Sep 18 21:27:01 devstack cinder-volume[75113]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 18 21:27:01 devstack cinder-volume[75113]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 18 21:27:01 devstack cinder-volume[75113]: we strongly recommend against using it for new projects. Sep 18 21:27:01 devstack cinder-volume[75113]: If you are already using Eventlet, we recommend migrating to a different Sep 18 21:27:01 devstack cinder-volume[75113]: framework. For more detail see Sep 18 21:27:01 devstack cinder-volume[75113]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 18 21:27:01 devstack cinder-volume[75113]: import eventlet # noqa Sep 18 21:27:04 devstack cinder-volume[75113]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 18 21:27:04 devstack cinder-volume[75113]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 18 21:27:04 devstack cinder-volume[75113]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 18 21:27:05 devstack cinder-volume[75113]: INFO dbcounter [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] Registered counter for database cinder Sep 18 21:27:05 devstack cinder-volume[75113]: DEBUG oslo_db.sqlalchemy.engines [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75113) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 18 21:27:06 devstack cinder-volume[75113]: DEBUG dbcounter [-] [75113] Writer thread running {{(pid=75113) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 18 21:27:06 devstack cinder-volume[75113]: INFO cinder.rpc [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 18 21:27:06 devstack cinder-volume[75113]: INFO cinder.rpc [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 18 21:27:06 devstack cinder-volume[75113]: DEBUG oslo_db.sqlalchemy.engines [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75113) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 18 21:27:06 devstack cinder-volume[75113]: INFO cinder.volume.manager [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] Determined volume DB was empty at startup. Sep 18 21:27:06 devstack cinder-volume[75113]: DEBUG cinder.volume.manager [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75113) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 18 21:27:06 devstack cinder-volume[75113]: INFO cinder.volume.manager [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 18 21:27:06 devstack cinder-volume[75113]: WARNING stevedore.named [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 18 21:27:06 devstack cinder-volume[75113]: WARNING castellan.key_manager [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 18 21:27:06 devstack cinder-volume[75113]: WARNING cinder.keymgr.conf_key_mgr [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 18 21:27:06 devstack cinder-volume[75113]: DEBUG cinder.volume.drivers.lvm [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75113) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 18 21:27:06 devstack cinder-volume[75113]: DEBUG oslo_concurrency.processutils [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75113) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:27:06 devstack cinder-volume[75113]: DEBUG oslo_concurrency.processutils [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] CMD "cinder-rtstool verify" returned: 0 in 0.553s {{(pid=75113) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_db.sqlalchemy.engines [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75113) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 18 21:27:07 devstack cinder-volume[75113]: INFO cinder.rpc [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 18 21:27:07 devstack cinder-volume[75113]: INFO cinder.rpc [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 18 21:27:07 devstack cinder-volume[75113]: WARNING stevedore.named [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 18 21:27:07 devstack cinder-volume[75113]: WARNING castellan.key_manager [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 18 21:27:07 devstack cinder-volume[75113]: INFO cinder.volume.manager [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_db.sqlalchemy.engines [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75113) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 18 21:27:07 devstack cinder-volume[75113]: INFO oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] Starting 1 workers Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] Started child 75309 {{(pid=75113) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] Full set of CONF: {{(pid=75113) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] ******************************************************************************** {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] Configuration options gathered from: {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] ================================================================================ {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] allow_availability_zone_fallback = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] allow_compression_on_image_upload = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] allowed_direct_url_schemes = [] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] api_rate_limit = True {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] auth_strategy = keystone {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] az_cache_duration = 3600 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] backend_availability_zone = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] backend_host = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] backend_name = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] backend_stats_polling_interval = 60 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] backup_api_class = cinder.backup.api.API {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] backup_name_template = backup-%s {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] backup_use_same_host = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] backup_use_temp_snapshot = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] chap_password = **** {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75309]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] chap_username = {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] cinder_internal_tenant_project_id = a205603f49dc45e3a1bf0718b51d9f0f {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] cinder_internal_tenant_user_id = e9f950adb5eb489ebeccd5b58878bbc3 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] cloned_volume_same_az = True {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] cluster = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] compression_format = gzip {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] compute_api_class = cinder.compute.nova.API {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] config_dir = [] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] config_source = [] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] control_exchange = openstack {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] debug = True {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] default_availability_zone = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] default_group_type = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] default_volume_type = lvmdriver-1 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] disk_geometry = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] driver_client_cert = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] driver_client_cert_key = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] driver_data_namespace = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] driver_ssl_cert_path = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] driver_ssl_cert_verify = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] driver_use_ssl = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] enable_force_upload = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] enable_new_services = True {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] enable_unsupported_driver = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] enforce_multipath_for_image_xfer = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] filter_function = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] glance_api_insecure = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] glance_api_servers = ['http://192.168.122.22/image'] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] glance_api_ssl_compression = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] glance_ca_certificates_file = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] glance_catalog_info = image:glance:publicURL {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] glance_certfile = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] glance_keyfile = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] glance_num_retries = 3 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] glance_request_timeout = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] goodness_function = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] graceful_shutdown_timeout = 5 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] group_api_class = cinder.group.api.API {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] host = devstack {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] image_compress_on_upload = True {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] image_conversion_address_space_limit = 1 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] image_conversion_cpu_limit = 60 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] image_conversion_disable = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] image_introspection_address_space_limit = 1 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] image_introspection_cpu_limit = 60 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] image_upload_use_cinder_backend = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] image_upload_use_internal_tenant = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] image_volume_cache_enabled = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] image_volume_cache_max_count = 0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] image_volume_cache_max_size_gb = 0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] init_host_max_objects_retrieval = 0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] instance_format = [instance: %(uuid)s] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] iscsi_target_flags = {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] iscsi_write_cache = on {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] iser_helper = tgtadm {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] iser_ip_address = 192.168.122.22 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] iser_port = 3260 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] log_color = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] log_config_append = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] log_dir = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] log_file = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] log_options = True {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] log_rotate_interval = 1 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] log_rotate_interval_type = days {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] log_rotation_type = none {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] max_age = 0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] max_logfile_count = 30 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] max_logfile_size_mb = 200 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] max_over_subscription_ratio = 20.0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] message_reap_interval = 86400 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] message_ttl = 2592000 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] migration_create_volume_timeout_secs = 300 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] monkey_patch = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75309]: INFO cinder.volume.manager [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] monkey_patch_modules = [] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] my_ip = 192.168.122.22 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] no_snapshot_gb_quota = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] num_iser_scan_tries = 3 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] num_shell_tries = 3 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] num_volume_device_scan_tries = 3 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] nvmeof_conn_info_version = 1 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] nvmet_ns_id = 10 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] nvmet_port_id = 1 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] osapi_max_limit = 1000 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] osapi_volume_ext_list = [] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] osapi_volume_listen_port = 8776 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] osapi_volume_use_ssl = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] osapi_volume_workers = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] per_volume_size_limit = -1 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] periodic_fuzzy_delay = 60 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] periodic_interval = 60 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] public_endpoint = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] publish_errors = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] quota_backup_gigabytes = 1000 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] quota_backups = 10 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] quota_gigabytes = 1000 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] quota_groups = 10 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] quota_snapshots = 10 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] quota_volumes = 10 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] rate_limit_burst = 0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] rate_limit_except_level = CRITICAL {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] rate_limit_interval = 0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] reinit_driver_count = 3 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] replication_device = **** {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] report_discard_supported = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] report_interval = 120 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] reservation_clean_interval = 86400 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] reservation_expire = 86400 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] reserved_image_namespaces = [] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] reserved_percentage = 0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] rpc_response_timeout = 120 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] run_external_periodic_tasks = True {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] scst_target_driver = iscsi {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] scst_target_iqn_name = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] service_down_time = 720 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] shell_completion = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] snapshot_name_template = snapshot-%s {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] snapshot_same_host = True {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] split_loggers = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] state_path = /opt/stack/data/cinder {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] storage_availability_zone = nova {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] storage_protocol = iSCSI {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] syslog_log_facility = LOG_USER {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] target_helper = lioadm {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] target_ip_address = 192.168.122.22 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] target_port = 3260 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] target_protocol = iscsi {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] target_secondary_ip_addresses = [] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] trace_flags = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] transport_url = **** {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] until_refresh = 0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] use_chap_auth = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.035s {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] use_default_quota_class = True {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] use_journal = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] use_json = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] use_multipath_for_image_xfer = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] use_stderr = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] use_syslog = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] verify_glance_signatures = enabled {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] volume_api_class = cinder.volume.api.API {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] volume_backend_name = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] volume_clear = zero {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] volume_clear_ionice = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] volume_clear_size = 0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] volume_copy_bps_limit = 0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] volume_dd_blocksize = 1M {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] volume_name_template = volume-%s {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] volume_service_inithost_offload = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] volume_usage_audit_period = month {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] zoning_mode = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] oslo_concurrency.disable_process_locking = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] keystone_authtoken.auth_section = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] keystone_authtoken.auth_type = password {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] keystone_authtoken.auth_version = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] keystone_authtoken.cache = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] keystone_authtoken.certfile = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] keystone_authtoken.include_service_catalog = True {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] keystone_authtoken.insecure = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] keystone_authtoken.interface = public {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] keystone_authtoken.keyfile = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] keystone_authtoken.memcache_password = **** {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] keystone_authtoken.memcache_username = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] keystone_authtoken.region_name = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] keystone_authtoken.service_type = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.22/identity {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] cache.backend = dogpile.cache.null {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] cache.backend_argument = **** {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] cache.backend_expiration_time = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] cache.config_prefix = cache.oslo {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] cache.debug_cache_backend = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] cache.enable_retry_client = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] cache.enable_socket_keepalive = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] cache.enabled = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] cache.expiration_time = 600 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] cache.hashclient_retry_attempts = 2 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] cache.memcache_dead_retry = 300 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] cache.memcache_pool_maxsize = 10 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] cache.memcache_sasl_enabled = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] cache.password = **** {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] cache.proxies = [] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] cache.redis_db = 0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] cache.redis_server = localhost:6379 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] cache.retry_attempts = 2 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] cache.retry_delay = 0.0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] cache.socket_keepalive_count = 1 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] cache.socket_keepalive_idle = 1 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] cache.socket_keepalive_interval = 1 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] cache.socket_timeout = 1.0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] cache.tls_allowed_ciphers = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] cache.tls_cafile = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] cache.tls_certfile = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] cache.tls_enabled = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] cache.tls_keyfile = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] cache.username = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] coordination.backend_url = **** {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] database.asyncio_connection = **** {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] database.asyncio_slave_connection = **** {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] database.backend = sqlalchemy {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] database.connection = **** {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] database.connection_debug = 0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] database.connection_parameters = {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] database.connection_recycle_time = 3600 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] database.connection_trace = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] database.db_inc_retry_interval = True {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] database.db_max_retries = 20 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] database.db_max_retry_interval = 10 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] database.db_retry_interval = 1 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] database.max_overflow = 50 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] database.max_pool_size = 5 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] database.max_retries = 10 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] database.mysql_wsrep_sync_wait = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] database.pool_timeout = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] database.retry_interval = 10 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] database.slave_connection = **** {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] database.sqlite_synchronous = True {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] database.synchronous_reader = True {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] database.use_db_reconnect = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] oslo_messaging_tracing.insecure = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.036s {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] profiler.connection_string = messaging:// {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] profiler.enabled = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] profiler.es_doc_type = notification {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] profiler.es_scroll_size = 10000 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] profiler.es_scroll_time = 2m {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] profiler.filter_error_trace = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] profiler.hmac_keys = **** {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] profiler.sentinel_service_name = mymaster {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] profiler.socket_timeout = 0.1 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] profiler.trace_requests = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] profiler.trace_sqlalchemy = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] profiler_jaeger.process_tags = {} {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] profiler_jaeger.service_name_prefix = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] profiler_otlp.service_name_prefix = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] oslo_policy.enforce_new_defaults = True {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] oslo_policy.policy_default_rule = default {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] oslo_policy.policy_file = policy.yaml {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] privsep_osbrick.group = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] privsep_osbrick.helper_command = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] privsep_osbrick.user = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] cinder_sys_admin.group = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] cinder_sys_admin.helper_command = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] cinder_sys_admin.user = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] service_user.auth_section = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] service_user.auth_type = password {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] service_user.cafile = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] service_user.certfile = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] service_user.collect_timing = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] service_user.insecure = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] service_user.keyfile = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] service_user.send_service_user_token = True {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] service_user.split_loggers = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] service_user.timeout = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] service_user.tls_ciphers = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] service_user.tls_min_version = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] glance.auth_section = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] glance.auth_type = password {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] glance.certfile = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] glance.collect_timing = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] glance.insecure = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] glance.keyfile = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] glance.region_name = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] glance.split_loggers = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] glance.timeout = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] glance.tls_ciphers = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] glance.tls_min_version = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] backend_defaults.backend_availability_zone = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] backend_defaults.chap_password = **** {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] backend_defaults.chap_username = {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] backend_defaults.disk_geometry = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack sudo[75357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] backend_defaults.driver_client_cert = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] backend_defaults.driver_client_cert_key = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] backend_defaults.driver_data_namespace = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack sudo[75357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] backend_defaults.driver_use_ssl = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] backend_defaults.extra_capabilities = {} {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] backend_defaults.filter_function = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] backend_defaults.goodness_function = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] backend_defaults.iscsi_target_flags = {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] backend_defaults.iscsi_write_cache = on {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] backend_defaults.iser_helper = tgtadm {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] backend_defaults.iser_ip_address = 192.168.122.22 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] backend_defaults.iser_port = 3260 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] backend_defaults.lvm_share_target = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] backend_defaults.lvm_type = auto {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] backend_defaults.num_shell_tries = 3 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] backend_defaults.replication_device = **** {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] backend_defaults.report_discard_supported = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] backend_defaults.reserved_percentage = 0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] backend_defaults.target_helper = tgtadm {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] backend_defaults.target_ip_address = 192.168.122.22 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] backend_defaults.target_port = 3260 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] backend_defaults.target_protocol = iscsi {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] backend_defaults.trace_flags = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] backend_defaults.unique_fqdn_network = True {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] backend_defaults.use_chap_auth = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] backend_defaults.volume_backend_name = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] backend_defaults.volume_clear = zero {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] backend_defaults.volume_clear_ionice = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] backend_defaults.volume_clear_size = 0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] oslo_reports.file_event_handler = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] oslo_reports.log_dir = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] lvmdriver-1.backend_host = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] lvmdriver-1.chap_password = **** {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] lvmdriver-1.chap_username = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] lvmdriver-1.disk_geometry = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] lvmdriver-1.driver_client_cert = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] lvmdriver-1.extra_capabilities = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] lvmdriver-1.filter_function = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] lvmdriver-1.goodness_function = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] lvmdriver-1.iser_helper = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] lvmdriver-1.iser_ip_address = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] lvmdriver-1.iser_port = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] lvmdriver-1.lvm_share_target = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] lvmdriver-1.lvm_type = auto {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] lvmdriver-1.num_shell_tries = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] lvmdriver-1.replication_device = **** {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] lvmdriver-1.report_discard_supported = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] lvmdriver-1.reserved_percentage = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] lvmdriver-1.scst_target_driver = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] lvmdriver-1.storage_protocol = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] lvmdriver-1.target_helper = lioadm {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] lvmdriver-1.target_ip_address = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] lvmdriver-1.target_port = 3260 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] lvmdriver-1.trace_flags = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] lvmdriver-1.use_chap_auth = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] lvmdriver-1.volume_clear = zero {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] lvmdriver-1.volume_clear_size = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] lvmdriver-1.volumes_dir = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] oslo_messaging_rabbit.ssl = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] oslo_messaging_notifications.driver = [] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] oslo_messaging_notifications.retry = -1 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] key_manager.fixed_key = **** {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] barbican.barbican_api_version = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] barbican.barbican_endpoint = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] barbican.barbican_endpoint_type = public {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] barbican.barbican_region_name = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] barbican.cafile = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] barbican.certfile = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] barbican.collect_timing = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] barbican.insecure = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] barbican.keyfile = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] barbican.number_of_retries = 60 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] barbican.retry_delay = 1 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] barbican.send_service_user_token = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] barbican.split_loggers = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] barbican.timeout = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] barbican.tls_ciphers = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] barbican.tls_min_version = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] barbican.verify_ssl = True {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] barbican.verify_ssl_path = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] barbican_service_user.auth_section = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] barbican_service_user.auth_type = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] barbican_service_user.cafile = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] barbican_service_user.certfile = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] barbican_service_user.collect_timing = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] barbican_service_user.insecure = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] barbican_service_user.keyfile = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] barbican_service_user.split_loggers = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] barbican_service_user.timeout = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] barbican_service_user.tls_ciphers = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] barbican_service_user.tls_min_version = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] vault.approle_role_id = **** {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] vault.approle_secret_id = **** {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] vault.auth_method = approle {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] vault.auth_path = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] vault.kv_mountpoint = secret {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] vault.kv_path = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] vault.kv_version = 2 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] vault.namespace = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] vault.root_token_id = **** {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] vault.ssl_ca_crt_file = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] vault.timeout = 60.0 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] vault.token_file = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] vault.token_role = None {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] vault.use_ssl = False {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:27:07 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] ******************************************************************************** {{(pid=75113) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 18 21:27:07 devstack sudo[75357]: pam_unix(sudo:session): session closed for user root Sep 18 21:27:07 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:27:07 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:27:07 devstack sudo[75474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 18 21:27:07 devstack sudo[75474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:27:07 devstack sudo[75474]: pam_unix(sudo:session): session closed for user root Sep 18 21:27:07 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.253s {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:27:07 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 18 21:27:07 devstack cinder-volume[75309]: INFO cinder.brick.local_dev.lvm [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 18 21:27:07 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:27:07 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:27:07 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:27:07 devstack sudo[75563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 18 21:27:07 devstack sudo[75563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:27:08 devstack sudo[75563]: pam_unix(sudo:session): session closed for user root Sep 18 21:27:08 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:27:08 devstack cinder-volume[75309]: DEBUG cinder.brick.local_dev.lvm [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75309) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 18 21:27:08 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:27:08 devstack sudo[75646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 18 21:27:08 devstack sudo[75646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:27:08 devstack sudo[75646]: pam_unix(sudo:session): session closed for user root Sep 18 21:27:08 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.538s {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:27:08 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:27:08 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:27:08 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:27:08 devstack sudo[75833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 18 21:27:08 devstack sudo[75833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:27:09 devstack sudo[75833]: pam_unix(sudo:session): session closed for user root Sep 18 21:27:09 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.341s {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:27:09 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:27:09 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:27:09 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:27:09 devstack sudo[75918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 18 21:27:09 devstack sudo[75918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:27:09 devstack sudo[75918]: pam_unix(sudo:session): session closed for user root Sep 18 21:27:09 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.302s {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:27:09 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:27:09 devstack sudo[75972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 18 21:27:09 devstack sudo[75972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:27:09 devstack sudo[75972]: pam_unix(sudo:session): session closed for user root Sep 18 21:27:09 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.336s {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:27:09 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:27:09 devstack sudo[76005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 18 21:27:09 devstack sudo[76005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:27:10 devstack sudo[76005]: pam_unix(sudo:session): session closed for user root Sep 18 21:27:10 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.329s {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:27:10 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:27:10 devstack sudo[76032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 18 21:27:10 devstack sudo[76032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:27:10 devstack sudo[76032]: pam_unix(sudo:session): session closed for user root Sep 18 21:27:10 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.313s {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:27:10 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:27:10 devstack sudo[76097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 18 21:27:10 devstack sudo[76097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:27:10 devstack sudo[76097]: pam_unix(sudo:session): session closed for user root Sep 18 21:27:10 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.296s {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:27:10 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:27:10 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:27:10 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:27:10 devstack sudo[76101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 18 21:27:10 devstack sudo[76101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:27:10 devstack sudo[76101]: pam_unix(sudo:session): session closed for user root Sep 18 21:27:11 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.273s {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:27:11 devstack cinder-volume[75309]: INFO cinder.volume.drivers.lvm [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 18 21:27:11 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:27:11 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:27:11 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:27:11 devstack sudo[76111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 18 21:27:11 devstack sudo[76111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:27:11 devstack sudo[76111]: pam_unix(sudo:session): session closed for user root Sep 18 21:27:11 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:27:11 devstack cinder-volume[75309]: DEBUG cinder.volume.drivers.lvm [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] Updating volume stats {{(pid=75309) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 18 21:27:11 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:27:11 devstack sudo[76114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 18 21:27:11 devstack sudo[76114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:27:11 devstack sudo[76114]: pam_unix(sudo:session): session closed for user root Sep 18 21:27:11 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:27:11 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:27:11 devstack sudo[76117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 18 21:27:11 devstack sudo[76117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:27:11 devstack sudo[76117]: pam_unix(sudo:session): session closed for user root Sep 18 21:27:11 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:27:11 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:27:11 devstack sudo[76120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 18 21:27:11 devstack sudo[76120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:27:12 devstack sudo[76120]: pam_unix(sudo:session): session closed for user root Sep 18 21:27:12 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:27:12 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:27:12 devstack sudo[76124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 18 21:27:12 devstack sudo[76124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:27:12 devstack sudo[76124]: pam_unix(sudo:session): session closed for user root Sep 18 21:27:12 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:27:12 devstack cinder-volume[75309]: INFO cinder.volume.driver [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] Driver hasn't implemented _init_vendor_properties() Sep 18 21:27:12 devstack cinder-volume[75309]: DEBUG cinder.volume.driver [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75309) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 18 21:27:12 devstack cinder-volume[75309]: DEBUG oslo_db.sqlalchemy.engines [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75309) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 18 21:27:12 devstack cinder-volume[75309]: DEBUG dbcounter [-] [75309] Writer thread running {{(pid=75309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 18 21:27:12 devstack cinder-volume[75309]: DEBUG cinder.db.api [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] Building query based on filter {{(pid=75309) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 18 21:27:12 devstack cinder-volume[75309]: DEBUG cinder.image.image_utils [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75309) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 18 21:27:12 devstack cinder-volume[75309]: INFO cinder.keymgr.migration [None req-2564fd59-1e58-45e5-aec8-a08a8d7cb90a None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 18 21:27:12 devstack cinder-volume[75309]: DEBUG cinder.volume.drivers.lvm [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] Updating volume stats {{(pid=75309) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 18 21:27:12 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:27:12 devstack sudo[76129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 18 21:27:12 devstack sudo[76129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:27:12 devstack sudo[76129]: pam_unix(sudo:session): session closed for user root Sep 18 21:27:12 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:27:12 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:27:12 devstack sudo[76132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 18 21:27:12 devstack sudo[76132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:27:13 devstack sudo[76132]: pam_unix(sudo:session): session closed for user root Sep 18 21:27:13 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:27:13 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:27:13 devstack sudo[76135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 18 21:27:13 devstack sudo[76135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:27:13 devstack sudo[76135]: pam_unix(sudo:session): session closed for user root Sep 18 21:27:13 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:27:13 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:27:13 devstack sudo[76138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 18 21:27:13 devstack sudo[76138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:27:13 devstack sudo[76138]: pam_unix(sudo:session): session closed for user root Sep 18 21:27:13 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:27:13 devstack cinder-volume[75309]: DEBUG cinder.manager [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] Notifying Schedulers of capabilities ... {{(pid=75309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:27:13 devstack cinder-volume[75309]: INFO cinder.volume.manager [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] Driver initialization completed successfully. Sep 18 21:27:13 devstack cinder-volume[75309]: INFO cinder.manager [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] Initiating service 2 cleanup Sep 18 21:27:13 devstack cinder-volume[75309]: INFO cinder.manager [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] Service 2 cleanup completed. Sep 18 21:27:13 devstack cinder-volume[75309]: DEBUG cinder.service [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] Creating RPC server for service cinder-volume {{(pid=75309) start /opt/stack/cinder/cinder/service.py:231}} Sep 18 21:27:13 devstack cinder-volume[75309]: DEBUG cinder.service [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75309) start /opt/stack/cinder/cinder/service.py:237}} Sep 18 21:27:13 devstack cinder-volume[75309]: INFO cinder.volume.manager [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 18 21:27:13 devstack cinder-volume[75309]: DEBUG cinder.volume.drivers.lvm [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] Updating volume stats {{(pid=75309) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 18 21:27:13 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:27:13 devstack sudo[76143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 18 21:27:13 devstack sudo[76143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:27:14 devstack sudo[76143]: pam_unix(sudo:session): session closed for user root Sep 18 21:27:14 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:27:14 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:27:14 devstack sudo[76149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 18 21:27:14 devstack sudo[76149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:27:14 devstack sudo[76149]: pam_unix(sudo:session): session closed for user root Sep 18 21:27:14 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.242s {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:27:14 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:27:14 devstack sudo[76152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 18 21:27:14 devstack sudo[76152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:27:14 devstack sudo[76152]: pam_unix(sudo:session): session closed for user root Sep 18 21:27:14 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.243s {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:27:14 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:27:14 devstack sudo[76155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 18 21:27:14 devstack sudo[76155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:27:14 devstack sudo[76155]: pam_unix(sudo:session): session closed for user root Sep 18 21:27:14 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:27:14 devstack cinder-volume[75309]: INFO cinder.volume.manager [None req-17864db9-7c4d-488d-8967-09629f8e6aec None None] Driver post RPC initialization completed successfully. Sep 18 21:27:17 devstack cinder-volume[75113]: DEBUG dbcounter [-] [75113] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75113) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 21:27:24 devstack cinder-volume[75309]: DEBUG dbcounter [-] [75309] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 21:27:24 devstack cinder-volume[75309]: DEBUG dbcounter [-] [75309] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=75309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 21:27:39 devstack cinder-volume[75309]: DEBUG oslo_service.periodic_task [None req-2ae93de6-6c7b-42f0-806d-8e37c4025de2 None None] Running periodic task VolumeManager._thread_info {{(pid=75309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 21:27:39 devstack cinder-volume[75309]: DEBUG cinder.volume.manager [None req-2ae93de6-6c7b-42f0-806d-8e37c4025de2 None None] thread count: 6 {{(pid=75309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 18 21:27:39 devstack cinder-volume[75309]: DEBUG cinder.volume.manager [None req-2ae93de6-6c7b-42f0-806d-8e37c4025de2 None None] thread info: [<_MainThread(MainThread, started 134175595110528)>, , , , , ] {{(pid=75309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 18 21:28:39 devstack cinder-volume[75309]: DEBUG oslo_service.periodic_task [None req-2ae93de6-6c7b-42f0-806d-8e37c4025de2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 21:28:39 devstack cinder-volume[75309]: DEBUG cinder.volume.drivers.lvm [None req-2ae93de6-6c7b-42f0-806d-8e37c4025de2 None None] Updating volume stats {{(pid=75309) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 18 21:28:39 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-2ae93de6-6c7b-42f0-806d-8e37c4025de2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:28:39 devstack sudo[78798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 18 21:28:39 devstack sudo[78798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:28:40 devstack sudo[78798]: pam_unix(sudo:session): session closed for user root Sep 18 21:28:40 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-2ae93de6-6c7b-42f0-806d-8e37c4025de2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:28:40 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-2ae93de6-6c7b-42f0-806d-8e37c4025de2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:28:40 devstack sudo[78801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 18 21:28:40 devstack sudo[78801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:28:40 devstack sudo[78801]: pam_unix(sudo:session): session closed for user root Sep 18 21:28:40 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-2ae93de6-6c7b-42f0-806d-8e37c4025de2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.305s {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:28:40 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-2ae93de6-6c7b-42f0-806d-8e37c4025de2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:28:40 devstack sudo[78805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 18 21:28:40 devstack sudo[78805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:28:40 devstack sudo[78805]: pam_unix(sudo:session): session closed for user root Sep 18 21:28:40 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-2ae93de6-6c7b-42f0-806d-8e37c4025de2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.276s {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:28:40 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-2ae93de6-6c7b-42f0-806d-8e37c4025de2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:28:40 devstack sudo[78808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 18 21:28:40 devstack sudo[78808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:28:40 devstack sudo[78808]: pam_unix(sudo:session): session closed for user root Sep 18 21:28:40 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-2ae93de6-6c7b-42f0-806d-8e37c4025de2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.290s {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:28:40 devstack cinder-volume[75309]: DEBUG cinder.manager [None req-2ae93de6-6c7b-42f0-806d-8e37c4025de2 None None] Notifying Schedulers of capabilities ... {{(pid=75309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:28:40 devstack cinder-volume[75309]: DEBUG oslo_service.periodic_task [None req-2ae93de6-6c7b-42f0-806d-8e37c4025de2 None None] Running periodic task VolumeManager._thread_info {{(pid=75309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 21:28:40 devstack cinder-volume[75309]: DEBUG cinder.volume.manager [None req-2ae93de6-6c7b-42f0-806d-8e37c4025de2 None None] thread count: 6 {{(pid=75309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 18 21:28:40 devstack cinder-volume[75309]: DEBUG cinder.volume.manager [None req-2ae93de6-6c7b-42f0-806d-8e37c4025de2 None None] thread info: [<_MainThread(MainThread, started 134175595110528)>, , , , , ] {{(pid=75309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 18 21:29:24 devstack cinder-volume[75309]: DEBUG dbcounter [-] [75309] Writing DB stats cinder:SELECT=1 {{(pid=75309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 21:29:24 devstack cinder-volume[75309]: DEBUG dbcounter [-] [75309] Writing DB stats cinder:UPDATE=1 {{(pid=75309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 21:29:39 devstack cinder-volume[75309]: DEBUG oslo_service.periodic_task [None req-2ae93de6-6c7b-42f0-806d-8e37c4025de2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 21:29:39 devstack cinder-volume[75309]: DEBUG cinder.volume.drivers.lvm [None req-2ae93de6-6c7b-42f0-806d-8e37c4025de2 None None] Updating volume stats {{(pid=75309) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 18 21:29:39 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-2ae93de6-6c7b-42f0-806d-8e37c4025de2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:29:39 devstack sudo[82131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 18 21:29:39 devstack sudo[82131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:29:40 devstack sudo[82131]: pam_unix(sudo:session): session closed for user root Sep 18 21:29:40 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-2ae93de6-6c7b-42f0-806d-8e37c4025de2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:29:40 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-2ae93de6-6c7b-42f0-806d-8e37c4025de2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:29:40 devstack sudo[82339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 18 21:29:40 devstack sudo[82339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:29:40 devstack sudo[82339]: pam_unix(sudo:session): session closed for user root Sep 18 21:29:40 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-2ae93de6-6c7b-42f0-806d-8e37c4025de2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:29:40 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-2ae93de6-6c7b-42f0-806d-8e37c4025de2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:29:40 devstack sudo[82416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 18 21:29:40 devstack sudo[82416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:29:40 devstack sudo[82416]: pam_unix(sudo:session): session closed for user root Sep 18 21:29:40 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-2ae93de6-6c7b-42f0-806d-8e37c4025de2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.270s {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:29:40 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-2ae93de6-6c7b-42f0-806d-8e37c4025de2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:29:40 devstack sudo[82426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 18 21:29:40 devstack sudo[82426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:29:40 devstack sudo[82426]: pam_unix(sudo:session): session closed for user root Sep 18 21:29:40 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-2ae93de6-6c7b-42f0-806d-8e37c4025de2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:29:40 devstack cinder-volume[75309]: DEBUG cinder.manager [None req-2ae93de6-6c7b-42f0-806d-8e37c4025de2 None None] Notifying Schedulers of capabilities ... {{(pid=75309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:29:40 devstack cinder-volume[75309]: DEBUG oslo_service.periodic_task [None req-2ae93de6-6c7b-42f0-806d-8e37c4025de2 None None] Running periodic task VolumeManager._thread_info {{(pid=75309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 21:29:40 devstack cinder-volume[75309]: DEBUG cinder.volume.manager [None req-2ae93de6-6c7b-42f0-806d-8e37c4025de2 None None] thread count: 6 {{(pid=75309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 18 21:29:40 devstack cinder-volume[75309]: DEBUG cinder.volume.manager [None req-2ae93de6-6c7b-42f0-806d-8e37c4025de2 None None] thread info: [<_MainThread(MainThread, started 134175595110528)>, , , , , ] {{(pid=75309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 18 21:30:39 devstack cinder-volume[75309]: DEBUG oslo_service.periodic_task [None req-2ae93de6-6c7b-42f0-806d-8e37c4025de2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 21:30:39 devstack cinder-volume[75309]: DEBUG cinder.volume.drivers.lvm [None req-2ae93de6-6c7b-42f0-806d-8e37c4025de2 None None] Updating volume stats {{(pid=75309) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 18 21:30:39 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-2ae93de6-6c7b-42f0-806d-8e37c4025de2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:30:39 devstack sudo[84126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 18 21:30:39 devstack sudo[84126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:30:40 devstack sudo[84126]: pam_unix(sudo:session): session closed for user root Sep 18 21:30:40 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-2ae93de6-6c7b-42f0-806d-8e37c4025de2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:30:40 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-2ae93de6-6c7b-42f0-806d-8e37c4025de2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:30:40 devstack sudo[84137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 18 21:30:40 devstack sudo[84137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:30:40 devstack sudo[84137]: pam_unix(sudo:session): session closed for user root Sep 18 21:30:40 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-2ae93de6-6c7b-42f0-806d-8e37c4025de2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.240s {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:30:40 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-2ae93de6-6c7b-42f0-806d-8e37c4025de2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:30:40 devstack sudo[84156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 18 21:30:40 devstack sudo[84156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:30:40 devstack sudo[84156]: pam_unix(sudo:session): session closed for user root Sep 18 21:30:40 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-2ae93de6-6c7b-42f0-806d-8e37c4025de2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.233s {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:30:40 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-2ae93de6-6c7b-42f0-806d-8e37c4025de2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:30:40 devstack sudo[84159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 18 21:30:40 devstack sudo[84159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:30:40 devstack sudo[84159]: pam_unix(sudo:session): session closed for user root Sep 18 21:30:40 devstack cinder-volume[75309]: DEBUG oslo_concurrency.processutils [None req-2ae93de6-6c7b-42f0-806d-8e37c4025de2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=75309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:30:40 devstack cinder-volume[75309]: DEBUG cinder.manager [None req-2ae93de6-6c7b-42f0-806d-8e37c4025de2 None None] Notifying Schedulers of capabilities ... {{(pid=75309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:31:24 devstack cinder-volume[75309]: DEBUG dbcounter [-] [75309] Writing DB stats cinder:SELECT=1 {{(pid=75309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 21:31:24 devstack cinder-volume[75309]: DEBUG dbcounter [-] [75309] Writing DB stats cinder:UPDATE=1 {{(pid=75309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 21:31:33 devstack cinder-volume[75113]: INFO oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] Caught SIGTERM, stopping children Sep 18 21:31:33 devstack cinder-volume[75113]: DEBUG oslo_concurrency.lockutils [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] Acquiring lock "singleton_lock" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 18 21:31:33 devstack cinder-volume[75113]: DEBUG oslo_concurrency.lockutils [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] Acquired lock "singleton_lock" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 18 21:31:33 devstack cinder-volume[75113]: DEBUG oslo_concurrency.lockutils [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] Releasing lock "singleton_lock" {{(pid=75113) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 18 21:31:33 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] Stop services. {{(pid=75113) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 18 21:31:33 devstack cinder-volume[75113]: DEBUG oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] Killing children. {{(pid=75113) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 18 21:31:33 devstack cinder-volume[75113]: INFO oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] Waiting on 1 children to exit Sep 18 21:31:33 devstack cinder-volume[75309]: DEBUG oslo_concurrency.lockutils [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] Acquiring lock "singleton_lock" {{(pid=75309) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 18 21:31:33 devstack cinder-volume[75309]: DEBUG oslo_concurrency.lockutils [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] Acquired lock "singleton_lock" {{(pid=75309) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 18 21:31:33 devstack cinder-volume[75309]: DEBUG oslo_concurrency.lockutils [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] Releasing lock "singleton_lock" {{(pid=75309) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 18 21:31:33 devstack cinder-volume[75309]: WARNING amqp [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 18 21:31:33 devstack cinder-volume[75309]: WARNING amqp [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 18 21:31:33 devstack cinder-volume[75113]: INFO oslo_service.backend._eventlet.service [None req-a228e774-e6c9-4080-b13c-4f6dfac529a0 None None] Child 75309 exited with status 0 Sep 18 21:31:34 devstack cinder-volume[85293]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 18 21:31:34 devstack cinder-volume[85293]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 18 21:31:34 devstack cinder-volume[85293]: we strongly recommend against using it for new projects. Sep 18 21:31:34 devstack cinder-volume[85293]: If you are already using Eventlet, we recommend migrating to a different Sep 18 21:31:34 devstack cinder-volume[85293]: framework. For more detail see Sep 18 21:31:34 devstack cinder-volume[85293]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 18 21:31:34 devstack cinder-volume[85293]: import eventlet # noqa Sep 18 21:31:36 devstack cinder-volume[85293]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85293) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 18 21:31:36 devstack cinder-volume[85293]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85293) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 18 21:31:36 devstack cinder-volume[85293]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85293) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 18 21:31:36 devstack cinder-volume[85293]: INFO dbcounter [None req-45938cda-df95-4038-b9ac-539046da463f None None] Registered counter for database cinder Sep 18 21:31:36 devstack cinder-volume[85293]: DEBUG oslo_db.sqlalchemy.engines [None req-45938cda-df95-4038-b9ac-539046da463f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85293) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG dbcounter [-] [85293] Writer thread running {{(pid=85293) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 18 21:31:37 devstack cinder-volume[85293]: INFO cinder.rpc [None req-45938cda-df95-4038-b9ac-539046da463f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 18 21:31:37 devstack cinder-volume[85293]: INFO cinder.rpc [None req-45938cda-df95-4038-b9ac-539046da463f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_db.sqlalchemy.engines [None req-45938cda-df95-4038-b9ac-539046da463f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85293) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 18 21:31:37 devstack cinder-volume[85293]: INFO cinder.volume.manager [None req-45938cda-df95-4038-b9ac-539046da463f None None] Determined volume DB was empty at startup. Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG cinder.volume.manager [None req-45938cda-df95-4038-b9ac-539046da463f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85293) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 18 21:31:37 devstack cinder-volume[85293]: INFO cinder.volume.manager [None req-45938cda-df95-4038-b9ac-539046da463f None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 18 21:31:37 devstack cinder-volume[85293]: WARNING stevedore.named [None req-45938cda-df95-4038-b9ac-539046da463f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 18 21:31:37 devstack cinder-volume[85293]: WARNING castellan.key_manager [None req-45938cda-df95-4038-b9ac-539046da463f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 18 21:31:37 devstack cinder-volume[85293]: WARNING cinder.keymgr.conf_key_mgr [None req-45938cda-df95-4038-b9ac-539046da463f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 18 21:31:37 devstack cinder-volume[85293]: INFO cinder.volume.manager [None req-45938cda-df95-4038-b9ac-539046da463f None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_db.sqlalchemy.engines [None req-45938cda-df95-4038-b9ac-539046da463f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85293) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 18 21:31:37 devstack cinder-volume[85293]: INFO oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] Starting 1 workers Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] Started child 85507 {{(pid=85293) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] Full set of CONF: {{(pid=85293) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] ******************************************************************************** {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] Configuration options gathered from: {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] ================================================================================ {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] allow_availability_zone_fallback = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] allow_compression_on_image_upload = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] allowed_direct_url_schemes = [] {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] api_rate_limit = True {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] auth_strategy = keystone {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backend_availability_zone = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backend_host = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backend_name = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backend_stats_polling_interval = 60 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backup_api_class = cinder.backup.api.API {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backup_name_template = backup-%s {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backup_use_same_host = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backup_use_temp_snapshot = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] chap_password = **** {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] chap_username = {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85507]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] cinder_internal_tenant_project_id = a205603f49dc45e3a1bf0718b51d9f0f {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] cinder_internal_tenant_user_id = e9f950adb5eb489ebeccd5b58878bbc3 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] cluster = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] compression_format = gzip {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] compute_api_class = cinder.compute.nova.API {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] config_dir = [] {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] config_source = [] {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] control_exchange = openstack {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] debug = True {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] default_availability_zone = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] default_group_type = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] default_volume_type = QuobyteHD {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] disk_geometry = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] driver_client_cert = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] driver_client_cert_key = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] driver_data_namespace = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] driver_ssl_cert_path = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] driver_ssl_cert_verify = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] driver_use_ssl = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] enable_new_services = True {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] enable_unsupported_driver = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] enabled_backends = ['QuobyteHD'] {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] enforce_multipath_for_image_xfer = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] filter_function = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] glance_api_insecure = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] glance_api_servers = ['http://192.168.122.22/image'] {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] glance_api_ssl_compression = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] glance_ca_certificates_file = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] glance_catalog_info = image:glance:publicURL {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] glance_certfile = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] glance_keyfile = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] glance_num_retries = 3 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] glance_request_timeout = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] goodness_function = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] graceful_shutdown_timeout = 5 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] group_api_class = cinder.group.api.API {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] host = devstack {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] image_compress_on_upload = True {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] image_conversion_address_space_limit = 1 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] image_conversion_cpu_limit = 60 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] image_conversion_disable = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] image_introspection_address_space_limit = 1 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] image_introspection_cpu_limit = 60 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] image_upload_use_cinder_backend = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] image_upload_use_internal_tenant = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] image_volume_cache_enabled = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] image_volume_cache_max_count = 0 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] image_volume_cache_max_size_gb = 0 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] init_host_max_objects_retrieval = 0 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] instance_format = [instance: %(uuid)s] {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] iscsi_target_flags = {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] iscsi_write_cache = on {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] iser_helper = tgtadm {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] iser_ip_address = 192.168.122.22 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] iser_port = 3260 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] log_color = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] log_config_append = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] log_dir = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] log_file = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] log_options = True {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] log_rotate_interval = 1 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] log_rotate_interval_type = days {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] log_rotation_type = none {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] max_age = 0 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] max_logfile_count = 30 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] max_logfile_size_mb = 200 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] max_over_subscription_ratio = 20.0 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] message_reap_interval = 86400 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] message_ttl = 2592000 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] migration_create_volume_timeout_secs = 300 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] monkey_patch = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] monkey_patch_modules = [] {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] my_ip = 192.168.122.22 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] no_snapshot_gb_quota = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] num_iser_scan_tries = 3 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] num_shell_tries = 3 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] num_volume_device_scan_tries = 3 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] nvmeof_conn_info_version = 1 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] nvmet_ns_id = 10 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] nvmet_port_id = 1 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] osapi_max_limit = 1000 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] osapi_volume_ext_list = [] {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] osapi_volume_listen = 0.0.0.0 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] osapi_volume_listen_port = 8776 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] osapi_volume_use_ssl = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] osapi_volume_workers = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] per_volume_size_limit = -1 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] periodic_fuzzy_delay = 60 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] periodic_interval = 60 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] project_id_regex = [0-9a-f\-]+ {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] public_endpoint = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] publish_errors = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] quota_backup_gigabytes = 1000 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] quota_backups = 10 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] quota_gigabytes = 1000 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] quota_groups = 10 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] quota_snapshots = 10 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] quota_volumes = 10 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] rate_limit_burst = 0 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] rate_limit_except_level = CRITICAL {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] rate_limit_interval = 0 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] reinit_driver_count = 3 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] replication_device = **** {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] report_discard_supported = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] report_interval = 120 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] reservation_clean_interval = 86400 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] reservation_expire = 86400 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] reserved_image_namespaces = [] {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] reserved_percentage = 0 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] rpc_response_timeout = 120 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] run_external_periodic_tasks = True {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] scst_target_driver = iscsi {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] scst_target_iqn_name = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] service_down_time = 720 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] shell_completion = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] snapshot_name_template = snapshot-%s {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] split_loggers = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] state_path = /opt/stack/data/cinder {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] storage_availability_zone = nova {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] storage_protocol = iSCSI {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] syslog_log_facility = LOG_USER {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] target_helper = lioadm {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] target_ip_address = 192.168.122.22 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] target_port = 3260 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] target_protocol = iscsi {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] target_secondary_ip_addresses = [] {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] trace_flags = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] transfer_api_class = cinder.transfer.api.API {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] transport_url = **** {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] until_refresh = 0 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] use_chap_auth = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] use_default_quota_class = True {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] use_journal = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] use_json = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] use_multipath_for_image_xfer = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] use_stderr = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] use_syslog = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] verify_glance_signatures = enabled {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] volume_api_class = cinder.volume.api.API {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] volume_backend_name = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] volume_clear = zero {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] volume_clear_ionice = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] volume_clear_size = 0 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] volume_copy_bps_limit = 0 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] volume_dd_blocksize = 1M {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] volume_name_template = volume-%s {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] volume_service_inithost_offload = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] volume_usage_audit_period = month {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] zoning_mode = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] oslo_concurrency.disable_process_locking = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] keystone_authtoken.auth_section = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] keystone_authtoken.auth_type = password {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] keystone_authtoken.auth_version = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] keystone_authtoken.cache = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] keystone_authtoken.certfile = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] keystone_authtoken.delay_auth_decision = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] keystone_authtoken.http_connect_timeout = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] keystone_authtoken.include_service_catalog = True {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] keystone_authtoken.insecure = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] keystone_authtoken.interface = public {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] keystone_authtoken.keyfile = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] keystone_authtoken.memcache_password = **** {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] keystone_authtoken.memcache_username = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] keystone_authtoken.region_name = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] keystone_authtoken.service_token_roles_required = True {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] keystone_authtoken.service_type = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] keystone_authtoken.token_cache_time = 300 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.22/identity {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] cache.backend = dogpile.cache.null {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] cache.backend_argument = **** {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] cache.backend_expiration_time = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] cache.config_prefix = cache.oslo {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] cache.debug_cache_backend = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] cache.enable_retry_client = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] cache.enable_socket_keepalive = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] cache.enabled = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] cache.expiration_time = 600 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] cache.hashclient_retry_attempts = 2 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] cache.memcache_dead_retry = 300 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] cache.memcache_pool_maxsize = 10 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] cache.memcache_sasl_enabled = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] cache.password = **** {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] cache.proxies = [] {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] cache.redis_db = 0 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] cache.redis_sentinel_service_name = mymaster {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] cache.redis_server = localhost:6379 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] cache.retry_attempts = 2 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] cache.retry_delay = 0.0 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] cache.socket_keepalive_count = 1 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] cache.socket_keepalive_idle = 1 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] cache.socket_keepalive_interval = 1 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] cache.socket_timeout = 1.0 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] cache.tls_allowed_ciphers = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] cache.tls_cafile = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] cache.tls_certfile = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] cache.tls_enabled = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] cache.tls_keyfile = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] cache.username = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] coordination.backend_url = **** {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] database.asyncio_connection = **** {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] database.asyncio_slave_connection = **** {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] database.backend = sqlalchemy {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] database.connection = **** {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] database.connection_debug = 0 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] database.connection_parameters = {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] database.connection_recycle_time = 3600 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] database.connection_trace = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] database.db_inc_retry_interval = True {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] database.db_max_retries = 20 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] database.db_max_retry_interval = 10 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] database.db_retry_interval = 1 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] database.max_overflow = 50 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] database.max_pool_size = 5 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] database.max_retries = 10 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] database.mysql_wsrep_sync_wait = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] database.pool_timeout = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] database.retry_interval = 10 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] database.slave_connection = **** {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] database.sqlite_synchronous = True {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] database.synchronous_reader = True {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] database.use_db_reconnect = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] oslo_messaging_tracing.insecure = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] profiler.connection_string = messaging:// {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] profiler.enabled = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] profiler.es_doc_type = notification {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] profiler.es_scroll_size = 10000 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] profiler.es_scroll_time = 2m {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] profiler.filter_error_trace = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] profiler.hmac_keys = **** {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] profiler.sentinel_service_name = mymaster {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] profiler.socket_timeout = 0.1 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] profiler.trace_requests = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] profiler.trace_sqlalchemy = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] profiler_jaeger.process_tags = {} {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] profiler_jaeger.service_name_prefix = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] profiler_otlp.service_name_prefix = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] oslo_policy.enforce_new_defaults = True {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] oslo_policy.policy_default_rule = default {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] oslo_policy.policy_file = policy.yaml {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] oslo_policy.remote_timeout = 60.0 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] privsep_osbrick.group = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] privsep_osbrick.helper_command = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] privsep_osbrick.user = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] cinder_sys_admin.group = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] cinder_sys_admin.helper_command = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] cinder_sys_admin.user = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] service_user.auth_section = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] service_user.auth_type = password {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] service_user.cafile = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] service_user.certfile = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] service_user.collect_timing = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] service_user.insecure = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] service_user.keyfile = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] service_user.send_service_user_token = True {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] service_user.split_loggers = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] service_user.timeout = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] service_user.tls_ciphers = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] service_user.tls_min_version = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85507]: INFO cinder.volume.manager [None req-13b8267b-85c6-4dd4-8758-16555c613c7d None None] Starting volume driver QuobyteDriver (1.2.1) Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] glance.auth_section = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85507]: DEBUG cinder.volume.drivers.remotefs [None req-13b8267b-85c6-4dd4-8758-16555c613c7d None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85507) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] glance.auth_type = password {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] glance.certfile = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] glance.collect_timing = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] glance.insecure = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] glance.keyfile = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] glance.region_name = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] glance.split_loggers = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] glance.timeout = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] glance.tls_ciphers = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] glance.tls_min_version = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backend_defaults.backend_availability_zone = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backend_defaults.chap_password = **** {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backend_defaults.chap_username = {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backend_defaults.disk_geometry = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backend_defaults.driver_client_cert = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backend_defaults.driver_client_cert_key = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backend_defaults.driver_data_namespace = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backend_defaults.driver_use_ssl = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backend_defaults.enable_unsupported_driver = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backend_defaults.extra_capabilities = {} {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backend_defaults.filter_function = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backend_defaults.goodness_function = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backend_defaults.iscsi_target_flags = {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backend_defaults.iscsi_write_cache = on {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backend_defaults.iser_helper = tgtadm {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backend_defaults.iser_ip_address = 192.168.122.22 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backend_defaults.iser_port = 3260 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backend_defaults.nas_host = {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backend_defaults.nas_login = admin {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backend_defaults.nas_mount_options = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backend_defaults.nas_password = **** {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backend_defaults.nas_private_key = {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backend_defaults.nas_share_path = {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backend_defaults.nas_ssh_port = 22 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backend_defaults.num_shell_tries = 3 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backend_defaults.nvmet_port_id = 1 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backend_defaults.quobyte_client_cfg = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backend_defaults.quobyte_volume_url = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backend_defaults.replication_device = **** {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backend_defaults.report_discard_supported = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backend_defaults.reserved_percentage = 0 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backend_defaults.scst_target_driver = iscsi {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backend_defaults.scst_target_iqn_name = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backend_defaults.storage_protocol = iSCSI {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backend_defaults.target_helper = tgtadm {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backend_defaults.target_ip_address = 192.168.122.22 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backend_defaults.target_port = 3260 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backend_defaults.target_protocol = iscsi {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backend_defaults.trace_flags = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backend_defaults.unique_fqdn_network = True {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backend_defaults.use_chap_auth = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backend_defaults.volume_backend_name = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backend_defaults.volume_clear = zero {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backend_defaults.volume_clear_ionice = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backend_defaults.volume_clear_size = 0 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] oslo_reports.file_event_handler = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] oslo_reports.log_dir = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] QuobyteHD.backend_availability_zone = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] QuobyteHD.backend_host = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] QuobyteHD.chap_password = **** {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] QuobyteHD.chap_username = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] QuobyteHD.chiscsi_conf = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] QuobyteHD.disk_geometry = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] QuobyteHD.driver_client_cert = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] QuobyteHD.driver_client_cert_key = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] QuobyteHD.driver_data_namespace = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] QuobyteHD.driver_use_ssl = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] QuobyteHD.extra_capabilities = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] QuobyteHD.filter_function = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] QuobyteHD.goodness_function = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] QuobyteHD.iscsi_target_flags = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] QuobyteHD.iscsi_write_cache = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] QuobyteHD.iser_helper = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] QuobyteHD.iser_ip_address = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] QuobyteHD.iser_port = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] QuobyteHD.iser_target_prefix = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] QuobyteHD.nas_host = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] QuobyteHD.nas_login = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] QuobyteHD.nas_mount_options = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] QuobyteHD.nas_password = **** {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] QuobyteHD.nas_private_key = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] QuobyteHD.nas_share_path = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] QuobyteHD.nas_ssh_port = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] QuobyteHD.num_shell_tries = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] QuobyteHD.nvmet_ns_id = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] QuobyteHD.nvmet_port_id = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] QuobyteHD.replication_device = **** {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] QuobyteHD.report_discard_supported = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] QuobyteHD.reserved_percentage = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] QuobyteHD.scst_target_driver = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] QuobyteHD.storage_protocol = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] QuobyteHD.target_helper = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] QuobyteHD.target_ip_address = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] QuobyteHD.target_port = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] QuobyteHD.target_prefix = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] QuobyteHD.target_protocol = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] QuobyteHD.trace_flags = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] QuobyteHD.unique_fqdn_network = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] QuobyteHD.use_chap_auth = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] QuobyteHD.volume_clear = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] QuobyteHD.volume_clear_ionice = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] QuobyteHD.volume_clear_size = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] QuobyteHD.volumes_dir = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] oslo_messaging_rabbit.ssl = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] oslo_messaging_rabbit.ssl_version = {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] oslo_messaging_notifications.driver = [] {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] oslo_messaging_notifications.retry = -1 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] oslo_messaging_notifications.transport_url = **** {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] key_manager.fixed_key = **** {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] barbican.barbican_api_version = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] barbican.barbican_endpoint = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] barbican.barbican_endpoint_type = public {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] barbican.barbican_region_name = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] barbican.cafile = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] barbican.certfile = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] barbican.collect_timing = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] barbican.insecure = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] barbican.keyfile = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] barbican.number_of_retries = 60 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] barbican.retry_delay = 1 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] barbican.send_service_user_token = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] barbican.split_loggers = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] barbican.timeout = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] barbican.tls_ciphers = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] barbican.tls_min_version = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] barbican.verify_ssl = True {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] barbican.verify_ssl_path = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] barbican_service_user.auth_section = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] barbican_service_user.auth_type = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] barbican_service_user.cafile = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] barbican_service_user.certfile = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] barbican_service_user.collect_timing = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] barbican_service_user.insecure = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] barbican_service_user.keyfile = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] barbican_service_user.split_loggers = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] barbican_service_user.timeout = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] barbican_service_user.tls_ciphers = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] barbican_service_user.tls_min_version = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] vault.approle_role_id = **** {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] vault.approle_secret_id = **** {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] vault.auth_method = approle {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] vault.auth_path = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] vault.kv_mountpoint = secret {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] vault.kv_path = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] vault.kv_version = 2 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] vault.namespace = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] vault.root_token_id = **** {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] vault.ssl_ca_crt_file = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] vault.timeout = 60.0 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] vault.token_file = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] vault.token_role = None {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] vault.use_ssl = False {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:37 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] ******************************************************************************** {{(pid=85293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 18 21:31:37 devstack cinder-volume[85507]: DEBUG cinder.volume.drivers.quobyte [None req-13b8267b-85c6-4dd4-8758-16555c613c7d None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85507) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 18 21:31:37 devstack cinder-volume[85507]: WARNING cinder.volume.drivers.quobyte [None req-13b8267b-85c6-4dd4-8758-16555c613c7d None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 18 21:31:37 devstack cinder-volume[85507]: WARNING cinder.volume.drivers.quobyte [None req-13b8267b-85c6-4dd4-8758-16555c613c7d None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 18 21:31:37 devstack cinder-volume[85507]: DEBUG oslo_concurrency.processutils [None req-13b8267b-85c6-4dd4-8758-16555c613c7d None None] Running cmd (subprocess): mount.quobyte {{(pid=85507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:31:37 devstack quobyte-client[85508]: Reading configuration file: /etc/quobyte/client.cfg Sep 18 21:31:37 devstack quobyte-client[85508]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 18 21:31:37 devstack cinder-volume[85507]: DEBUG oslo_concurrency.processutils [None req-13b8267b-85c6-4dd4-8758-16555c613c7d None None] CMD "mount.quobyte" returned: 1 in 0.099s {{(pid=85507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:31:37 devstack cinder-volume[85507]: DEBUG oslo_concurrency.lockutils [None req-13b8267b-85c6-4dd4-8758-16555c613c7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:31:37 devstack cinder-volume[85507]: DEBUG oslo_concurrency.lockutils [None req-13b8267b-85c6-4dd4-8758-16555c613c7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:31:37 devstack cinder-volume[85507]: DEBUG cinder.volume.drivers.quobyte [None req-13b8267b-85c6-4dd4-8758-16555c613c7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=85507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:31:37 devstack cinder-volume[85507]: INFO cinder.volume.drivers.quobyte [None req-13b8267b-85c6-4dd4-8758-16555c613c7d None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff ... Sep 18 21:31:37 devstack cinder-volume[85507]: DEBUG oslo_concurrency.processutils [None req-13b8267b-85c6-4dd4-8758-16555c613c7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 -c /etc/quobyte/client-cinder.cfg {{(pid=85507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:31:37 devstack sudo[85511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 -c /etc/quobyte/client-cinder.cfg Sep 18 21:31:37 devstack sudo[85511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:31:38 devstack sudo[85511]: pam_unix(sudo:session): session closed for user root Sep 18 21:31:38 devstack cinder-volume[85507]: DEBUG oslo_concurrency.processutils [None req-13b8267b-85c6-4dd4-8758-16555c613c7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.389s {{(pid=85507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:31:38 devstack cinder-volume[85507]: INFO cinder.volume.drivers.quobyte [None req-13b8267b-85c6-4dd4-8758-16555c613c7d None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff succeeded Sep 18 21:31:38 devstack cinder-volume[85507]: DEBUG cinder.volume.drivers.quobyte [None req-13b8267b-85c6-4dd4-8758-16555c613c7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=85507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:31:38 devstack cinder-volume[85507]: DEBUG oslo_concurrency.lockutils [None req-13b8267b-85c6-4dd4-8758-16555c613c7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.405s {{(pid=85507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:31:38 devstack cinder-volume[85507]: DEBUG oslo_concurrency.processutils [None req-13b8267b-85c6-4dd4-8758-16555c613c7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=85507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:31:38 devstack sudo[85612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:31:38 devstack sudo[85612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:31:38 devstack sudo[85612]: pam_unix(sudo:session): session closed for user root Sep 18 21:31:38 devstack cinder-volume[85507]: DEBUG oslo_concurrency.processutils [None req-13b8267b-85c6-4dd4-8758-16555c613c7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.259s {{(pid=85507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:31:38 devstack cinder-volume[85507]: INFO cinder.volume.driver [None req-13b8267b-85c6-4dd4-8758-16555c613c7d None None] Driver hasn't implemented _init_vendor_properties() Sep 18 21:31:38 devstack cinder-volume[85507]: DEBUG cinder.volume.driver [None req-13b8267b-85c6-4dd4-8758-16555c613c7d None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6893119812012, 'free_capacity_gb': 1775.6893119812012, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85507) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 18 21:31:38 devstack cinder-volume[85507]: DEBUG oslo_db.sqlalchemy.engines [None req-13b8267b-85c6-4dd4-8758-16555c613c7d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85507) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 18 21:31:38 devstack cinder-volume[85507]: DEBUG dbcounter [-] [85507] Writer thread running {{(pid=85507) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 18 21:31:38 devstack cinder-volume[85507]: DEBUG cinder.db.api [None req-13b8267b-85c6-4dd4-8758-16555c613c7d None None] Building query based on filter {{(pid=85507) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 18 21:31:38 devstack cinder-volume[85507]: DEBUG cinder.image.image_utils [None req-13b8267b-85c6-4dd4-8758-16555c613c7d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85507) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 18 21:31:38 devstack cinder-volume[85507]: INFO cinder.keymgr.migration [None req-d59d8ffd-bd6c-4586-a346-0a77ee6b7ab8 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 18 21:31:38 devstack cinder-volume[85507]: DEBUG oslo_concurrency.lockutils [None req-13b8267b-85c6-4dd4-8758-16555c613c7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:31:38 devstack cinder-volume[85507]: DEBUG oslo_concurrency.lockutils [None req-13b8267b-85c6-4dd4-8758-16555c613c7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:31:38 devstack cinder-volume[85507]: DEBUG cinder.volume.drivers.quobyte [None req-13b8267b-85c6-4dd4-8758-16555c613c7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=85507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:31:38 devstack cinder-volume[85507]: DEBUG cinder.volume.drivers.quobyte [None req-13b8267b-85c6-4dd4-8758-16555c613c7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=85507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:31:38 devstack cinder-volume[85507]: DEBUG oslo_concurrency.lockutils [None req-13b8267b-85c6-4dd4-8758-16555c613c7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:31:38 devstack cinder-volume[85507]: DEBUG oslo_concurrency.processutils [None req-13b8267b-85c6-4dd4-8758-16555c613c7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=85507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:31:38 devstack sudo[85616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:31:38 devstack sudo[85616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:31:38 devstack sudo[85616]: pam_unix(sudo:session): session closed for user root Sep 18 21:31:38 devstack cinder-volume[85507]: DEBUG oslo_concurrency.processutils [None req-13b8267b-85c6-4dd4-8758-16555c613c7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.264s {{(pid=85507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:31:38 devstack cinder-volume[85507]: DEBUG cinder.manager [None req-13b8267b-85c6-4dd4-8758-16555c613c7d None None] Notifying Schedulers of capabilities ... {{(pid=85507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:31:38 devstack cinder-volume[85507]: INFO cinder.volume.manager [None req-13b8267b-85c6-4dd4-8758-16555c613c7d None None] Driver initialization completed successfully. Sep 18 21:31:38 devstack cinder-volume[85507]: INFO cinder.manager [None req-13b8267b-85c6-4dd4-8758-16555c613c7d None None] Initiating service 3 cleanup Sep 18 21:31:39 devstack cinder-volume[85507]: INFO cinder.manager [None req-13b8267b-85c6-4dd4-8758-16555c613c7d None None] Service 3 cleanup completed. Sep 18 21:31:39 devstack cinder-volume[85507]: DEBUG cinder.service [None req-13b8267b-85c6-4dd4-8758-16555c613c7d None None] Creating RPC server for service cinder-volume {{(pid=85507) start /opt/stack/cinder/cinder/service.py:231}} Sep 18 21:31:39 devstack cinder-volume[85507]: DEBUG cinder.service [None req-13b8267b-85c6-4dd4-8758-16555c613c7d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85507) start /opt/stack/cinder/cinder/service.py:237}} Sep 18 21:31:39 devstack cinder-volume[85507]: INFO cinder.volume.manager [None req-13b8267b-85c6-4dd4-8758-16555c613c7d None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 18 21:31:39 devstack cinder-volume[85507]: DEBUG oslo_concurrency.lockutils [None req-13b8267b-85c6-4dd4-8758-16555c613c7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:31:39 devstack cinder-volume[85507]: DEBUG oslo_concurrency.lockutils [None req-13b8267b-85c6-4dd4-8758-16555c613c7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:31:39 devstack cinder-volume[85507]: DEBUG cinder.volume.drivers.quobyte [None req-13b8267b-85c6-4dd4-8758-16555c613c7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=85507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:31:39 devstack cinder-volume[85507]: DEBUG cinder.volume.drivers.quobyte [None req-13b8267b-85c6-4dd4-8758-16555c613c7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=85507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:31:39 devstack cinder-volume[85507]: DEBUG oslo_concurrency.lockutils [None req-13b8267b-85c6-4dd4-8758-16555c613c7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:31:39 devstack cinder-volume[85507]: DEBUG oslo_concurrency.processutils [None req-13b8267b-85c6-4dd4-8758-16555c613c7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=85507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:31:39 devstack sudo[85619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:31:39 devstack sudo[85619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:31:39 devstack sudo[85619]: pam_unix(sudo:session): session closed for user root Sep 18 21:31:39 devstack cinder-volume[85507]: DEBUG oslo_concurrency.processutils [None req-13b8267b-85c6-4dd4-8758-16555c613c7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.273s {{(pid=85507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:31:39 devstack cinder-volume[85507]: INFO cinder.volume.manager [None req-13b8267b-85c6-4dd4-8758-16555c613c7d None None] Driver post RPC initialization completed successfully. Sep 18 21:31:43 devstack cinder-volume[85293]: INFO oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] Caught SIGTERM, stopping children Sep 18 21:31:43 devstack cinder-volume[85293]: DEBUG oslo_concurrency.lockutils [None req-45938cda-df95-4038-b9ac-539046da463f None None] Acquiring lock "singleton_lock" {{(pid=85293) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 18 21:31:43 devstack cinder-volume[85293]: DEBUG oslo_concurrency.lockutils [None req-45938cda-df95-4038-b9ac-539046da463f None None] Acquired lock "singleton_lock" {{(pid=85293) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 18 21:31:43 devstack cinder-volume[85293]: DEBUG oslo_concurrency.lockutils [None req-45938cda-df95-4038-b9ac-539046da463f None None] Releasing lock "singleton_lock" {{(pid=85293) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 18 21:31:43 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] Stop services. {{(pid=85293) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 18 21:31:43 devstack cinder-volume[85293]: DEBUG oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] Killing children. {{(pid=85293) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 18 21:31:43 devstack cinder-volume[85293]: INFO oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] Waiting on 1 children to exit Sep 18 21:31:47 devstack cinder-volume[85507]: DEBUG oslo_concurrency.lockutils [None req-45938cda-df95-4038-b9ac-539046da463f None None] Acquiring lock "singleton_lock" {{(pid=85507) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 18 21:31:47 devstack cinder-volume[85507]: DEBUG oslo_concurrency.lockutils [None req-45938cda-df95-4038-b9ac-539046da463f None None] Acquired lock "singleton_lock" {{(pid=85507) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 18 21:31:47 devstack cinder-volume[85507]: DEBUG oslo_concurrency.lockutils [None req-45938cda-df95-4038-b9ac-539046da463f None None] Releasing lock "singleton_lock" {{(pid=85507) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 18 21:31:47 devstack cinder-volume[85507]: WARNING amqp [None req-45938cda-df95-4038-b9ac-539046da463f None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 18 21:31:47 devstack cinder-volume[85507]: WARNING amqp [None req-45938cda-df95-4038-b9ac-539046da463f None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 18 21:31:47 devstack cinder-volume[85293]: INFO oslo_service.backend._eventlet.service [None req-45938cda-df95-4038-b9ac-539046da463f None None] Child 85507 exited with status 0 Sep 18 21:31:47 devstack cinder-volume[85841]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 18 21:31:47 devstack cinder-volume[85841]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 18 21:31:47 devstack cinder-volume[85841]: we strongly recommend against using it for new projects. Sep 18 21:31:47 devstack cinder-volume[85841]: If you are already using Eventlet, we recommend migrating to a different Sep 18 21:31:47 devstack cinder-volume[85841]: framework. For more detail see Sep 18 21:31:47 devstack cinder-volume[85841]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 18 21:31:47 devstack cinder-volume[85841]: import eventlet # noqa Sep 18 21:31:50 devstack cinder-volume[85841]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85841) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 18 21:31:50 devstack cinder-volume[85841]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85841) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 18 21:31:50 devstack cinder-volume[85841]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85841) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 18 21:31:51 devstack cinder-volume[85841]: INFO dbcounter [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] Registered counter for database cinder Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_db.sqlalchemy.engines [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85841) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG dbcounter [-] [85841] Writer thread running {{(pid=85841) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 18 21:31:51 devstack cinder-volume[85841]: INFO cinder.rpc [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 18 21:31:51 devstack cinder-volume[85841]: INFO cinder.rpc [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_db.sqlalchemy.engines [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85841) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 18 21:31:51 devstack cinder-volume[85841]: INFO cinder.volume.manager [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] Determined volume DB was empty at startup. Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG cinder.volume.manager [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85841) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 18 21:31:51 devstack cinder-volume[85841]: WARNING stevedore.named [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 18 21:31:51 devstack cinder-volume[85841]: WARNING castellan.key_manager [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 18 21:31:51 devstack cinder-volume[85841]: WARNING cinder.keymgr.conf_key_mgr [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 18 21:31:51 devstack cinder-volume[85841]: INFO cinder.volume.manager [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_db.sqlalchemy.engines [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85841) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 18 21:31:51 devstack cinder-volume[85841]: INFO oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] Starting 1 workers Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] Started child 86136 {{(pid=85841) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] Full set of CONF: {{(pid=85841) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] ******************************************************************************** {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] Configuration options gathered from: {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] ================================================================================ {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] allow_availability_zone_fallback = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] allow_compression_on_image_upload = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] allowed_direct_url_schemes = [] {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] api_rate_limit = True {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] auth_strategy = keystone {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backend_availability_zone = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backend_host = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backend_name = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backend_stats_polling_interval = 60 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backup_api_class = cinder.backup.api.API {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[86136]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backup_name_template = backup-%s {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backup_use_same_host = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backup_use_temp_snapshot = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] chap_password = **** {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] chap_username = {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] cinder_internal_tenant_project_id = a205603f49dc45e3a1bf0718b51d9f0f {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] cinder_internal_tenant_user_id = e9f950adb5eb489ebeccd5b58878bbc3 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] cluster = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] compression_format = gzip {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] compute_api_class = cinder.compute.nova.API {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] config_dir = [] {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] config_source = [] {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] control_exchange = openstack {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] debug = True {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] default_availability_zone = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] default_group_type = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] default_volume_type = QuobyteHD {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] disk_geometry = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] driver_client_cert = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] driver_client_cert_key = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] driver_data_namespace = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] driver_ssl_cert_path = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] driver_ssl_cert_verify = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] driver_use_ssl = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] enable_new_services = True {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] enable_unsupported_driver = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] enabled_backends = ['QuobyteHD'] {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] enforce_multipath_for_image_xfer = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] filter_function = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] glance_api_insecure = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] glance_api_servers = ['http://192.168.122.22/image'] {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] glance_api_ssl_compression = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] glance_ca_certificates_file = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] glance_catalog_info = image:glance:publicURL {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] glance_certfile = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] glance_keyfile = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] glance_num_retries = 3 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] glance_request_timeout = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] goodness_function = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] graceful_shutdown_timeout = 5 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] group_api_class = cinder.group.api.API {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] host = devstack {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] image_compress_on_upload = True {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] image_conversion_address_space_limit = 1 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] image_conversion_cpu_limit = 60 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] image_conversion_disable = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] image_introspection_address_space_limit = 1 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] image_introspection_cpu_limit = 60 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] image_upload_use_cinder_backend = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] image_upload_use_internal_tenant = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] image_volume_cache_enabled = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] image_volume_cache_max_count = 0 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] image_volume_cache_max_size_gb = 0 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] init_host_max_objects_retrieval = 0 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] instance_format = [instance: %(uuid)s] {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] iscsi_target_flags = {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] iscsi_write_cache = on {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] iser_helper = tgtadm {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] iser_ip_address = 192.168.122.22 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] iser_port = 3260 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] log_color = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] log_config_append = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] log_dir = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] log_file = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] log_options = True {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] log_rotate_interval = 1 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] log_rotate_interval_type = days {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] log_rotation_type = none {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] max_age = 0 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] max_logfile_count = 30 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] max_logfile_size_mb = 200 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] max_over_subscription_ratio = 20.0 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] message_reap_interval = 86400 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] message_ttl = 2592000 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] migration_create_volume_timeout_secs = 300 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] monkey_patch = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] monkey_patch_modules = [] {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] my_ip = 192.168.122.22 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] no_snapshot_gb_quota = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] num_iser_scan_tries = 3 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] num_shell_tries = 3 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] num_volume_device_scan_tries = 3 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] nvmeof_conn_info_version = 1 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] nvmet_ns_id = 10 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] nvmet_port_id = 1 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] osapi_max_limit = 1000 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] osapi_volume_ext_list = [] {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] osapi_volume_listen_port = 8776 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] osapi_volume_use_ssl = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] osapi_volume_workers = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] per_volume_size_limit = -1 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] periodic_fuzzy_delay = 60 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] periodic_interval = 60 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-5c62f18f-d505-4a07-87a8-fa0992ad2dde None None] Starting volume driver QuobyteDriver (1.2.1) Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-5c62f18f-d505-4a07-87a8-fa0992ad2dde None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86136) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] public_endpoint = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] publish_errors = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] quota_backup_gigabytes = 1000 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] quota_backups = 10 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] quota_gigabytes = 1000 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] quota_groups = 10 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] quota_snapshots = 10 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] quota_volumes = 10 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] rate_limit_burst = 0 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] rate_limit_except_level = CRITICAL {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] rate_limit_interval = 0 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] reinit_driver_count = 3 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] replication_device = **** {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] report_discard_supported = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] report_interval = 120 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] reservation_clean_interval = 86400 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] reservation_expire = 86400 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] reserved_image_namespaces = [] {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] reserved_percentage = 0 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] rpc_response_timeout = 120 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] run_external_periodic_tasks = True {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] scst_target_driver = iscsi {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] scst_target_iqn_name = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] service_down_time = 720 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] shell_completion = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] snapshot_name_template = snapshot-%s {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] split_loggers = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] state_path = /opt/stack/data/cinder {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] storage_availability_zone = nova {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] storage_protocol = iSCSI {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] syslog_log_facility = LOG_USER {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] target_helper = lioadm {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] target_ip_address = 192.168.122.22 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] target_port = 3260 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] target_protocol = iscsi {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] target_secondary_ip_addresses = [] {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] trace_flags = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] transport_url = **** {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] until_refresh = 0 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] use_chap_auth = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] use_default_quota_class = True {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] use_journal = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] use_json = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] use_multipath_for_image_xfer = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] use_stderr = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] use_syslog = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] verify_glance_signatures = enabled {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] volume_api_class = cinder.volume.api.API {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] volume_backend_name = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] volume_clear = zero {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] volume_clear_ionice = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] volume_clear_size = 0 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] volume_copy_bps_limit = 0 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] volume_dd_blocksize = 1M {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] volume_name_template = volume-%s {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] volume_service_inithost_offload = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] volume_usage_audit_period = month {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] zoning_mode = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] oslo_concurrency.disable_process_locking = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] keystone_authtoken.auth_section = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] keystone_authtoken.auth_type = password {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] keystone_authtoken.auth_version = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] keystone_authtoken.cache = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] keystone_authtoken.certfile = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] keystone_authtoken.include_service_catalog = True {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] keystone_authtoken.insecure = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] keystone_authtoken.interface = public {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] keystone_authtoken.keyfile = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] keystone_authtoken.memcache_password = **** {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] keystone_authtoken.memcache_username = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] keystone_authtoken.region_name = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] keystone_authtoken.service_type = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.22/identity {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] cache.backend = dogpile.cache.null {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] cache.backend_argument = **** {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] cache.backend_expiration_time = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] cache.config_prefix = cache.oslo {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] cache.debug_cache_backend = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] cache.enable_retry_client = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] cache.enable_socket_keepalive = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] cache.enabled = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] cache.expiration_time = 600 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] cache.hashclient_retry_attempts = 2 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] cache.memcache_dead_retry = 300 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] cache.memcache_pool_maxsize = 10 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] cache.memcache_sasl_enabled = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] cache.password = **** {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] cache.proxies = [] {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] cache.redis_db = 0 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] cache.redis_server = localhost:6379 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] cache.retry_attempts = 2 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] cache.retry_delay = 0.0 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] cache.socket_keepalive_count = 1 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] cache.socket_keepalive_idle = 1 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] cache.socket_keepalive_interval = 1 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] cache.socket_timeout = 1.0 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] cache.tls_allowed_ciphers = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] cache.tls_cafile = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] cache.tls_certfile = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] cache.tls_enabled = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] cache.tls_keyfile = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] cache.username = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] coordination.backend_url = **** {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] database.asyncio_connection = **** {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] database.asyncio_slave_connection = **** {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] database.backend = sqlalchemy {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] database.connection = **** {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] database.connection_debug = 0 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] database.connection_parameters = {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] database.connection_recycle_time = 3600 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] database.connection_trace = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] database.db_inc_retry_interval = True {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] database.db_max_retries = 20 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] database.db_max_retry_interval = 10 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] database.db_retry_interval = 1 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-5c62f18f-d505-4a07-87a8-fa0992ad2dde None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86136) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] database.max_overflow = 50 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] database.max_pool_size = 5 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] database.max_retries = 10 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.quobyte [None req-5c62f18f-d505-4a07-87a8-fa0992ad2dde None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.quobyte [None req-5c62f18f-d505-4a07-87a8-fa0992ad2dde None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] database.mysql_wsrep_sync_wait = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] database.pool_timeout = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] database.retry_interval = 10 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] database.slave_connection = **** {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] database.sqlite_synchronous = True {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5c62f18f-d505-4a07-87a8-fa0992ad2dde None None] Running cmd (subprocess): mount.quobyte {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] database.synchronous_reader = True {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] database.use_db_reconnect = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] oslo_messaging_tracing.insecure = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] profiler.connection_string = messaging:// {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] profiler.enabled = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] profiler.es_doc_type = notification {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] profiler.es_scroll_size = 10000 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] profiler.es_scroll_time = 2m {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] profiler.filter_error_trace = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] profiler.hmac_keys = **** {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] profiler.sentinel_service_name = mymaster {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] profiler.socket_timeout = 0.1 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] profiler.trace_requests = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] profiler.trace_sqlalchemy = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] profiler_jaeger.process_tags = {} {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] profiler_jaeger.service_name_prefix = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] profiler_otlp.service_name_prefix = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] oslo_policy.enforce_new_defaults = True {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] oslo_policy.policy_default_rule = default {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] oslo_policy.policy_file = policy.yaml {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] oslo_policy.remote_timeout = 60.0 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] privsep_osbrick.group = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] privsep_osbrick.helper_command = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] privsep_osbrick.user = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] cinder_sys_admin.group = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] cinder_sys_admin.helper_command = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] cinder_sys_admin.user = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] service_user.auth_section = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] service_user.auth_type = password {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] service_user.cafile = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] service_user.certfile = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] service_user.collect_timing = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] service_user.insecure = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] service_user.keyfile = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] service_user.send_service_user_token = True {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] service_user.split_loggers = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] service_user.timeout = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] service_user.tls_ciphers = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] service_user.tls_min_version = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] glance.auth_section = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] glance.auth_type = password {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] glance.certfile = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] glance.collect_timing = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] glance.insecure = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] glance.keyfile = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] glance.region_name = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] glance.split_loggers = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] glance.timeout = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] glance.tls_ciphers = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] glance.tls_min_version = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backend_defaults.backend_availability_zone = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backend_defaults.chap_password = **** {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backend_defaults.chap_username = {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backend_defaults.disk_geometry = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backend_defaults.driver_client_cert = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backend_defaults.driver_client_cert_key = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backend_defaults.driver_data_namespace = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backend_defaults.driver_use_ssl = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backend_defaults.extra_capabilities = {} {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backend_defaults.filter_function = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backend_defaults.goodness_function = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backend_defaults.iscsi_target_flags = {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backend_defaults.iscsi_write_cache = on {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backend_defaults.iser_helper = tgtadm {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backend_defaults.iser_ip_address = 192.168.122.22 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backend_defaults.iser_port = 3260 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backend_defaults.nas_host = {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backend_defaults.nas_login = admin {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backend_defaults.nas_mount_options = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backend_defaults.nas_password = **** {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backend_defaults.nas_private_key = {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backend_defaults.nas_share_path = {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backend_defaults.nas_ssh_port = 22 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backend_defaults.num_shell_tries = 3 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack quobyte-client[86145]: Reading configuration file: /etc/quobyte/client.cfg Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backend_defaults.quobyte_volume_url = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backend_defaults.replication_device = **** {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack quobyte-client[86145]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backend_defaults.report_discard_supported = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backend_defaults.reserved_percentage = 0 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5c62f18f-d505-4a07-87a8-fa0992ad2dde None None] CMD "mount.quobyte" returned: 1 in 0.064s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-5c62f18f-d505-4a07-87a8-fa0992ad2dde None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-5c62f18f-d505-4a07-87a8-fa0992ad2dde None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-5c62f18f-d505-4a07-87a8-fa0992ad2dde None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backend_defaults.target_helper = tgtadm {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backend_defaults.target_ip_address = 192.168.122.22 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backend_defaults.target_port = 3260 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backend_defaults.target_protocol = iscsi {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backend_defaults.trace_flags = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backend_defaults.unique_fqdn_network = True {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backend_defaults.use_chap_auth = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backend_defaults.volume_backend_name = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backend_defaults.volume_clear = zero {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backend_defaults.volume_clear_ionice = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backend_defaults.volume_clear_size = 0 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] oslo_reports.file_event_handler = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] oslo_reports.log_dir = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] QuobyteHD.backend_availability_zone = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] QuobyteHD.backend_host = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] QuobyteHD.chap_password = **** {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] QuobyteHD.chap_username = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] QuobyteHD.chiscsi_conf = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] QuobyteHD.disk_geometry = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-5c62f18f-d505-4a07-87a8-fa0992ad2dde None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] QuobyteHD.driver_client_cert = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] QuobyteHD.driver_data_namespace = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-5c62f18f-d505-4a07-87a8-fa0992ad2dde None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5c62f18f-d505-4a07-87a8-fa0992ad2dde None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] QuobyteHD.driver_use_ssl = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] QuobyteHD.extra_capabilities = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] QuobyteHD.filter_function = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] QuobyteHD.goodness_function = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] QuobyteHD.iscsi_target_flags = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] QuobyteHD.iscsi_write_cache = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] QuobyteHD.iser_helper = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] QuobyteHD.iser_ip_address = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] QuobyteHD.iser_port = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] QuobyteHD.iser_target_prefix = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] QuobyteHD.nas_host = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] QuobyteHD.nas_login = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] QuobyteHD.nas_mount_options = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] QuobyteHD.nas_password = **** {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] QuobyteHD.nas_private_key = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] QuobyteHD.nas_share_path = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] QuobyteHD.nas_ssh_port = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] QuobyteHD.num_shell_tries = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] QuobyteHD.nvmet_ns_id = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] QuobyteHD.nvmet_port_id = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] QuobyteHD.replication_device = **** {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] QuobyteHD.report_discard_supported = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] QuobyteHD.reserved_percentage = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] QuobyteHD.scst_target_driver = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] QuobyteHD.storage_protocol = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] QuobyteHD.target_helper = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] QuobyteHD.target_ip_address = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack sudo[86149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] QuobyteHD.target_port = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] QuobyteHD.target_prefix = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] QuobyteHD.target_protocol = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] QuobyteHD.trace_flags = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack sudo[86149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] QuobyteHD.unique_fqdn_network = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] QuobyteHD.use_chap_auth = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] QuobyteHD.volume_clear = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] QuobyteHD.volume_clear_ionice = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] QuobyteHD.volume_clear_size = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] QuobyteHD.volumes_dir = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] oslo_messaging_rabbit.ssl = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] oslo_messaging_notifications.driver = [] {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] oslo_messaging_notifications.retry = -1 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] key_manager.fixed_key = **** {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] barbican.barbican_api_version = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] barbican.barbican_endpoint = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] barbican.barbican_endpoint_type = public {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] barbican.barbican_region_name = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] barbican.cafile = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] barbican.certfile = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] barbican.collect_timing = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] barbican.insecure = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] barbican.keyfile = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] barbican.number_of_retries = 60 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] barbican.retry_delay = 1 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] barbican.send_service_user_token = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] barbican.split_loggers = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] barbican.timeout = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] barbican.tls_ciphers = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] barbican.tls_min_version = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] barbican.verify_ssl = True {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] barbican.verify_ssl_path = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] barbican_service_user.auth_section = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] barbican_service_user.auth_type = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] barbican_service_user.cafile = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] barbican_service_user.certfile = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] barbican_service_user.collect_timing = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] barbican_service_user.insecure = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] barbican_service_user.keyfile = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] barbican_service_user.split_loggers = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] barbican_service_user.timeout = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] barbican_service_user.tls_ciphers = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] barbican_service_user.tls_min_version = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] vault.approle_role_id = **** {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] vault.approle_secret_id = **** {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] vault.auth_method = approle {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] vault.auth_path = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] vault.kv_mountpoint = secret {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] vault.kv_path = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] vault.kv_version = 2 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] vault.namespace = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] vault.root_token_id = **** {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:51 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] vault.ssl_ca_crt_file = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:52 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] vault.timeout = 60.0 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:52 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] vault.token_file = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:52 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] vault.token_role = None {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:52 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] vault.use_ssl = False {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:52 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 21:31:52 devstack cinder-volume[85841]: DEBUG oslo_service.backend._eventlet.service [None req-52a38fa9-7294-4af3-ad1a-7b62f85644f3 None None] ******************************************************************************** {{(pid=85841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 18 21:31:52 devstack sudo[86149]: pam_unix(sudo:session): session closed for user root Sep 18 21:31:52 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5c62f18f-d505-4a07-87a8-fa0992ad2dde None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.255s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:31:52 devstack cinder-volume[86136]: INFO cinder.volume.driver [None req-5c62f18f-d505-4a07-87a8-fa0992ad2dde None None] Driver hasn't implemented _init_vendor_properties() Sep 18 21:31:52 devstack cinder-volume[86136]: DEBUG cinder.volume.driver [None req-5c62f18f-d505-4a07-87a8-fa0992ad2dde None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6893119812012, 'free_capacity_gb': 1775.6893119812012, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86136) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 18 21:31:52 devstack cinder-volume[86136]: DEBUG oslo_db.sqlalchemy.engines [None req-5c62f18f-d505-4a07-87a8-fa0992ad2dde None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86136) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 18 21:31:52 devstack cinder-volume[86136]: DEBUG dbcounter [-] [86136] Writer thread running {{(pid=86136) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 18 21:31:52 devstack cinder-volume[86136]: DEBUG cinder.db.api [None req-5c62f18f-d505-4a07-87a8-fa0992ad2dde None None] Building query based on filter {{(pid=86136) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 18 21:31:52 devstack cinder-volume[86136]: DEBUG cinder.image.image_utils [None req-5c62f18f-d505-4a07-87a8-fa0992ad2dde None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86136) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 18 21:31:52 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-5c62f18f-d505-4a07-87a8-fa0992ad2dde None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:31:52 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-5c62f18f-d505-4a07-87a8-fa0992ad2dde None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:31:52 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-5c62f18f-d505-4a07-87a8-fa0992ad2dde None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:31:52 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-5c62f18f-d505-4a07-87a8-fa0992ad2dde None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:31:52 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-5c62f18f-d505-4a07-87a8-fa0992ad2dde None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:31:52 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5c62f18f-d505-4a07-87a8-fa0992ad2dde None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:31:52 devstack cinder-volume[86136]: INFO cinder.keymgr.migration [None req-fa98de83-7242-46c6-a9e8-71b55963e7b9 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 18 21:31:52 devstack sudo[86160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:31:52 devstack sudo[86160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:31:52 devstack sudo[86160]: pam_unix(sudo:session): session closed for user root Sep 18 21:31:52 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5c62f18f-d505-4a07-87a8-fa0992ad2dde None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.225s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:31:52 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-5c62f18f-d505-4a07-87a8-fa0992ad2dde None None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:31:52 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-5c62f18f-d505-4a07-87a8-fa0992ad2dde None None] Driver initialization completed successfully. Sep 18 21:31:52 devstack cinder-volume[86136]: INFO cinder.manager [None req-5c62f18f-d505-4a07-87a8-fa0992ad2dde None None] Initiating service 3 cleanup Sep 18 21:31:52 devstack cinder-volume[86136]: INFO cinder.manager [None req-5c62f18f-d505-4a07-87a8-fa0992ad2dde None None] Service 3 cleanup completed. Sep 18 21:31:52 devstack cinder-volume[86136]: DEBUG cinder.service [None req-5c62f18f-d505-4a07-87a8-fa0992ad2dde None None] Creating RPC server for service cinder-volume {{(pid=86136) start /opt/stack/cinder/cinder/service.py:231}} Sep 18 21:31:52 devstack cinder-volume[86136]: DEBUG cinder.service [None req-5c62f18f-d505-4a07-87a8-fa0992ad2dde None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86136) start /opt/stack/cinder/cinder/service.py:237}} Sep 18 21:31:52 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-5c62f18f-d505-4a07-87a8-fa0992ad2dde None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 18 21:31:52 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-5c62f18f-d505-4a07-87a8-fa0992ad2dde None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:31:52 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-5c62f18f-d505-4a07-87a8-fa0992ad2dde None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:31:52 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-5c62f18f-d505-4a07-87a8-fa0992ad2dde None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:31:52 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-5c62f18f-d505-4a07-87a8-fa0992ad2dde None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:31:52 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-5c62f18f-d505-4a07-87a8-fa0992ad2dde None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:31:52 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5c62f18f-d505-4a07-87a8-fa0992ad2dde None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:31:52 devstack sudo[86171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:31:52 devstack sudo[86171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:31:52 devstack sudo[86171]: pam_unix(sudo:session): session closed for user root Sep 18 21:31:52 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5c62f18f-d505-4a07-87a8-fa0992ad2dde None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.231s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:31:52 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-5c62f18f-d505-4a07-87a8-fa0992ad2dde None None] Driver post RPC initialization completed successfully. Sep 18 21:32:01 devstack cinder-volume[85841]: DEBUG dbcounter [-] [85841] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=85841) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 21:32:02 devstack cinder-volume[86136]: DEBUG dbcounter [-] [86136] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86136) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 21:32:02 devstack cinder-volume[86136]: DEBUG dbcounter [-] [86136] Writing DB stats cinder:SELECT=2 {{(pid=86136) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 21:32:04 devstack cinder-volume[86136]: DEBUG oslo_service.periodic_task [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Running periodic task VolumeManager._thread_info {{(pid=86136) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 21:32:04 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] thread count: 6 {{(pid=86136) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 18 21:32:04 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] thread info: [<_MainThread(MainThread, started 138548347871360)>, , , , , ] {{(pid=86136) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 18 21:33:04 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea7b3a0d-f3f6-4974-9657-891df4890bf4 tempest-DeleteServersTestJSON-513250494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:33:04 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ea7b3a0d-f3f6-4974-9657-891df4890bf4 tempest-DeleteServersTestJSON-513250494 None] Flow 'volume_create_manager' (8d0fc4b8-1a0e-47a2-9b5c-ec4fa800c772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:33:05 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ea7b3a0d-f3f6-4974-9657-891df4890bf4 tempest-DeleteServersTestJSON-513250494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da41aeb1-cc0e-45e5-a700-a4cac735a777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:33:05 devstack cinder-volume[86136]: DEBUG oslo_service.periodic_task [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86136) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 21:33:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:33:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:33:05 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:33:05 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:33:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:33:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:33:05 devstack sudo[86855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:33:05 devstack sudo[86855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:33:05 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ea7b3a0d-f3f6-4974-9657-891df4890bf4 tempest-DeleteServersTestJSON-513250494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da41aeb1-cc0e-45e5-a700-a4cac735a777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:33:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1155550416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26e13350-8f8b-4ea3-b116-14d75af0924c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='020909c389534f7d99f2d9b3e78f115d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:33:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:33:05Z,use_quota=True,user_id='9637e87f879742ce9c77ece7d33f3b86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:33:05 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ea7b3a0d-f3f6-4974-9657-891df4890bf4 tempest-DeleteServersTestJSON-513250494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52a83f31-f070-410d-9a11-dadd37c43b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:33:05 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ea7b3a0d-f3f6-4974-9657-891df4890bf4 tempest-DeleteServersTestJSON-513250494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52a83f31-f070-410d-9a11-dadd37c43b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:33:05 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ea7b3a0d-f3f6-4974-9657-891df4890bf4 tempest-DeleteServersTestJSON-513250494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8c925ef-7095-47ea-a9a3-22394821939f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:33:05 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ea7b3a0d-f3f6-4974-9657-891df4890bf4 tempest-DeleteServersTestJSON-513250494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8c925ef-7095-47ea-a9a3-22394821939f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26e13350-8f8b-4ea3-b116-14d75af0924c', 'volume_name': 'volume-26e13350-8f8b-4ea3-b116-14d75af0924c', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:33:05 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ea7b3a0d-f3f6-4974-9657-891df4890bf4 tempest-DeleteServersTestJSON-513250494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1267bc8b-fe65-421d-ba44-7c92107a0943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:33:05 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ea7b3a0d-f3f6-4974-9657-891df4890bf4 tempest-DeleteServersTestJSON-513250494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1267bc8b-fe65-421d-ba44-7c92107a0943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:33:05 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ea7b3a0d-f3f6-4974-9657-891df4890bf4 tempest-DeleteServersTestJSON-513250494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (775d92c5-0cc4-4fc9-865e-ae7dfdd3851a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:33:05 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-ea7b3a0d-f3f6-4974-9657-891df4890bf4 tempest-DeleteServersTestJSON-513250494 None] Volume 26e13350-8f8b-4ea3-b116-14d75af0924c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26e13350-8f8b-4ea3-b116-14d75af0924c', 'volume_size': 1} Sep 18 21:33:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-ea7b3a0d-f3f6-4974-9657-891df4890bf4 tempest-DeleteServersTestJSON-513250494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:33:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-ea7b3a0d-f3f6-4974-9657-891df4890bf4 tempest-DeleteServersTestJSON-513250494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:33:05 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-ea7b3a0d-f3f6-4974-9657-891df4890bf4 tempest-DeleteServersTestJSON-513250494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:33:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1155550416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26e13350-8f8b-4ea3-b116-14d75af0924c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='020909c389534f7d99f2d9b3e78f115d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:33:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:33:05Z,use_quota=True,user_id='9637e87f879742ce9c77ece7d33f3b86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:33:05 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-ea7b3a0d-f3f6-4974-9657-891df4890bf4 tempest-DeleteServersTestJSON-513250494 None] Creating volume 26e13350-8f8b-4ea3-b116-14d75af0924c {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:33:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-ea7b3a0d-f3f6-4974-9657-891df4890bf4 tempest-DeleteServersTestJSON-513250494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:33:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-ea7b3a0d-f3f6-4974-9657-891df4890bf4 tempest-DeleteServersTestJSON-513250494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:33:05 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-ea7b3a0d-f3f6-4974-9657-891df4890bf4 tempest-DeleteServersTestJSON-513250494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:33:05 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-ea7b3a0d-f3f6-4974-9657-891df4890bf4 tempest-DeleteServersTestJSON-513250494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:33:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-ea7b3a0d-f3f6-4974-9657-891df4890bf4 tempest-DeleteServersTestJSON-513250494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.053s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:33:05 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-ea7b3a0d-f3f6-4974-9657-891df4890bf4 tempest-DeleteServersTestJSON-513250494 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:33:05 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-ea7b3a0d-f3f6-4974-9657-891df4890bf4 tempest-DeleteServersTestJSON-513250494 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:33:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ea7b3a0d-f3f6-4974-9657-891df4890bf4 tempest-DeleteServersTestJSON-513250494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-26e13350-8f8b-4ea3-b116-14d75af0924c 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:33:05 devstack sudo[86859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-26e13350-8f8b-4ea3-b116-14d75af0924c 1073741824 Sep 18 21:33:05 devstack sudo[86859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:33:05 devstack sudo[86855]: pam_unix(sudo:session): session closed for user root Sep 18 21:33:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.748s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:33:05 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:33:05 devstack cinder-volume[86136]: DEBUG oslo_service.periodic_task [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Running periodic task VolumeManager._thread_info {{(pid=86136) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 21:33:05 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] thread count: 6 {{(pid=86136) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 18 21:33:05 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] thread info: [<_MainThread(MainThread, started 138548347871360)>, , , , , ] {{(pid=86136) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 18 21:33:07 devstack sudo[86859]: pam_unix(sudo:session): session closed for user root Sep 18 21:33:07 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ea7b3a0d-f3f6-4974-9657-891df4890bf4 tempest-DeleteServersTestJSON-513250494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-26e13350-8f8b-4ea3-b116-14d75af0924c 1073741824" returned: 0 in 1.499s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:33:07 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ea7b3a0d-f3f6-4974-9657-891df4890bf4 tempest-DeleteServersTestJSON-513250494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-26e13350-8f8b-4ea3-b116-14d75af0924c {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:33:07 devstack sudo[87205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-26e13350-8f8b-4ea3-b116-14d75af0924c Sep 18 21:33:07 devstack sudo[87205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:33:07 devstack sudo[87205]: pam_unix(sudo:session): session closed for user root Sep 18 21:33:07 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ea7b3a0d-f3f6-4974-9657-891df4890bf4 tempest-DeleteServersTestJSON-513250494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-26e13350-8f8b-4ea3-b116-14d75af0924c" returned: 0 in 0.593s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:33:07 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-ea7b3a0d-f3f6-4974-9657-891df4890bf4 tempest-DeleteServersTestJSON-513250494 None] <== create_volume: return (2247ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:33:07 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-ea7b3a0d-f3f6-4974-9657-891df4890bf4 tempest-DeleteServersTestJSON-513250494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.261s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:33:07 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ea7b3a0d-f3f6-4974-9657-891df4890bf4 tempest-DeleteServersTestJSON-513250494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (775d92c5-0cc4-4fc9-865e-ae7dfdd3851a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26e13350-8f8b-4ea3-b116-14d75af0924c', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:33:07 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ea7b3a0d-f3f6-4974-9657-891df4890bf4 tempest-DeleteServersTestJSON-513250494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (604d3474-f478-417e-821f-361fee630613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:33:07 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-ea7b3a0d-f3f6-4974-9657-891df4890bf4 tempest-DeleteServersTestJSON-513250494 None] Volume volume-26e13350-8f8b-4ea3-b116-14d75af0924c (26e13350-8f8b-4ea3-b116-14d75af0924c): created successfully Sep 18 21:33:07 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ea7b3a0d-f3f6-4974-9657-891df4890bf4 tempest-DeleteServersTestJSON-513250494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (604d3474-f478-417e-821f-361fee630613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:33:07 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ea7b3a0d-f3f6-4974-9657-891df4890bf4 tempest-DeleteServersTestJSON-513250494 None] Flow 'volume_create_manager' (8d0fc4b8-1a0e-47a2-9b5c-ec4fa800c772) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:33:07 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-ea7b3a0d-f3f6-4974-9657-891df4890bf4 tempest-DeleteServersTestJSON-513250494 None] Created volume successfully. Sep 18 21:33:12 devstack cinder-volume[86136]: WARNING py.warnings [req-fe9f0cac-ca8e-4680-8fa9-01caf66934c7 req-0db24100-09d0-4f90-8c65-d666e8d7c616 tempest-DeleteServersTestJSON-513250494 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Sep 18 21:33:12 devstack cinder-volume[86136]: .first() Sep 18 21:33:12 devstack cinder-volume[86136]: Sep 18 21:33:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-fe9f0cac-ca8e-4680-8fa9-01caf66934c7 req-0db24100-09d0-4f90-8c65-d666e8d7c616 tempest-DeleteServersTestJSON-513250494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:33:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-fe9f0cac-ca8e-4680-8fa9-01caf66934c7 req-0db24100-09d0-4f90-8c65-d666e8d7c616 tempest-DeleteServersTestJSON-513250494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:33:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-fe9f0cac-ca8e-4680-8fa9-01caf66934c7 req-0db24100-09d0-4f90-8c65-d666e8d7c616 tempest-DeleteServersTestJSON-513250494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:33:12 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [req-fe9f0cac-ca8e-4680-8fa9-01caf66934c7 req-0db24100-09d0-4f90-8c65-d666e8d7c616 tempest-DeleteServersTestJSON-513250494 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff', 'name': 'volume-26e13350-8f8b-4ea3-b116-14d75af0924c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7f719003-4b31-4828-9395-e708b33d9f12', 'enforce_multipath': True} {{(pid=86136) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 18 21:33:12 devstack cinder-volume[86136]: INFO cinder.volume.manager [req-fe9f0cac-ca8e-4680-8fa9-01caf66934c7 req-0db24100-09d0-4f90-8c65-d666e8d7c616 tempest-DeleteServersTestJSON-513250494 None] attachment_update completed successfully. Sep 18 21:33:21 devstack cinder-volume[86136]: INFO cinder.volume.manager [req-5c06f6b3-a51e-42e1-a6ed-aa5b7251bd05 req-12a09358-84e3-4fa5-b6f2-0e0034d385fe tempest-DeleteServersTestJSON-513250494 None] Terminate volume connection completed successfully. Sep 18 21:33:21 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [req-5c06f6b3-a51e-42e1-a6ed-aa5b7251bd05 req-12a09358-84e3-4fa5-b6f2-0e0034d385fe tempest-DeleteServersTestJSON-513250494 None] Deleting attachment 7f719003-4b31-4828-9395-e708b33d9f12. {{(pid=86136) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 18 21:33:22 devstack cinder-volume[86136]: DEBUG dbcounter [-] [86136] Writing DB stats cinder:UPDATE=5,cinder:SELECT=10 {{(pid=86136) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 21:33:24 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddf4cf86-ded0-4cca-a723-bc8843bc6ef3 tempest-VolumesAdminNegativeTest-1142204865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:33:24 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ddf4cf86-ded0-4cca-a723-bc8843bc6ef3 tempest-VolumesAdminNegativeTest-1142204865 None] Flow 'volume_create_manager' (24a7bd7d-ae17-446d-babc-28c399918d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:33:24 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ddf4cf86-ded0-4cca-a723-bc8843bc6ef3 tempest-VolumesAdminNegativeTest-1142204865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b21d88c9-909c-4aaa-92c9-27f1921da787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:33:24 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ddf4cf86-ded0-4cca-a723-bc8843bc6ef3 tempest-VolumesAdminNegativeTest-1142204865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b21d88c9-909c-4aaa-92c9-27f1921da787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:33:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-9164066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83f271f0-5efc-49cc-8a3b-f0e580c0906e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c24c3be4a6d48368516969afa65a3c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:33:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:33:24Z,use_quota=True,user_id='a3bb8008dbb94680ab262f792c406ab8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:33:24 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ddf4cf86-ded0-4cca-a723-bc8843bc6ef3 tempest-VolumesAdminNegativeTest-1142204865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (495fb36f-8c6f-40e0-9a62-7bb62150f111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:33:24 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ddf4cf86-ded0-4cca-a723-bc8843bc6ef3 tempest-VolumesAdminNegativeTest-1142204865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (495fb36f-8c6f-40e0-9a62-7bb62150f111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:33:24 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ddf4cf86-ded0-4cca-a723-bc8843bc6ef3 tempest-VolumesAdminNegativeTest-1142204865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3f4e57a-b598-420e-b784-1ac4d25d11ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:33:24 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ddf4cf86-ded0-4cca-a723-bc8843bc6ef3 tempest-VolumesAdminNegativeTest-1142204865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3f4e57a-b598-420e-b784-1ac4d25d11ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83f271f0-5efc-49cc-8a3b-f0e580c0906e', 'volume_name': 'volume-83f271f0-5efc-49cc-8a3b-f0e580c0906e', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:33:24 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ddf4cf86-ded0-4cca-a723-bc8843bc6ef3 tempest-VolumesAdminNegativeTest-1142204865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43864899-37a0-4d09-b5c9-36024acca684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:33:24 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ddf4cf86-ded0-4cca-a723-bc8843bc6ef3 tempest-VolumesAdminNegativeTest-1142204865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43864899-37a0-4d09-b5c9-36024acca684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:33:24 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ddf4cf86-ded0-4cca-a723-bc8843bc6ef3 tempest-VolumesAdminNegativeTest-1142204865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (737566c3-e999-4e08-9020-e768c2a6b60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:33:24 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-ddf4cf86-ded0-4cca-a723-bc8843bc6ef3 tempest-VolumesAdminNegativeTest-1142204865 None] Volume 83f271f0-5efc-49cc-8a3b-f0e580c0906e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83f271f0-5efc-49cc-8a3b-f0e580c0906e', 'volume_size': 1} Sep 18 21:33:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-ddf4cf86-ded0-4cca-a723-bc8843bc6ef3 tempest-VolumesAdminNegativeTest-1142204865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:33:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-ddf4cf86-ded0-4cca-a723-bc8843bc6ef3 tempest-VolumesAdminNegativeTest-1142204865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:33:24 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-ddf4cf86-ded0-4cca-a723-bc8843bc6ef3 tempest-VolumesAdminNegativeTest-1142204865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:33:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-9164066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83f271f0-5efc-49cc-8a3b-f0e580c0906e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c24c3be4a6d48368516969afa65a3c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:33:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:33:24Z,use_quota=True,user_id='a3bb8008dbb94680ab262f792c406ab8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:33:24 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-ddf4cf86-ded0-4cca-a723-bc8843bc6ef3 tempest-VolumesAdminNegativeTest-1142204865 None] Creating volume 83f271f0-5efc-49cc-8a3b-f0e580c0906e {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:33:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-ddf4cf86-ded0-4cca-a723-bc8843bc6ef3 tempest-VolumesAdminNegativeTest-1142204865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:33:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-ddf4cf86-ded0-4cca-a723-bc8843bc6ef3 tempest-VolumesAdminNegativeTest-1142204865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:33:24 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-ddf4cf86-ded0-4cca-a723-bc8843bc6ef3 tempest-VolumesAdminNegativeTest-1142204865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:33:24 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-ddf4cf86-ded0-4cca-a723-bc8843bc6ef3 tempest-VolumesAdminNegativeTest-1142204865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:33:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-ddf4cf86-ded0-4cca-a723-bc8843bc6ef3 tempest-VolumesAdminNegativeTest-1142204865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:33:24 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-ddf4cf86-ded0-4cca-a723-bc8843bc6ef3 tempest-VolumesAdminNegativeTest-1142204865 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:33:24 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-ddf4cf86-ded0-4cca-a723-bc8843bc6ef3 tempest-VolumesAdminNegativeTest-1142204865 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:33:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ddf4cf86-ded0-4cca-a723-bc8843bc6ef3 tempest-VolumesAdminNegativeTest-1142204865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-83f271f0-5efc-49cc-8a3b-f0e580c0906e 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:33:24 devstack sudo[87946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-83f271f0-5efc-49cc-8a3b-f0e580c0906e 1073741824 Sep 18 21:33:24 devstack sudo[87946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:33:24 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-3b4da0a9-e2c8-41f1-975a-2dbcfc88369a tempest-DeleteServersTestJSON-513250494 None] Acquiring lock "cinder-26e13350-8f8b-4ea3-b116-14d75af0924c-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:33:25 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-3b4da0a9-e2c8-41f1-975a-2dbcfc88369a tempest-DeleteServersTestJSON-513250494 None] Lock "cinder-26e13350-8f8b-4ea3-b116-14d75af0924c-delete_volume" acquired by "delete_volume" :: waited 0.095s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:33:25 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-3b4da0a9-e2c8-41f1-975a-2dbcfc88369a tempest-DeleteServersTestJSON-513250494 None] Acquiring lock "cinder-quobyte-26e13350-8f8b-4ea3-b116-14d75af0924c" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:33:25 devstack sudo[87946]: pam_unix(sudo:session): session closed for user root Sep 18 21:33:25 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ddf4cf86-ded0-4cca-a723-bc8843bc6ef3 tempest-VolumesAdminNegativeTest-1142204865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-83f271f0-5efc-49cc-8a3b-f0e580c0906e 1073741824" returned: 0 in 0.909s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:33:25 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-3b4da0a9-e2c8-41f1-975a-2dbcfc88369a tempest-DeleteServersTestJSON-513250494 None] Lock "cinder-quobyte-26e13350-8f8b-4ea3-b116-14d75af0924c" acquired by "delete_volume" :: waited 0.033s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:33:25 devstack cinder-volume[86136]: INFO oslo.privsep.daemon [None req-3b4da0a9-e2c8-41f1-975a-2dbcfc88369a tempest-DeleteServersTestJSON-513250494 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp7uvgxlf_/privsep.sock'] Sep 18 21:33:25 devstack sudo[87954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp7uvgxlf_/privsep.sock Sep 18 21:33:25 devstack sudo[87954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:33:25 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ddf4cf86-ded0-4cca-a723-bc8843bc6ef3 tempest-VolumesAdminNegativeTest-1142204865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-83f271f0-5efc-49cc-8a3b-f0e580c0906e {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:33:25 devstack sudo[87956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-83f271f0-5efc-49cc-8a3b-f0e580c0906e Sep 18 21:33:25 devstack sudo[87956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:33:25 devstack sudo[87956]: pam_unix(sudo:session): session closed for user root Sep 18 21:33:25 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ddf4cf86-ded0-4cca-a723-bc8843bc6ef3 tempest-VolumesAdminNegativeTest-1142204865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-83f271f0-5efc-49cc-8a3b-f0e580c0906e" returned: 0 in 0.544s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:33:25 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-ddf4cf86-ded0-4cca-a723-bc8843bc6ef3 tempest-VolumesAdminNegativeTest-1142204865 None] <== create_volume: return (1566ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:33:25 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-ddf4cf86-ded0-4cca-a723-bc8843bc6ef3 tempest-VolumesAdminNegativeTest-1142204865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.569s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:33:25 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ddf4cf86-ded0-4cca-a723-bc8843bc6ef3 tempest-VolumesAdminNegativeTest-1142204865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (737566c3-e999-4e08-9020-e768c2a6b60e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83f271f0-5efc-49cc-8a3b-f0e580c0906e', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:33:25 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ddf4cf86-ded0-4cca-a723-bc8843bc6ef3 tempest-VolumesAdminNegativeTest-1142204865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79f2b549-cf7b-4d0f-af9d-3f9c9ffa03ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:33:25 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-ddf4cf86-ded0-4cca-a723-bc8843bc6ef3 tempest-VolumesAdminNegativeTest-1142204865 None] Volume volume-83f271f0-5efc-49cc-8a3b-f0e580c0906e (83f271f0-5efc-49cc-8a3b-f0e580c0906e): created successfully Sep 18 21:33:25 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ddf4cf86-ded0-4cca-a723-bc8843bc6ef3 tempest-VolumesAdminNegativeTest-1142204865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79f2b549-cf7b-4d0f-af9d-3f9c9ffa03ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:33:25 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ddf4cf86-ded0-4cca-a723-bc8843bc6ef3 tempest-VolumesAdminNegativeTest-1142204865 None] Flow 'volume_create_manager' (24a7bd7d-ae17-446d-babc-28c399918d7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:33:25 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-ddf4cf86-ded0-4cca-a723-bc8843bc6ef3 tempest-VolumesAdminNegativeTest-1142204865 None] Created volume successfully. Sep 18 21:33:26 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-0b37b03b-ccbe-44d9-aa57-4c2b08377ddd tempest-VolumesAdminNegativeTest-1142204865 None] Acquiring lock "cinder-83f271f0-5efc-49cc-8a3b-f0e580c0906e-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:33:27 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-0b37b03b-ccbe-44d9-aa57-4c2b08377ddd tempest-VolumesAdminNegativeTest-1142204865 None] Lock "cinder-83f271f0-5efc-49cc-8a3b-f0e580c0906e-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:33:27 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-0b37b03b-ccbe-44d9-aa57-4c2b08377ddd tempest-VolumesAdminNegativeTest-1142204865 None] Acquiring lock "cinder-quobyte-83f271f0-5efc-49cc-8a3b-f0e580c0906e" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:33:27 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-0b37b03b-ccbe-44d9-aa57-4c2b08377ddd tempest-VolumesAdminNegativeTest-1142204865 None] Lock "cinder-quobyte-83f271f0-5efc-49cc-8a3b-f0e580c0906e" acquired by "delete_volume" :: waited 0.017s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:33:27 devstack cinder-volume[86136]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 18 21:33:27 devstack cinder-volume[86136]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 18 21:33:27 devstack cinder-volume[86136]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 18 21:33:27 devstack cinder-volume[86136]: WARNING oslo.privsep.daemon [-] privsep log: Sep 18 21:33:27 devstack cinder-volume[86136]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 18 21:33:27 devstack cinder-volume[86136]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 18 21:33:27 devstack cinder-volume[86136]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 18 21:33:27 devstack cinder-volume[86136]: WARNING oslo.privsep.daemon [-] privsep log: Sep 18 21:33:27 devstack cinder-volume[86136]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 18 21:33:27 devstack sudo[87954]: pam_unix(sudo:session): session closed for user root Sep 18 21:33:27 devstack cinder-volume[86136]: INFO oslo.privsep.daemon [None req-3b4da0a9-e2c8-41f1-975a-2dbcfc88369a tempest-DeleteServersTestJSON-513250494 None] Spawned new privsep daemon via rootwrap Sep 18 21:33:27 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [None req-3b4da0a9-e2c8-41f1-975a-2dbcfc88369a tempest-DeleteServersTestJSON-513250494 None] Accepted privsep connection to /tmp/tmp7uvgxlf_/privsep.sock {{(pid=86136) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 18 21:33:27 devstack cinder-volume[86136]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 18 21:33:27 devstack cinder-volume[86136]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 18 21:33:27 devstack cinder-volume[86136]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 18 21:33:27 devstack cinder-volume[86136]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87968 Sep 18 21:33:27 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[623b7652-47f6-496b-aafd-56374af37d89]: (2,) {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:33:27 devstack cinder-volume[86136]: WARNING oslo_privsep.priv_context [None req-0b37b03b-ccbe-44d9-aa57-4c2b08377ddd tempest-VolumesAdminNegativeTest-1142204865 None] privsep daemon already running Sep 18 21:33:27 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce78d13-c0d4-4125-b595-da24d48ca326]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:33:27 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b65da13-19fa-44e1-9136-ea3b6ce168b6]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:33:27 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3b4da0a9-e2c8-41f1-975a-2dbcfc88369a tempest-DeleteServersTestJSON-513250494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-26e13350-8f8b-4ea3-b116-14d75af0924c {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:33:27 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0b37b03b-ccbe-44d9-aa57-4c2b08377ddd tempest-VolumesAdminNegativeTest-1142204865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-83f271f0-5efc-49cc-8a3b-f0e580c0906e {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:33:27 devstack sudo[87974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-83f271f0-5efc-49cc-8a3b-f0e580c0906e Sep 18 21:33:27 devstack sudo[87974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:33:27 devstack sudo[87973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-26e13350-8f8b-4ea3-b116-14d75af0924c Sep 18 21:33:27 devstack sudo[87973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:33:28 devstack sudo[87973]: pam_unix(sudo:session): session closed for user root Sep 18 21:33:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3b4da0a9-e2c8-41f1-975a-2dbcfc88369a tempest-DeleteServersTestJSON-513250494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-26e13350-8f8b-4ea3-b116-14d75af0924c" returned: 0 in 0.487s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:33:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3b4da0a9-e2c8-41f1-975a-2dbcfc88369a tempest-DeleteServersTestJSON-513250494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-26e13350-8f8b-4ea3-b116-14d75af0924c {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:33:28 devstack sudo[87983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-26e13350-8f8b-4ea3-b116-14d75af0924c Sep 18 21:33:28 devstack sudo[87983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:33:28 devstack sudo[87974]: pam_unix(sudo:session): session closed for user root Sep 18 21:33:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0b37b03b-ccbe-44d9-aa57-4c2b08377ddd tempest-VolumesAdminNegativeTest-1142204865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-83f271f0-5efc-49cc-8a3b-f0e580c0906e" returned: 0 in 0.557s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:33:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0b37b03b-ccbe-44d9-aa57-4c2b08377ddd tempest-VolumesAdminNegativeTest-1142204865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-83f271f0-5efc-49cc-8a3b-f0e580c0906e {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:33:28 devstack sudo[87985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-83f271f0-5efc-49cc-8a3b-f0e580c0906e Sep 18 21:33:28 devstack sudo[87985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:33:28 devstack sudo[87985]: pam_unix(sudo:session): session closed for user root Sep 18 21:33:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0b37b03b-ccbe-44d9-aa57-4c2b08377ddd tempest-VolumesAdminNegativeTest-1142204865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-83f271f0-5efc-49cc-8a3b-f0e580c0906e" returned: 0 in 0.454s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:33:28 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-0b37b03b-ccbe-44d9-aa57-4c2b08377ddd tempest-VolumesAdminNegativeTest-1142204865 None] Lock "cinder-quobyte-83f271f0-5efc-49cc-8a3b-f0e580c0906e" released by "delete_volume" :: held 1.720s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:33:28 devstack sudo[87983]: pam_unix(sudo:session): session closed for user root Sep 18 21:33:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3b4da0a9-e2c8-41f1-975a-2dbcfc88369a tempest-DeleteServersTestJSON-513250494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-26e13350-8f8b-4ea3-b116-14d75af0924c" returned: 0 in 0.593s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:33:28 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-3b4da0a9-e2c8-41f1-975a-2dbcfc88369a tempest-DeleteServersTestJSON-513250494 None] Lock "cinder-quobyte-26e13350-8f8b-4ea3-b116-14d75af0924c" released by "delete_volume" :: held 3.684s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:33:28 devstack cinder-volume[86136]: WARNING cinder.quota [None req-0b37b03b-ccbe-44d9-aa57-4c2b08377ddd tempest-VolumesAdminNegativeTest-1142204865 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 18 21:33:28 devstack cinder-volume[86136]: WARNING cinder.quota [None req-0b37b03b-ccbe-44d9-aa57-4c2b08377ddd tempest-VolumesAdminNegativeTest-1142204865 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 18 21:33:29 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-0b37b03b-ccbe-44d9-aa57-4c2b08377ddd tempest-VolumesAdminNegativeTest-1142204865 None] Created reservations ['ff5a6b97-be1d-40cf-a923-8738642d59e0', '342dac86-c2f9-47f5-8b72-99a676628099', 'e884e7c9-da3c-4e16-b653-f15edd7fbd75', '88c903b1-05b4-489d-9e9b-04086e00219c'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:33:29 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-3b4da0a9-e2c8-41f1-975a-2dbcfc88369a tempest-DeleteServersTestJSON-513250494 None] Created reservations ['743197f2-88a3-4b5d-bf1e-4a70eb511c4d', '87f144c0-d0ac-4bee-800d-6264d82a61aa', 'f63c1964-27e0-4ca5-8399-5c120d1d9504', '5ef81778-6871-4f4d-a254-f431da063f17'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:33:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-3b4da0a9-e2c8-41f1-975a-2dbcfc88369a tempest-DeleteServersTestJSON-513250494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:33:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-3b4da0a9-e2c8-41f1-975a-2dbcfc88369a tempest-DeleteServersTestJSON-513250494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:33:29 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-3b4da0a9-e2c8-41f1-975a-2dbcfc88369a tempest-DeleteServersTestJSON-513250494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:33:29 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-3b4da0a9-e2c8-41f1-975a-2dbcfc88369a tempest-DeleteServersTestJSON-513250494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:33:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-3b4da0a9-e2c8-41f1-975a-2dbcfc88369a tempest-DeleteServersTestJSON-513250494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:33:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3b4da0a9-e2c8-41f1-975a-2dbcfc88369a tempest-DeleteServersTestJSON-513250494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:33:29 devstack sudo[87990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:33:29 devstack sudo[87990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:33:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-0b37b03b-ccbe-44d9-aa57-4c2b08377ddd tempest-VolumesAdminNegativeTest-1142204865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:33:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-0b37b03b-ccbe-44d9-aa57-4c2b08377ddd tempest-VolumesAdminNegativeTest-1142204865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:33:29 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-0b37b03b-ccbe-44d9-aa57-4c2b08377ddd tempest-VolumesAdminNegativeTest-1142204865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:33:29 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-0b37b03b-ccbe-44d9-aa57-4c2b08377ddd tempest-VolumesAdminNegativeTest-1142204865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:33:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-0b37b03b-ccbe-44d9-aa57-4c2b08377ddd tempest-VolumesAdminNegativeTest-1142204865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:33:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0b37b03b-ccbe-44d9-aa57-4c2b08377ddd tempest-VolumesAdminNegativeTest-1142204865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:33:29 devstack sudo[87992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:33:29 devstack sudo[87992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:33:29 devstack sudo[87990]: pam_unix(sudo:session): session closed for user root Sep 18 21:33:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3b4da0a9-e2c8-41f1-975a-2dbcfc88369a tempest-DeleteServersTestJSON-513250494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.609s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:33:29 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-3b4da0a9-e2c8-41f1-975a-2dbcfc88369a tempest-DeleteServersTestJSON-513250494 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:33:29 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-3b4da0a9-e2c8-41f1-975a-2dbcfc88369a tempest-DeleteServersTestJSON-513250494 None] Deleted volume successfully. Sep 18 21:33:29 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-3b4da0a9-e2c8-41f1-975a-2dbcfc88369a tempest-DeleteServersTestJSON-513250494 None] Lock "cinder-26e13350-8f8b-4ea3-b116-14d75af0924c-delete_volume" released by "delete_volume" :: held 4.891s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:33:29 devstack sudo[87992]: pam_unix(sudo:session): session closed for user root Sep 18 21:33:30 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0b37b03b-ccbe-44d9-aa57-4c2b08377ddd tempest-VolumesAdminNegativeTest-1142204865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.714s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:33:30 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-0b37b03b-ccbe-44d9-aa57-4c2b08377ddd tempest-VolumesAdminNegativeTest-1142204865 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:33:30 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-0b37b03b-ccbe-44d9-aa57-4c2b08377ddd tempest-VolumesAdminNegativeTest-1142204865 None] Deleted volume successfully. Sep 18 21:33:30 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-0b37b03b-ccbe-44d9-aa57-4c2b08377ddd tempest-VolumesAdminNegativeTest-1142204865 None] Lock "cinder-83f271f0-5efc-49cc-8a3b-f0e580c0906e-delete_volume" released by "delete_volume" :: held 3.050s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:33:30 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-40cc8001-9ed1-47ad-9974-6054f4d8fa9d tempest-ServersNegativeTestJSON-1447684049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:33:30 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-40cc8001-9ed1-47ad-9974-6054f4d8fa9d tempest-ServersNegativeTestJSON-1447684049 None] Flow 'volume_create_manager' (bcf5a433-95ff-4988-b9c3-a24bcae050b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:33:30 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-40cc8001-9ed1-47ad-9974-6054f4d8fa9d tempest-ServersNegativeTestJSON-1447684049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (428fcb20-91a4-4209-921d-9278e265c204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:33:30 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-40cc8001-9ed1-47ad-9974-6054f4d8fa9d tempest-ServersNegativeTestJSON-1447684049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (428fcb20-91a4-4209-921d-9278e265c204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:33:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1035898792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44b71840-067d-45fc-8a4b-eb6053bbc8c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6f496eca49b4897b5d7a401ea698f04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:33:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:33:30Z,use_quota=True,user_id='c1afab7b8ef14b62a17f3e10df444ea4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:33:30 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-40cc8001-9ed1-47ad-9974-6054f4d8fa9d tempest-ServersNegativeTestJSON-1447684049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2d04764-c29e-4523-a0a8-10f3c011cc52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:33:30 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-40cc8001-9ed1-47ad-9974-6054f4d8fa9d tempest-ServersNegativeTestJSON-1447684049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2d04764-c29e-4523-a0a8-10f3c011cc52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:33:30 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-40cc8001-9ed1-47ad-9974-6054f4d8fa9d tempest-ServersNegativeTestJSON-1447684049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85c29e0a-8a39-4ced-997d-087fd21d7ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:33:30 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-40cc8001-9ed1-47ad-9974-6054f4d8fa9d tempest-ServersNegativeTestJSON-1447684049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85c29e0a-8a39-4ced-997d-087fd21d7ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44b71840-067d-45fc-8a4b-eb6053bbc8c0', 'volume_name': 'volume-44b71840-067d-45fc-8a4b-eb6053bbc8c0', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:33:30 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-40cc8001-9ed1-47ad-9974-6054f4d8fa9d tempest-ServersNegativeTestJSON-1447684049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aed8f316-7153-462d-9070-8e65e7514aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:33:30 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-40cc8001-9ed1-47ad-9974-6054f4d8fa9d tempest-ServersNegativeTestJSON-1447684049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aed8f316-7153-462d-9070-8e65e7514aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:33:30 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-40cc8001-9ed1-47ad-9974-6054f4d8fa9d tempest-ServersNegativeTestJSON-1447684049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db200aef-d455-4f57-bc00-856ae5a545ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:33:30 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-40cc8001-9ed1-47ad-9974-6054f4d8fa9d tempest-ServersNegativeTestJSON-1447684049 None] Volume 44b71840-067d-45fc-8a4b-eb6053bbc8c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44b71840-067d-45fc-8a4b-eb6053bbc8c0', 'volume_size': 1} Sep 18 21:33:30 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-40cc8001-9ed1-47ad-9974-6054f4d8fa9d tempest-ServersNegativeTestJSON-1447684049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:33:30 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-40cc8001-9ed1-47ad-9974-6054f4d8fa9d tempest-ServersNegativeTestJSON-1447684049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:33:30 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-40cc8001-9ed1-47ad-9974-6054f4d8fa9d tempest-ServersNegativeTestJSON-1447684049 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:33:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1035898792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44b71840-067d-45fc-8a4b-eb6053bbc8c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6f496eca49b4897b5d7a401ea698f04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:33:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:33:30Z,use_quota=True,user_id='c1afab7b8ef14b62a17f3e10df444ea4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:33:30 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-40cc8001-9ed1-47ad-9974-6054f4d8fa9d tempest-ServersNegativeTestJSON-1447684049 None] Creating volume 44b71840-067d-45fc-8a4b-eb6053bbc8c0 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:33:30 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-40cc8001-9ed1-47ad-9974-6054f4d8fa9d tempest-ServersNegativeTestJSON-1447684049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:33:30 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-40cc8001-9ed1-47ad-9974-6054f4d8fa9d tempest-ServersNegativeTestJSON-1447684049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:33:30 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-40cc8001-9ed1-47ad-9974-6054f4d8fa9d tempest-ServersNegativeTestJSON-1447684049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:33:30 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-40cc8001-9ed1-47ad-9974-6054f4d8fa9d tempest-ServersNegativeTestJSON-1447684049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:33:30 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-40cc8001-9ed1-47ad-9974-6054f4d8fa9d tempest-ServersNegativeTestJSON-1447684049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:33:30 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-40cc8001-9ed1-47ad-9974-6054f4d8fa9d tempest-ServersNegativeTestJSON-1447684049 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:33:30 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-40cc8001-9ed1-47ad-9974-6054f4d8fa9d tempest-ServersNegativeTestJSON-1447684049 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:33:30 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-40cc8001-9ed1-47ad-9974-6054f4d8fa9d tempest-ServersNegativeTestJSON-1447684049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-44b71840-067d-45fc-8a4b-eb6053bbc8c0 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:33:30 devstack sudo[88015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-44b71840-067d-45fc-8a4b-eb6053bbc8c0 1073741824 Sep 18 21:33:30 devstack sudo[88015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:33:30 devstack sudo[88015]: pam_unix(sudo:session): session closed for user root Sep 18 21:33:30 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-40cc8001-9ed1-47ad-9974-6054f4d8fa9d tempest-ServersNegativeTestJSON-1447684049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-44b71840-067d-45fc-8a4b-eb6053bbc8c0 1073741824" returned: 0 in 0.577s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:33:30 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-40cc8001-9ed1-47ad-9974-6054f4d8fa9d tempest-ServersNegativeTestJSON-1447684049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-44b71840-067d-45fc-8a4b-eb6053bbc8c0 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:33:30 devstack sudo[88027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-44b71840-067d-45fc-8a4b-eb6053bbc8c0 Sep 18 21:33:30 devstack sudo[88027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:33:31 devstack sudo[88027]: pam_unix(sudo:session): session closed for user root Sep 18 21:33:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-40cc8001-9ed1-47ad-9974-6054f4d8fa9d tempest-ServersNegativeTestJSON-1447684049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-44b71840-067d-45fc-8a4b-eb6053bbc8c0" returned: 0 in 0.268s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:33:31 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-40cc8001-9ed1-47ad-9974-6054f4d8fa9d tempest-ServersNegativeTestJSON-1447684049 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:33:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-40cc8001-9ed1-47ad-9974-6054f4d8fa9d tempest-ServersNegativeTestJSON-1447684049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:33:31 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-40cc8001-9ed1-47ad-9974-6054f4d8fa9d tempest-ServersNegativeTestJSON-1447684049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db200aef-d455-4f57-bc00-856ae5a545ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44b71840-067d-45fc-8a4b-eb6053bbc8c0', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:33:31 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-40cc8001-9ed1-47ad-9974-6054f4d8fa9d tempest-ServersNegativeTestJSON-1447684049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e070ecbc-4089-49a6-83b5-e8286b5258b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:33:31 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-40cc8001-9ed1-47ad-9974-6054f4d8fa9d tempest-ServersNegativeTestJSON-1447684049 None] Volume volume-44b71840-067d-45fc-8a4b-eb6053bbc8c0 (44b71840-067d-45fc-8a4b-eb6053bbc8c0): created successfully Sep 18 21:33:31 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-40cc8001-9ed1-47ad-9974-6054f4d8fa9d tempest-ServersNegativeTestJSON-1447684049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e070ecbc-4089-49a6-83b5-e8286b5258b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:33:31 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-40cc8001-9ed1-47ad-9974-6054f4d8fa9d tempest-ServersNegativeTestJSON-1447684049 None] Flow 'volume_create_manager' (bcf5a433-95ff-4988-b9c3-a24bcae050b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:33:31 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-40cc8001-9ed1-47ad-9974-6054f4d8fa9d tempest-ServersNegativeTestJSON-1447684049 None] Created volume successfully. Sep 18 21:33:34 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fa2315b-1fb1-4eff-a85f-6d0a5c831c2c tempest-ServersNegativeTestJSON-1447684049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:33:34 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-1fa2315b-1fb1-4eff-a85f-6d0a5c831c2c tempest-ServersNegativeTestJSON-1447684049 None] Flow 'volume_create_manager' (70bc7ec9-6436-4c38-a305-601e4b3af644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:33:34 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-1fa2315b-1fb1-4eff-a85f-6d0a5c831c2c tempest-ServersNegativeTestJSON-1447684049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c54250b-d0b3-42b8-a9d7-3481b37616df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:33:34 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-1fa2315b-1fb1-4eff-a85f-6d0a5c831c2c tempest-ServersNegativeTestJSON-1447684049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c54250b-d0b3-42b8-a9d7-3481b37616df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:33:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1462776093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55412793-dbbb-41da-8afd-221c7f273572,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6f496eca49b4897b5d7a401ea698f04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:33:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:33:35Z,use_quota=True,user_id='c1afab7b8ef14b62a17f3e10df444ea4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:33:34 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-1fa2315b-1fb1-4eff-a85f-6d0a5c831c2c tempest-ServersNegativeTestJSON-1447684049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31a8e22d-c026-4803-a6cf-c7ddff2920e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:33:34 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-1fa2315b-1fb1-4eff-a85f-6d0a5c831c2c tempest-ServersNegativeTestJSON-1447684049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31a8e22d-c026-4803-a6cf-c7ddff2920e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:33:34 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-1fa2315b-1fb1-4eff-a85f-6d0a5c831c2c tempest-ServersNegativeTestJSON-1447684049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d09b0c4-1a85-41ef-bc6c-d80f809e92db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:33:34 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-1fa2315b-1fb1-4eff-a85f-6d0a5c831c2c tempest-ServersNegativeTestJSON-1447684049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d09b0c4-1a85-41ef-bc6c-d80f809e92db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55412793-dbbb-41da-8afd-221c7f273572', 'volume_name': 'volume-55412793-dbbb-41da-8afd-221c7f273572', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:33:34 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-1fa2315b-1fb1-4eff-a85f-6d0a5c831c2c tempest-ServersNegativeTestJSON-1447684049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79996501-ddf2-447f-9afd-fffff32822ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:33:34 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-1fa2315b-1fb1-4eff-a85f-6d0a5c831c2c tempest-ServersNegativeTestJSON-1447684049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79996501-ddf2-447f-9afd-fffff32822ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:33:34 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-1fa2315b-1fb1-4eff-a85f-6d0a5c831c2c tempest-ServersNegativeTestJSON-1447684049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (370f8d23-7347-438e-8a11-1ae7f286a665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:33:34 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-1fa2315b-1fb1-4eff-a85f-6d0a5c831c2c tempest-ServersNegativeTestJSON-1447684049 None] Volume 55412793-dbbb-41da-8afd-221c7f273572: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55412793-dbbb-41da-8afd-221c7f273572', 'volume_size': 1} Sep 18 21:33:34 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-1fa2315b-1fb1-4eff-a85f-6d0a5c831c2c tempest-ServersNegativeTestJSON-1447684049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:33:34 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-1fa2315b-1fb1-4eff-a85f-6d0a5c831c2c tempest-ServersNegativeTestJSON-1447684049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:33:34 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-1fa2315b-1fb1-4eff-a85f-6d0a5c831c2c tempest-ServersNegativeTestJSON-1447684049 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:33:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1462776093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55412793-dbbb-41da-8afd-221c7f273572,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6f496eca49b4897b5d7a401ea698f04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:33:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:33:35Z,use_quota=True,user_id='c1afab7b8ef14b62a17f3e10df444ea4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:33:34 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-1fa2315b-1fb1-4eff-a85f-6d0a5c831c2c tempest-ServersNegativeTestJSON-1447684049 None] Creating volume 55412793-dbbb-41da-8afd-221c7f273572 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:33:34 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-1fa2315b-1fb1-4eff-a85f-6d0a5c831c2c tempest-ServersNegativeTestJSON-1447684049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:33:34 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-1fa2315b-1fb1-4eff-a85f-6d0a5c831c2c tempest-ServersNegativeTestJSON-1447684049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:33:34 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-1fa2315b-1fb1-4eff-a85f-6d0a5c831c2c tempest-ServersNegativeTestJSON-1447684049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:33:34 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-1fa2315b-1fb1-4eff-a85f-6d0a5c831c2c tempest-ServersNegativeTestJSON-1447684049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:33:34 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-1fa2315b-1fb1-4eff-a85f-6d0a5c831c2c tempest-ServersNegativeTestJSON-1447684049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:33:34 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-1fa2315b-1fb1-4eff-a85f-6d0a5c831c2c tempest-ServersNegativeTestJSON-1447684049 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:33:34 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-1fa2315b-1fb1-4eff-a85f-6d0a5c831c2c tempest-ServersNegativeTestJSON-1447684049 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:33:34 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1fa2315b-1fb1-4eff-a85f-6d0a5c831c2c tempest-ServersNegativeTestJSON-1447684049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-55412793-dbbb-41da-8afd-221c7f273572 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:33:34 devstack sudo[88037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-55412793-dbbb-41da-8afd-221c7f273572 1073741824 Sep 18 21:33:34 devstack sudo[88037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:33:35 devstack sudo[88037]: pam_unix(sudo:session): session closed for user root Sep 18 21:33:35 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1fa2315b-1fb1-4eff-a85f-6d0a5c831c2c tempest-ServersNegativeTestJSON-1447684049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-55412793-dbbb-41da-8afd-221c7f273572 1073741824" returned: 0 in 0.483s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:33:35 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1fa2315b-1fb1-4eff-a85f-6d0a5c831c2c tempest-ServersNegativeTestJSON-1447684049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-55412793-dbbb-41da-8afd-221c7f273572 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:33:35 devstack sudo[88043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-55412793-dbbb-41da-8afd-221c7f273572 Sep 18 21:33:35 devstack sudo[88043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:33:35 devstack sudo[88043]: pam_unix(sudo:session): session closed for user root Sep 18 21:33:35 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1fa2315b-1fb1-4eff-a85f-6d0a5c831c2c tempest-ServersNegativeTestJSON-1447684049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-55412793-dbbb-41da-8afd-221c7f273572" returned: 0 in 0.333s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:33:35 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-1fa2315b-1fb1-4eff-a85f-6d0a5c831c2c tempest-ServersNegativeTestJSON-1447684049 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:33:35 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-1fa2315b-1fb1-4eff-a85f-6d0a5c831c2c tempest-ServersNegativeTestJSON-1447684049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:33:35 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-1fa2315b-1fb1-4eff-a85f-6d0a5c831c2c tempest-ServersNegativeTestJSON-1447684049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (370f8d23-7347-438e-8a11-1ae7f286a665) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55412793-dbbb-41da-8afd-221c7f273572', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:33:35 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-1fa2315b-1fb1-4eff-a85f-6d0a5c831c2c tempest-ServersNegativeTestJSON-1447684049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cf5ea94-9a3b-4a88-9b63-a9bd5b261bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:33:35 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-1fa2315b-1fb1-4eff-a85f-6d0a5c831c2c tempest-ServersNegativeTestJSON-1447684049 None] Volume volume-55412793-dbbb-41da-8afd-221c7f273572 (55412793-dbbb-41da-8afd-221c7f273572): created successfully Sep 18 21:33:35 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-1fa2315b-1fb1-4eff-a85f-6d0a5c831c2c tempest-ServersNegativeTestJSON-1447684049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cf5ea94-9a3b-4a88-9b63-a9bd5b261bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:33:35 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-1fa2315b-1fb1-4eff-a85f-6d0a5c831c2c tempest-ServersNegativeTestJSON-1447684049 None] Flow 'volume_create_manager' (70bc7ec9-6436-4c38-a305-601e4b3af644) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:33:35 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-1fa2315b-1fb1-4eff-a85f-6d0a5c831c2c tempest-ServersNegativeTestJSON-1447684049 None] Created volume successfully. Sep 18 21:33:37 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-c7554134-61db-4122-a6fd-84e2a890d2f9 tempest-ServersNegativeTestJSON-1447684049 None] Acquiring lock "cinder-55412793-dbbb-41da-8afd-221c7f273572-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:33:37 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-c7554134-61db-4122-a6fd-84e2a890d2f9 tempest-ServersNegativeTestJSON-1447684049 None] Lock "cinder-55412793-dbbb-41da-8afd-221c7f273572-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:33:37 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-c7554134-61db-4122-a6fd-84e2a890d2f9 tempest-ServersNegativeTestJSON-1447684049 None] Acquiring lock "cinder-quobyte-55412793-dbbb-41da-8afd-221c7f273572" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:33:37 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-c7554134-61db-4122-a6fd-84e2a890d2f9 tempest-ServersNegativeTestJSON-1447684049 None] Lock "cinder-quobyte-55412793-dbbb-41da-8afd-221c7f273572" acquired by "delete_volume" :: waited 0.016s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:33:37 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[471cfd19-1b61-4274-ad92-add0ea435d9c]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:33:37 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c7554134-61db-4122-a6fd-84e2a890d2f9 tempest-ServersNegativeTestJSON-1447684049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-55412793-dbbb-41da-8afd-221c7f273572 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:33:38 devstack sudo[88048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-55412793-dbbb-41da-8afd-221c7f273572 Sep 18 21:33:38 devstack sudo[88048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:33:38 devstack sudo[88048]: pam_unix(sudo:session): session closed for user root Sep 18 21:33:38 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c7554134-61db-4122-a6fd-84e2a890d2f9 tempest-ServersNegativeTestJSON-1447684049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-55412793-dbbb-41da-8afd-221c7f273572" returned: 0 in 0.494s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:33:38 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c7554134-61db-4122-a6fd-84e2a890d2f9 tempest-ServersNegativeTestJSON-1447684049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-55412793-dbbb-41da-8afd-221c7f273572 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:33:38 devstack sudo[88054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-55412793-dbbb-41da-8afd-221c7f273572 Sep 18 21:33:38 devstack sudo[88054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:33:38 devstack sudo[88054]: pam_unix(sudo:session): session closed for user root Sep 18 21:33:38 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c7554134-61db-4122-a6fd-84e2a890d2f9 tempest-ServersNegativeTestJSON-1447684049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-55412793-dbbb-41da-8afd-221c7f273572" returned: 0 in 0.328s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:33:38 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-c7554134-61db-4122-a6fd-84e2a890d2f9 tempest-ServersNegativeTestJSON-1447684049 None] Lock "cinder-quobyte-55412793-dbbb-41da-8afd-221c7f273572" released by "delete_volume" :: held 0.875s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:33:38 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-c7554134-61db-4122-a6fd-84e2a890d2f9 tempest-ServersNegativeTestJSON-1447684049 None] Created reservations ['74b15acb-9014-421e-8b12-4c9a71831048', '07c7a3cd-3732-4dd9-9e86-fc575a02ed78', '2d6350f0-5800-4adc-94d5-0cf286456cd1', '2499fa6b-760d-40be-a20e-0d30f9fda80d'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:33:38 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c7554134-61db-4122-a6fd-84e2a890d2f9 tempest-ServersNegativeTestJSON-1447684049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:33:38 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c7554134-61db-4122-a6fd-84e2a890d2f9 tempest-ServersNegativeTestJSON-1447684049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:33:38 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-c7554134-61db-4122-a6fd-84e2a890d2f9 tempest-ServersNegativeTestJSON-1447684049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:33:38 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-c7554134-61db-4122-a6fd-84e2a890d2f9 tempest-ServersNegativeTestJSON-1447684049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:33:38 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c7554134-61db-4122-a6fd-84e2a890d2f9 tempest-ServersNegativeTestJSON-1447684049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:33:38 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c7554134-61db-4122-a6fd-84e2a890d2f9 tempest-ServersNegativeTestJSON-1447684049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:33:39 devstack sudo[88057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:33:39 devstack sudo[88057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:33:39 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-a85c60b4-0fc5-4e0b-84b1-b83fece477a8 tempest-ServersNegativeTestJSON-1447684049 None] Acquiring lock "cinder-44b71840-067d-45fc-8a4b-eb6053bbc8c0-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:33:39 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-a85c60b4-0fc5-4e0b-84b1-b83fece477a8 tempest-ServersNegativeTestJSON-1447684049 None] Lock "cinder-44b71840-067d-45fc-8a4b-eb6053bbc8c0-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:33:39 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-a85c60b4-0fc5-4e0b-84b1-b83fece477a8 tempest-ServersNegativeTestJSON-1447684049 None] Acquiring lock "cinder-quobyte-44b71840-067d-45fc-8a4b-eb6053bbc8c0" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:33:39 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-a85c60b4-0fc5-4e0b-84b1-b83fece477a8 tempest-ServersNegativeTestJSON-1447684049 None] Lock "cinder-quobyte-44b71840-067d-45fc-8a4b-eb6053bbc8c0" acquired by "delete_volume" :: waited 0.039s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:33:39 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[617a47d8-bbd3-4008-b734-c36d8805da99]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:33:39 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-a85c60b4-0fc5-4e0b-84b1-b83fece477a8 tempest-ServersNegativeTestJSON-1447684049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-44b71840-067d-45fc-8a4b-eb6053bbc8c0 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:33:39 devstack sudo[88057]: pam_unix(sudo:session): session closed for user root Sep 18 21:33:39 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c7554134-61db-4122-a6fd-84e2a890d2f9 tempest-ServersNegativeTestJSON-1447684049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.330s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:33:39 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-c7554134-61db-4122-a6fd-84e2a890d2f9 tempest-ServersNegativeTestJSON-1447684049 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:33:39 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-c7554134-61db-4122-a6fd-84e2a890d2f9 tempest-ServersNegativeTestJSON-1447684049 None] Deleted volume successfully. Sep 18 21:33:39 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-c7554134-61db-4122-a6fd-84e2a890d2f9 tempest-ServersNegativeTestJSON-1447684049 None] Lock "cinder-55412793-dbbb-41da-8afd-221c7f273572-delete_volume" released by "delete_volume" :: held 1.527s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:33:39 devstack sudo[88060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-44b71840-067d-45fc-8a4b-eb6053bbc8c0 Sep 18 21:33:39 devstack sudo[88060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:33:39 devstack sudo[88060]: pam_unix(sudo:session): session closed for user root Sep 18 21:33:39 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-a85c60b4-0fc5-4e0b-84b1-b83fece477a8 tempest-ServersNegativeTestJSON-1447684049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-44b71840-067d-45fc-8a4b-eb6053bbc8c0" returned: 0 in 0.535s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:33:39 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-a85c60b4-0fc5-4e0b-84b1-b83fece477a8 tempest-ServersNegativeTestJSON-1447684049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-44b71840-067d-45fc-8a4b-eb6053bbc8c0 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:33:39 devstack sudo[88067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-44b71840-067d-45fc-8a4b-eb6053bbc8c0 Sep 18 21:33:39 devstack sudo[88067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:33:40 devstack sudo[88067]: pam_unix(sudo:session): session closed for user root Sep 18 21:33:40 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-a85c60b4-0fc5-4e0b-84b1-b83fece477a8 tempest-ServersNegativeTestJSON-1447684049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-44b71840-067d-45fc-8a4b-eb6053bbc8c0" returned: 0 in 0.364s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:33:40 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-a85c60b4-0fc5-4e0b-84b1-b83fece477a8 tempest-ServersNegativeTestJSON-1447684049 None] Lock "cinder-quobyte-44b71840-067d-45fc-8a4b-eb6053bbc8c0" released by "delete_volume" :: held 0.973s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:33:40 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-a85c60b4-0fc5-4e0b-84b1-b83fece477a8 tempest-ServersNegativeTestJSON-1447684049 None] Created reservations ['9365662f-350c-4400-a65f-18eb126e6555', 'ad54374a-73f1-40c7-b4d8-3228a310aeae', '598a12cb-70fe-4544-a763-ba6d44c0f05b', 'c5706376-5e95-4ea6-b53f-6645cf056043'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:33:40 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-a85c60b4-0fc5-4e0b-84b1-b83fece477a8 tempest-ServersNegativeTestJSON-1447684049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:33:40 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-a85c60b4-0fc5-4e0b-84b1-b83fece477a8 tempest-ServersNegativeTestJSON-1447684049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:33:40 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-a85c60b4-0fc5-4e0b-84b1-b83fece477a8 tempest-ServersNegativeTestJSON-1447684049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:33:40 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-a85c60b4-0fc5-4e0b-84b1-b83fece477a8 tempest-ServersNegativeTestJSON-1447684049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:33:40 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-a85c60b4-0fc5-4e0b-84b1-b83fece477a8 tempest-ServersNegativeTestJSON-1447684049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:33:40 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-a85c60b4-0fc5-4e0b-84b1-b83fece477a8 tempest-ServersNegativeTestJSON-1447684049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:33:40 devstack sudo[88070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:33:40 devstack sudo[88070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:33:40 devstack sudo[88070]: pam_unix(sudo:session): session closed for user root Sep 18 21:33:40 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-a85c60b4-0fc5-4e0b-84b1-b83fece477a8 tempest-ServersNegativeTestJSON-1447684049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.308s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:33:40 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-a85c60b4-0fc5-4e0b-84b1-b83fece477a8 tempest-ServersNegativeTestJSON-1447684049 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:33:40 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-a85c60b4-0fc5-4e0b-84b1-b83fece477a8 tempest-ServersNegativeTestJSON-1447684049 None] Deleted volume successfully. Sep 18 21:33:40 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-a85c60b4-0fc5-4e0b-84b1-b83fece477a8 tempest-ServersNegativeTestJSON-1447684049 None] Lock "cinder-44b71840-067d-45fc-8a4b-eb6053bbc8c0-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:33:50 devstack cinder-volume[86136]: DEBUG dbcounter [-] [86136] Writing DB stats cinder:UPDATE=44,cinder:SELECT=20,cinder:INSERT=12,cinder:DELETE=4 {{(pid=86136) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 21:33:50 devstack cinder-volume[86136]: DEBUG dbcounter [-] [86136] Writing DB stats cinder:SELECT=41,cinder:INSERT=8,cinder:UPDATE=42,cinder:DELETE=4 {{(pid=86136) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 21:34:02 devstack cinder-volume[86136]: DEBUG dbcounter [-] [86136] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=86136) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 21:34:05 devstack cinder-volume[86136]: DEBUG oslo_service.periodic_task [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86136) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 21:34:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:34:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:34:05 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:34:05 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:34:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:34:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:34:05 devstack sudo[88119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:34:05 devstack sudo[88119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:34:05 devstack sudo[88119]: pam_unix(sudo:session): session closed for user root Sep 18 21:34:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.328s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:34:05 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:34:10 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-f072ffcd-a610-4bdb-bd30-305b26e6a795 tempest-VolumesTestJSON-1979632273 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:34:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f072ffcd-a610-4bdb-bd30-305b26e6a795 tempest-VolumesTestJSON-1979632273 None] Flow 'volume_create_manager' (45a9b706-d8f1-420c-b08e-c57694d6cc86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:34:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f072ffcd-a610-4bdb-bd30-305b26e6a795 tempest-VolumesTestJSON-1979632273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d267dca-9160-45ba-9b20-857769ce42a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:34:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f072ffcd-a610-4bdb-bd30-305b26e6a795 tempest-VolumesTestJSON-1979632273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d267dca-9160-45ba-9b20-857769ce42a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:34:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-46421206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cea26553-21b6-4b6d-ba2f-e46c6b6af2ee,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='be0b026ffff8489ca86a3b7e5fad2d5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:34:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:34:11Z,use_quota=True,user_id='a75334e579eb46bba779f4f0b48561a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:34:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f072ffcd-a610-4bdb-bd30-305b26e6a795 tempest-VolumesTestJSON-1979632273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6340da3-9363-4280-983d-4ac2df095a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:34:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f072ffcd-a610-4bdb-bd30-305b26e6a795 tempest-VolumesTestJSON-1979632273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6340da3-9363-4280-983d-4ac2df095a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:34:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f072ffcd-a610-4bdb-bd30-305b26e6a795 tempest-VolumesTestJSON-1979632273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97aea23d-73a7-44d0-8cac-6b3b18fce054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:34:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f072ffcd-a610-4bdb-bd30-305b26e6a795 tempest-VolumesTestJSON-1979632273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97aea23d-73a7-44d0-8cac-6b3b18fce054) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cea26553-21b6-4b6d-ba2f-e46c6b6af2ee', 'volume_name': 'volume-cea26553-21b6-4b6d-ba2f-e46c6b6af2ee', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:34:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f072ffcd-a610-4bdb-bd30-305b26e6a795 tempest-VolumesTestJSON-1979632273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b2fd339-e5c4-4f12-ab1f-90311381b141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:34:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f072ffcd-a610-4bdb-bd30-305b26e6a795 tempest-VolumesTestJSON-1979632273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b2fd339-e5c4-4f12-ab1f-90311381b141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:34:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f072ffcd-a610-4bdb-bd30-305b26e6a795 tempest-VolumesTestJSON-1979632273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7096cb4e-914e-4b9c-bced-c5ec0fb7b94f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:34:11 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-f072ffcd-a610-4bdb-bd30-305b26e6a795 tempest-VolumesTestJSON-1979632273 None] Volume cea26553-21b6-4b6d-ba2f-e46c6b6af2ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cea26553-21b6-4b6d-ba2f-e46c6b6af2ee', 'volume_size': 1} Sep 18 21:34:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-f072ffcd-a610-4bdb-bd30-305b26e6a795 tempest-VolumesTestJSON-1979632273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:34:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-f072ffcd-a610-4bdb-bd30-305b26e6a795 tempest-VolumesTestJSON-1979632273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:34:11 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-f072ffcd-a610-4bdb-bd30-305b26e6a795 tempest-VolumesTestJSON-1979632273 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:34:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-46421206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cea26553-21b6-4b6d-ba2f-e46c6b6af2ee,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='be0b026ffff8489ca86a3b7e5fad2d5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:34:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:34:11Z,use_quota=True,user_id='a75334e579eb46bba779f4f0b48561a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:34:11 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-f072ffcd-a610-4bdb-bd30-305b26e6a795 tempest-VolumesTestJSON-1979632273 None] Creating volume cea26553-21b6-4b6d-ba2f-e46c6b6af2ee {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:34:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-f072ffcd-a610-4bdb-bd30-305b26e6a795 tempest-VolumesTestJSON-1979632273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:34:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-f072ffcd-a610-4bdb-bd30-305b26e6a795 tempest-VolumesTestJSON-1979632273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:34:11 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-f072ffcd-a610-4bdb-bd30-305b26e6a795 tempest-VolumesTestJSON-1979632273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:34:11 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-f072ffcd-a610-4bdb-bd30-305b26e6a795 tempest-VolumesTestJSON-1979632273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:34:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-f072ffcd-a610-4bdb-bd30-305b26e6a795 tempest-VolumesTestJSON-1979632273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:34:11 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-f072ffcd-a610-4bdb-bd30-305b26e6a795 tempest-VolumesTestJSON-1979632273 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:34:11 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-f072ffcd-a610-4bdb-bd30-305b26e6a795 tempest-VolumesTestJSON-1979632273 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:34:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f072ffcd-a610-4bdb-bd30-305b26e6a795 tempest-VolumesTestJSON-1979632273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-cea26553-21b6-4b6d-ba2f-e46c6b6af2ee 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:34:11 devstack sudo[88162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-cea26553-21b6-4b6d-ba2f-e46c6b6af2ee 1073741824 Sep 18 21:34:11 devstack sudo[88162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:34:11 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-f187f75c-2108-428e-ae16-78092ebd79c3 tempest-TaggedAttachmentsTest-481802302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:34:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f187f75c-2108-428e-ae16-78092ebd79c3 tempest-TaggedAttachmentsTest-481802302 None] Flow 'volume_create_manager' (c7e0c31f-703d-485a-968d-6b678dc332e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:34:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f187f75c-2108-428e-ae16-78092ebd79c3 tempest-TaggedAttachmentsTest-481802302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (862ac359-7032-4813-8dba-178b2f282ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:34:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f187f75c-2108-428e-ae16-78092ebd79c3 tempest-TaggedAttachmentsTest-481802302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (862ac359-7032-4813-8dba-178b2f282ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:34:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-995400133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e6c96a3-617c-46b8-a151-e42ac1bf7916,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d69748e58d24f7692b502805e09f5f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:34:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:34:11Z,use_quota=True,user_id='e444537ae32946daba969a444709a9a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:34:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f187f75c-2108-428e-ae16-78092ebd79c3 tempest-TaggedAttachmentsTest-481802302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95123e59-4077-4272-aa6c-a2dc126dfe33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:34:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f187f75c-2108-428e-ae16-78092ebd79c3 tempest-TaggedAttachmentsTest-481802302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95123e59-4077-4272-aa6c-a2dc126dfe33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:34:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f187f75c-2108-428e-ae16-78092ebd79c3 tempest-TaggedAttachmentsTest-481802302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c46315e-d215-40ba-ae1a-7bcb81a61fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:34:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f187f75c-2108-428e-ae16-78092ebd79c3 tempest-TaggedAttachmentsTest-481802302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c46315e-d215-40ba-ae1a-7bcb81a61fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e6c96a3-617c-46b8-a151-e42ac1bf7916', 'volume_name': 'volume-9e6c96a3-617c-46b8-a151-e42ac1bf7916', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:34:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f187f75c-2108-428e-ae16-78092ebd79c3 tempest-TaggedAttachmentsTest-481802302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f018644-2b8f-4c44-9332-3a4c91febe21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:34:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f187f75c-2108-428e-ae16-78092ebd79c3 tempest-TaggedAttachmentsTest-481802302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f018644-2b8f-4c44-9332-3a4c91febe21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:34:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f187f75c-2108-428e-ae16-78092ebd79c3 tempest-TaggedAttachmentsTest-481802302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e32e66e-e1cd-40f5-9d0a-98a0e0030543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:34:11 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-f187f75c-2108-428e-ae16-78092ebd79c3 tempest-TaggedAttachmentsTest-481802302 None] Volume 9e6c96a3-617c-46b8-a151-e42ac1bf7916: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e6c96a3-617c-46b8-a151-e42ac1bf7916', 'volume_size': 1} Sep 18 21:34:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-f187f75c-2108-428e-ae16-78092ebd79c3 tempest-TaggedAttachmentsTest-481802302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:34:11 devstack sudo[88162]: pam_unix(sudo:session): session closed for user root Sep 18 21:34:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f072ffcd-a610-4bdb-bd30-305b26e6a795 tempest-VolumesTestJSON-1979632273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-cea26553-21b6-4b6d-ba2f-e46c6b6af2ee 1073741824" returned: 0 in 0.580s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:34:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f072ffcd-a610-4bdb-bd30-305b26e6a795 tempest-VolumesTestJSON-1979632273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-cea26553-21b6-4b6d-ba2f-e46c6b6af2ee {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:34:11 devstack sudo[88170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-cea26553-21b6-4b6d-ba2f-e46c6b6af2ee Sep 18 21:34:11 devstack sudo[88170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:34:12 devstack sudo[88170]: pam_unix(sudo:session): session closed for user root Sep 18 21:34:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f072ffcd-a610-4bdb-bd30-305b26e6a795 tempest-VolumesTestJSON-1979632273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-cea26553-21b6-4b6d-ba2f-e46c6b6af2ee" returned: 0 in 0.281s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:34:12 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-f072ffcd-a610-4bdb-bd30-305b26e6a795 tempest-VolumesTestJSON-1979632273 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:34:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-f072ffcd-a610-4bdb-bd30-305b26e6a795 tempest-VolumesTestJSON-1979632273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:34:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-f187f75c-2108-428e-ae16-78092ebd79c3 tempest-TaggedAttachmentsTest-481802302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.396s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:34:12 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-f187f75c-2108-428e-ae16-78092ebd79c3 tempest-TaggedAttachmentsTest-481802302 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:34:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-995400133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e6c96a3-617c-46b8-a151-e42ac1bf7916,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d69748e58d24f7692b502805e09f5f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:34:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:34:11Z,use_quota=True,user_id='e444537ae32946daba969a444709a9a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:34:12 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-f187f75c-2108-428e-ae16-78092ebd79c3 tempest-TaggedAttachmentsTest-481802302 None] Creating volume 9e6c96a3-617c-46b8-a151-e42ac1bf7916 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:34:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-f187f75c-2108-428e-ae16-78092ebd79c3 tempest-TaggedAttachmentsTest-481802302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:34:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-f187f75c-2108-428e-ae16-78092ebd79c3 tempest-TaggedAttachmentsTest-481802302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:34:12 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-f187f75c-2108-428e-ae16-78092ebd79c3 tempest-TaggedAttachmentsTest-481802302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:34:12 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-f187f75c-2108-428e-ae16-78092ebd79c3 tempest-TaggedAttachmentsTest-481802302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:34:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-f187f75c-2108-428e-ae16-78092ebd79c3 tempest-TaggedAttachmentsTest-481802302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:34:12 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-f187f75c-2108-428e-ae16-78092ebd79c3 tempest-TaggedAttachmentsTest-481802302 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:34:12 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-f187f75c-2108-428e-ae16-78092ebd79c3 tempest-TaggedAttachmentsTest-481802302 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:34:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f187f75c-2108-428e-ae16-78092ebd79c3 tempest-TaggedAttachmentsTest-481802302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9e6c96a3-617c-46b8-a151-e42ac1bf7916 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:34:12 devstack sudo[88173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9e6c96a3-617c-46b8-a151-e42ac1bf7916 1073741824 Sep 18 21:34:12 devstack sudo[88173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:34:12 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f072ffcd-a610-4bdb-bd30-305b26e6a795 tempest-VolumesTestJSON-1979632273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7096cb4e-914e-4b9c-bced-c5ec0fb7b94f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cea26553-21b6-4b6d-ba2f-e46c6b6af2ee', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:34:12 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f072ffcd-a610-4bdb-bd30-305b26e6a795 tempest-VolumesTestJSON-1979632273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ee6fb4a-ee9a-4640-bf73-ea72a46d6128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:34:12 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-f072ffcd-a610-4bdb-bd30-305b26e6a795 tempest-VolumesTestJSON-1979632273 None] Volume volume-cea26553-21b6-4b6d-ba2f-e46c6b6af2ee (cea26553-21b6-4b6d-ba2f-e46c6b6af2ee): created successfully Sep 18 21:34:12 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f072ffcd-a610-4bdb-bd30-305b26e6a795 tempest-VolumesTestJSON-1979632273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ee6fb4a-ee9a-4640-bf73-ea72a46d6128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:34:12 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f072ffcd-a610-4bdb-bd30-305b26e6a795 tempest-VolumesTestJSON-1979632273 None] Flow 'volume_create_manager' (45a9b706-d8f1-420c-b08e-c57694d6cc86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:34:12 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-f072ffcd-a610-4bdb-bd30-305b26e6a795 tempest-VolumesTestJSON-1979632273 None] Created volume successfully. Sep 18 21:34:12 devstack sudo[88173]: pam_unix(sudo:session): session closed for user root Sep 18 21:34:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f187f75c-2108-428e-ae16-78092ebd79c3 tempest-TaggedAttachmentsTest-481802302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9e6c96a3-617c-46b8-a151-e42ac1bf7916 1073741824" returned: 0 in 0.607s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:34:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f187f75c-2108-428e-ae16-78092ebd79c3 tempest-TaggedAttachmentsTest-481802302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9e6c96a3-617c-46b8-a151-e42ac1bf7916 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:34:12 devstack sudo[88181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9e6c96a3-617c-46b8-a151-e42ac1bf7916 Sep 18 21:34:12 devstack sudo[88181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:34:13 devstack sudo[88181]: pam_unix(sudo:session): session closed for user root Sep 18 21:34:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f187f75c-2108-428e-ae16-78092ebd79c3 tempest-TaggedAttachmentsTest-481802302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9e6c96a3-617c-46b8-a151-e42ac1bf7916" returned: 0 in 0.392s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:34:13 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-f187f75c-2108-428e-ae16-78092ebd79c3 tempest-TaggedAttachmentsTest-481802302 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:34:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-f187f75c-2108-428e-ae16-78092ebd79c3 tempest-TaggedAttachmentsTest-481802302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:34:13 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f187f75c-2108-428e-ae16-78092ebd79c3 tempest-TaggedAttachmentsTest-481802302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e32e66e-e1cd-40f5-9d0a-98a0e0030543) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e6c96a3-617c-46b8-a151-e42ac1bf7916', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:34:13 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f187f75c-2108-428e-ae16-78092ebd79c3 tempest-TaggedAttachmentsTest-481802302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7bb5012-d564-47bb-a169-f1f001bd0758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:34:13 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-f187f75c-2108-428e-ae16-78092ebd79c3 tempest-TaggedAttachmentsTest-481802302 None] Volume volume-9e6c96a3-617c-46b8-a151-e42ac1bf7916 (9e6c96a3-617c-46b8-a151-e42ac1bf7916): created successfully Sep 18 21:34:13 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f187f75c-2108-428e-ae16-78092ebd79c3 tempest-TaggedAttachmentsTest-481802302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7bb5012-d564-47bb-a169-f1f001bd0758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:34:13 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f187f75c-2108-428e-ae16-78092ebd79c3 tempest-TaggedAttachmentsTest-481802302 None] Flow 'volume_create_manager' (c7e0c31f-703d-485a-968d-6b678dc332e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:34:13 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-f187f75c-2108-428e-ae16-78092ebd79c3 tempest-TaggedAttachmentsTest-481802302 None] Created volume successfully. Sep 18 21:34:13 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-421aeff4-6587-4100-a7e6-d701e373ac89 tempest-VolumesTestJSON-1979632273 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:34:13 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-421aeff4-6587-4100-a7e6-d701e373ac89 tempest-VolumesTestJSON-1979632273 None] Flow 'volume_create_manager' (2a5e91f8-27e4-4966-a97d-f56a4a3408d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:34:13 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-421aeff4-6587-4100-a7e6-d701e373ac89 tempest-VolumesTestJSON-1979632273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a918c63-b792-42f6-82de-4ddbcf026ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:34:13 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-421aeff4-6587-4100-a7e6-d701e373ac89 tempest-VolumesTestJSON-1979632273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a918c63-b792-42f6-82de-4ddbcf026ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:34:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-103357746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1a632d9-351a-4ac8-8a96-8deccb17fb19,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='be0b026ffff8489ca86a3b7e5fad2d5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:34:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:34:14Z,use_quota=True,user_id='a75334e579eb46bba779f4f0b48561a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:34:13 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-421aeff4-6587-4100-a7e6-d701e373ac89 tempest-VolumesTestJSON-1979632273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f247615-8bfb-44fa-85a1-48b1d303ca95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:34:13 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-421aeff4-6587-4100-a7e6-d701e373ac89 tempest-VolumesTestJSON-1979632273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f247615-8bfb-44fa-85a1-48b1d303ca95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:34:13 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-421aeff4-6587-4100-a7e6-d701e373ac89 tempest-VolumesTestJSON-1979632273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff40d6ca-9ced-4f66-b9ca-36e513468452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:34:13 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-421aeff4-6587-4100-a7e6-d701e373ac89 tempest-VolumesTestJSON-1979632273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff40d6ca-9ced-4f66-b9ca-36e513468452) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1a632d9-351a-4ac8-8a96-8deccb17fb19', 'volume_name': 'volume-c1a632d9-351a-4ac8-8a96-8deccb17fb19', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:34:13 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-421aeff4-6587-4100-a7e6-d701e373ac89 tempest-VolumesTestJSON-1979632273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87497fd9-8e70-43d2-b25a-df81105aade9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:34:13 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-421aeff4-6587-4100-a7e6-d701e373ac89 tempest-VolumesTestJSON-1979632273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87497fd9-8e70-43d2-b25a-df81105aade9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:34:13 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-421aeff4-6587-4100-a7e6-d701e373ac89 tempest-VolumesTestJSON-1979632273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6c6ef63-5944-418b-b443-d4c71fdf4998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:34:13 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-421aeff4-6587-4100-a7e6-d701e373ac89 tempest-VolumesTestJSON-1979632273 None] Volume c1a632d9-351a-4ac8-8a96-8deccb17fb19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1a632d9-351a-4ac8-8a96-8deccb17fb19', 'volume_size': 1} Sep 18 21:34:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-421aeff4-6587-4100-a7e6-d701e373ac89 tempest-VolumesTestJSON-1979632273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:34:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-421aeff4-6587-4100-a7e6-d701e373ac89 tempest-VolumesTestJSON-1979632273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:34:13 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-421aeff4-6587-4100-a7e6-d701e373ac89 tempest-VolumesTestJSON-1979632273 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:34:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-103357746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1a632d9-351a-4ac8-8a96-8deccb17fb19,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='be0b026ffff8489ca86a3b7e5fad2d5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:34:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:34:14Z,use_quota=True,user_id='a75334e579eb46bba779f4f0b48561a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:34:13 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-421aeff4-6587-4100-a7e6-d701e373ac89 tempest-VolumesTestJSON-1979632273 None] Creating volume c1a632d9-351a-4ac8-8a96-8deccb17fb19 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:34:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-421aeff4-6587-4100-a7e6-d701e373ac89 tempest-VolumesTestJSON-1979632273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:34:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-421aeff4-6587-4100-a7e6-d701e373ac89 tempest-VolumesTestJSON-1979632273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:34:13 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-421aeff4-6587-4100-a7e6-d701e373ac89 tempest-VolumesTestJSON-1979632273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:34:13 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-421aeff4-6587-4100-a7e6-d701e373ac89 tempest-VolumesTestJSON-1979632273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:34:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-421aeff4-6587-4100-a7e6-d701e373ac89 tempest-VolumesTestJSON-1979632273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:34:13 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-421aeff4-6587-4100-a7e6-d701e373ac89 tempest-VolumesTestJSON-1979632273 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:34:13 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-421aeff4-6587-4100-a7e6-d701e373ac89 tempest-VolumesTestJSON-1979632273 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:34:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-421aeff4-6587-4100-a7e6-d701e373ac89 tempest-VolumesTestJSON-1979632273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c1a632d9-351a-4ac8-8a96-8deccb17fb19 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:34:14 devstack sudo[88200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c1a632d9-351a-4ac8-8a96-8deccb17fb19 1073741824 Sep 18 21:34:14 devstack sudo[88200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:34:14 devstack sudo[88200]: pam_unix(sudo:session): session closed for user root Sep 18 21:34:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-421aeff4-6587-4100-a7e6-d701e373ac89 tempest-VolumesTestJSON-1979632273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c1a632d9-351a-4ac8-8a96-8deccb17fb19 1073741824" returned: 0 in 0.503s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:34:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-421aeff4-6587-4100-a7e6-d701e373ac89 tempest-VolumesTestJSON-1979632273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c1a632d9-351a-4ac8-8a96-8deccb17fb19 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:34:14 devstack sudo[88206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c1a632d9-351a-4ac8-8a96-8deccb17fb19 Sep 18 21:34:14 devstack sudo[88206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:34:14 devstack sudo[88206]: pam_unix(sudo:session): session closed for user root Sep 18 21:34:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-421aeff4-6587-4100-a7e6-d701e373ac89 tempest-VolumesTestJSON-1979632273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c1a632d9-351a-4ac8-8a96-8deccb17fb19" returned: 0 in 0.259s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:34:14 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-421aeff4-6587-4100-a7e6-d701e373ac89 tempest-VolumesTestJSON-1979632273 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:34:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-421aeff4-6587-4100-a7e6-d701e373ac89 tempest-VolumesTestJSON-1979632273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:34:14 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-421aeff4-6587-4100-a7e6-d701e373ac89 tempest-VolumesTestJSON-1979632273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6c6ef63-5944-418b-b443-d4c71fdf4998) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1a632d9-351a-4ac8-8a96-8deccb17fb19', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:34:14 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-421aeff4-6587-4100-a7e6-d701e373ac89 tempest-VolumesTestJSON-1979632273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e66295d-e0df-44e5-b01d-75452eb8ab27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:34:14 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-421aeff4-6587-4100-a7e6-d701e373ac89 tempest-VolumesTestJSON-1979632273 None] Volume volume-c1a632d9-351a-4ac8-8a96-8deccb17fb19 (c1a632d9-351a-4ac8-8a96-8deccb17fb19): created successfully Sep 18 21:34:14 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-421aeff4-6587-4100-a7e6-d701e373ac89 tempest-VolumesTestJSON-1979632273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e66295d-e0df-44e5-b01d-75452eb8ab27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:34:14 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-421aeff4-6587-4100-a7e6-d701e373ac89 tempest-VolumesTestJSON-1979632273 None] Flow 'volume_create_manager' (2a5e91f8-27e4-4966-a97d-f56a4a3408d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:34:14 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-421aeff4-6587-4100-a7e6-d701e373ac89 tempest-VolumesTestJSON-1979632273 None] Created volume successfully. Sep 18 21:34:16 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-062f0539-d420-4a7b-82bc-65137ad587c6 tempest-VolumesTestJSON-1979632273 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:34:16 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-062f0539-d420-4a7b-82bc-65137ad587c6 tempest-VolumesTestJSON-1979632273 None] Flow 'volume_create_manager' (b75edb49-0197-42e0-869c-2eec14cbd6ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:34:16 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-062f0539-d420-4a7b-82bc-65137ad587c6 tempest-VolumesTestJSON-1979632273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f0385d2-27f5-44ce-b604-ba252423ce78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:34:16 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-062f0539-d420-4a7b-82bc-65137ad587c6 tempest-VolumesTestJSON-1979632273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f0385d2-27f5-44ce-b604-ba252423ce78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:34:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1304590422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f1f6228-d76e-48f6-a7aa-b939f17344db,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='be0b026ffff8489ca86a3b7e5fad2d5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:34:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:34:16Z,use_quota=True,user_id='a75334e579eb46bba779f4f0b48561a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:34:16 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-062f0539-d420-4a7b-82bc-65137ad587c6 tempest-VolumesTestJSON-1979632273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2126f885-8e58-4682-94b1-9ea6b55c4461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:34:16 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-062f0539-d420-4a7b-82bc-65137ad587c6 tempest-VolumesTestJSON-1979632273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2126f885-8e58-4682-94b1-9ea6b55c4461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:34:16 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-062f0539-d420-4a7b-82bc-65137ad587c6 tempest-VolumesTestJSON-1979632273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a7b30ae-530c-4a18-af38-f36474231b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:34:16 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-062f0539-d420-4a7b-82bc-65137ad587c6 tempest-VolumesTestJSON-1979632273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a7b30ae-530c-4a18-af38-f36474231b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f1f6228-d76e-48f6-a7aa-b939f17344db', 'volume_name': 'volume-2f1f6228-d76e-48f6-a7aa-b939f17344db', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:34:16 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-062f0539-d420-4a7b-82bc-65137ad587c6 tempest-VolumesTestJSON-1979632273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (364446a8-5c32-47f4-a92e-54dfb3d93550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:34:16 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-062f0539-d420-4a7b-82bc-65137ad587c6 tempest-VolumesTestJSON-1979632273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (364446a8-5c32-47f4-a92e-54dfb3d93550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:34:16 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-062f0539-d420-4a7b-82bc-65137ad587c6 tempest-VolumesTestJSON-1979632273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb09fe76-3368-48b3-9950-d8d6a1ac2db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:34:16 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-062f0539-d420-4a7b-82bc-65137ad587c6 tempest-VolumesTestJSON-1979632273 None] Volume 2f1f6228-d76e-48f6-a7aa-b939f17344db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f1f6228-d76e-48f6-a7aa-b939f17344db', 'volume_size': 1} Sep 18 21:34:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-062f0539-d420-4a7b-82bc-65137ad587c6 tempest-VolumesTestJSON-1979632273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:34:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-062f0539-d420-4a7b-82bc-65137ad587c6 tempest-VolumesTestJSON-1979632273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:34:16 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-062f0539-d420-4a7b-82bc-65137ad587c6 tempest-VolumesTestJSON-1979632273 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:34:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1304590422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f1f6228-d76e-48f6-a7aa-b939f17344db,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='be0b026ffff8489ca86a3b7e5fad2d5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:34:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:34:16Z,use_quota=True,user_id='a75334e579eb46bba779f4f0b48561a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:34:16 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-062f0539-d420-4a7b-82bc-65137ad587c6 tempest-VolumesTestJSON-1979632273 None] Creating volume 2f1f6228-d76e-48f6-a7aa-b939f17344db {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:34:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-062f0539-d420-4a7b-82bc-65137ad587c6 tempest-VolumesTestJSON-1979632273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:34:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-062f0539-d420-4a7b-82bc-65137ad587c6 tempest-VolumesTestJSON-1979632273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:34:16 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-062f0539-d420-4a7b-82bc-65137ad587c6 tempest-VolumesTestJSON-1979632273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:34:16 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-062f0539-d420-4a7b-82bc-65137ad587c6 tempest-VolumesTestJSON-1979632273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:34:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-062f0539-d420-4a7b-82bc-65137ad587c6 tempest-VolumesTestJSON-1979632273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:34:16 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-062f0539-d420-4a7b-82bc-65137ad587c6 tempest-VolumesTestJSON-1979632273 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:34:16 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-062f0539-d420-4a7b-82bc-65137ad587c6 tempest-VolumesTestJSON-1979632273 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:34:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-062f0539-d420-4a7b-82bc-65137ad587c6 tempest-VolumesTestJSON-1979632273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2f1f6228-d76e-48f6-a7aa-b939f17344db 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:34:16 devstack sudo[88212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2f1f6228-d76e-48f6-a7aa-b939f17344db 1073741824 Sep 18 21:34:16 devstack sudo[88212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:34:17 devstack sudo[88212]: pam_unix(sudo:session): session closed for user root Sep 18 21:34:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-062f0539-d420-4a7b-82bc-65137ad587c6 tempest-VolumesTestJSON-1979632273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2f1f6228-d76e-48f6-a7aa-b939f17344db 1073741824" returned: 0 in 0.526s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:34:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-062f0539-d420-4a7b-82bc-65137ad587c6 tempest-VolumesTestJSON-1979632273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2f1f6228-d76e-48f6-a7aa-b939f17344db {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:34:17 devstack sudo[88218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2f1f6228-d76e-48f6-a7aa-b939f17344db Sep 18 21:34:17 devstack sudo[88218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:34:17 devstack sudo[88218]: pam_unix(sudo:session): session closed for user root Sep 18 21:34:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-062f0539-d420-4a7b-82bc-65137ad587c6 tempest-VolumesTestJSON-1979632273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2f1f6228-d76e-48f6-a7aa-b939f17344db" returned: 0 in 0.419s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:34:17 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-062f0539-d420-4a7b-82bc-65137ad587c6 tempest-VolumesTestJSON-1979632273 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:34:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-062f0539-d420-4a7b-82bc-65137ad587c6 tempest-VolumesTestJSON-1979632273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:34:17 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-062f0539-d420-4a7b-82bc-65137ad587c6 tempest-VolumesTestJSON-1979632273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb09fe76-3368-48b3-9950-d8d6a1ac2db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f1f6228-d76e-48f6-a7aa-b939f17344db', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:34:17 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-062f0539-d420-4a7b-82bc-65137ad587c6 tempest-VolumesTestJSON-1979632273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (568f3dc4-560a-4b13-bcb4-e87bb654a1f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:34:17 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-062f0539-d420-4a7b-82bc-65137ad587c6 tempest-VolumesTestJSON-1979632273 None] Volume volume-2f1f6228-d76e-48f6-a7aa-b939f17344db (2f1f6228-d76e-48f6-a7aa-b939f17344db): created successfully Sep 18 21:34:17 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-062f0539-d420-4a7b-82bc-65137ad587c6 tempest-VolumesTestJSON-1979632273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (568f3dc4-560a-4b13-bcb4-e87bb654a1f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:34:17 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-062f0539-d420-4a7b-82bc-65137ad587c6 tempest-VolumesTestJSON-1979632273 None] Flow 'volume_create_manager' (b75edb49-0197-42e0-869c-2eec14cbd6ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:34:17 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-062f0539-d420-4a7b-82bc-65137ad587c6 tempest-VolumesTestJSON-1979632273 None] Created volume successfully. Sep 18 21:34:22 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-ba55a22e-88fe-44cd-9ee3-7adadebc05ff tempest-VolumesTestJSON-1979632273 None] Acquiring lock "cinder-2f1f6228-d76e-48f6-a7aa-b939f17344db-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:34:22 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-ba55a22e-88fe-44cd-9ee3-7adadebc05ff tempest-VolumesTestJSON-1979632273 None] Lock "cinder-2f1f6228-d76e-48f6-a7aa-b939f17344db-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:34:22 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-ba55a22e-88fe-44cd-9ee3-7adadebc05ff tempest-VolumesTestJSON-1979632273 None] Acquiring lock "cinder-quobyte-2f1f6228-d76e-48f6-a7aa-b939f17344db" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:34:22 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-ba55a22e-88fe-44cd-9ee3-7adadebc05ff tempest-VolumesTestJSON-1979632273 None] Lock "cinder-quobyte-2f1f6228-d76e-48f6-a7aa-b939f17344db" acquired by "delete_volume" :: waited 0.019s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:34:22 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c562ee-01e9-431c-9c2d-e9b0ffec8030]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:34:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ba55a22e-88fe-44cd-9ee3-7adadebc05ff tempest-VolumesTestJSON-1979632273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2f1f6228-d76e-48f6-a7aa-b939f17344db {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:34:22 devstack sudo[88296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2f1f6228-d76e-48f6-a7aa-b939f17344db Sep 18 21:34:22 devstack sudo[88296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:34:23 devstack sudo[88296]: pam_unix(sudo:session): session closed for user root Sep 18 21:34:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ba55a22e-88fe-44cd-9ee3-7adadebc05ff tempest-VolumesTestJSON-1979632273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2f1f6228-d76e-48f6-a7aa-b939f17344db" returned: 0 in 0.700s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:34:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ba55a22e-88fe-44cd-9ee3-7adadebc05ff tempest-VolumesTestJSON-1979632273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2f1f6228-d76e-48f6-a7aa-b939f17344db {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:34:23 devstack sudo[88308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2f1f6228-d76e-48f6-a7aa-b939f17344db Sep 18 21:34:23 devstack sudo[88308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:34:23 devstack sudo[88308]: pam_unix(sudo:session): session closed for user root Sep 18 21:34:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ba55a22e-88fe-44cd-9ee3-7adadebc05ff tempest-VolumesTestJSON-1979632273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2f1f6228-d76e-48f6-a7aa-b939f17344db" returned: 0 in 0.527s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:34:23 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-ba55a22e-88fe-44cd-9ee3-7adadebc05ff tempest-VolumesTestJSON-1979632273 None] Lock "cinder-quobyte-2f1f6228-d76e-48f6-a7aa-b939f17344db" released by "delete_volume" :: held 1.335s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:34:24 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-ba55a22e-88fe-44cd-9ee3-7adadebc05ff tempest-VolumesTestJSON-1979632273 None] Created reservations ['c59ed529-2e0e-4e2a-9c9d-5a464f809a55', '621bc329-0904-4c96-9fd5-cc255ef67478', '6cfc8592-5679-48e5-8063-26f178eaf916', '95b4c0f8-f4bb-47f8-8505-bf8545c4cffd'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:34:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-ba55a22e-88fe-44cd-9ee3-7adadebc05ff tempest-VolumesTestJSON-1979632273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:34:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-ba55a22e-88fe-44cd-9ee3-7adadebc05ff tempest-VolumesTestJSON-1979632273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:34:24 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-ba55a22e-88fe-44cd-9ee3-7adadebc05ff tempest-VolumesTestJSON-1979632273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:34:24 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-ba55a22e-88fe-44cd-9ee3-7adadebc05ff tempest-VolumesTestJSON-1979632273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:34:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-ba55a22e-88fe-44cd-9ee3-7adadebc05ff tempest-VolumesTestJSON-1979632273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:34:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ba55a22e-88fe-44cd-9ee3-7adadebc05ff tempest-VolumesTestJSON-1979632273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:34:24 devstack sudo[88320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:34:24 devstack sudo[88320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:34:24 devstack sudo[88320]: pam_unix(sudo:session): session closed for user root Sep 18 21:34:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ba55a22e-88fe-44cd-9ee3-7adadebc05ff tempest-VolumesTestJSON-1979632273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.378s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:34:24 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-ba55a22e-88fe-44cd-9ee3-7adadebc05ff tempest-VolumesTestJSON-1979632273 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:34:24 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-ba55a22e-88fe-44cd-9ee3-7adadebc05ff tempest-VolumesTestJSON-1979632273 None] Deleted volume successfully. Sep 18 21:34:24 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-ba55a22e-88fe-44cd-9ee3-7adadebc05ff tempest-VolumesTestJSON-1979632273 None] Lock "cinder-2f1f6228-d76e-48f6-a7aa-b939f17344db-delete_volume" released by "delete_volume" :: held 2.121s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:34:24 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d3bb2652-9739-47af-b7ca-8a7882627c9d tempest-VolumesTestJSON-1979632273 None] Acquiring lock "cinder-c1a632d9-351a-4ac8-8a96-8deccb17fb19-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:34:24 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d3bb2652-9739-47af-b7ca-8a7882627c9d tempest-VolumesTestJSON-1979632273 None] Lock "cinder-c1a632d9-351a-4ac8-8a96-8deccb17fb19-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:34:25 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d3bb2652-9739-47af-b7ca-8a7882627c9d tempest-VolumesTestJSON-1979632273 None] Acquiring lock "cinder-quobyte-c1a632d9-351a-4ac8-8a96-8deccb17fb19" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:34:25 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d3bb2652-9739-47af-b7ca-8a7882627c9d tempest-VolumesTestJSON-1979632273 None] Lock "cinder-quobyte-c1a632d9-351a-4ac8-8a96-8deccb17fb19" acquired by "delete_volume" :: waited 0.027s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:34:25 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[774337d5-b480-4555-8059-9d5b054228e8]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:34:25 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d3bb2652-9739-47af-b7ca-8a7882627c9d tempest-VolumesTestJSON-1979632273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c1a632d9-351a-4ac8-8a96-8deccb17fb19 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:34:25 devstack sudo[88324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c1a632d9-351a-4ac8-8a96-8deccb17fb19 Sep 18 21:34:25 devstack sudo[88324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:34:25 devstack sudo[88324]: pam_unix(sudo:session): session closed for user root Sep 18 21:34:25 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d3bb2652-9739-47af-b7ca-8a7882627c9d tempest-VolumesTestJSON-1979632273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c1a632d9-351a-4ac8-8a96-8deccb17fb19" returned: 0 in 0.708s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:34:25 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d3bb2652-9739-47af-b7ca-8a7882627c9d tempest-VolumesTestJSON-1979632273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c1a632d9-351a-4ac8-8a96-8deccb17fb19 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:34:25 devstack sudo[88335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c1a632d9-351a-4ac8-8a96-8deccb17fb19 Sep 18 21:34:25 devstack sudo[88335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:34:26 devstack sudo[88335]: pam_unix(sudo:session): session closed for user root Sep 18 21:34:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d3bb2652-9739-47af-b7ca-8a7882627c9d tempest-VolumesTestJSON-1979632273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c1a632d9-351a-4ac8-8a96-8deccb17fb19" returned: 0 in 0.405s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:34:26 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d3bb2652-9739-47af-b7ca-8a7882627c9d tempest-VolumesTestJSON-1979632273 None] Lock "cinder-quobyte-c1a632d9-351a-4ac8-8a96-8deccb17fb19" released by "delete_volume" :: held 1.183s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:34:26 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-d3bb2652-9739-47af-b7ca-8a7882627c9d tempest-VolumesTestJSON-1979632273 None] Created reservations ['f8c50192-982b-46a3-801c-9feca5a70cfb', '7ac6857e-597f-4100-8a4c-1a061a65b9a0', '345bc772-e246-4525-b4cf-cd5a97d704bc', '569c1dfa-849c-490c-b750-de3fd83ec88a'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:34:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-d3bb2652-9739-47af-b7ca-8a7882627c9d tempest-VolumesTestJSON-1979632273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:34:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-d3bb2652-9739-47af-b7ca-8a7882627c9d tempest-VolumesTestJSON-1979632273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:34:26 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-d3bb2652-9739-47af-b7ca-8a7882627c9d tempest-VolumesTestJSON-1979632273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:34:26 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-d3bb2652-9739-47af-b7ca-8a7882627c9d tempest-VolumesTestJSON-1979632273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:34:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-d3bb2652-9739-47af-b7ca-8a7882627c9d tempest-VolumesTestJSON-1979632273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:34:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d3bb2652-9739-47af-b7ca-8a7882627c9d tempest-VolumesTestJSON-1979632273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:34:26 devstack sudo[88338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:34:26 devstack sudo[88338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:34:26 devstack sudo[88338]: pam_unix(sudo:session): session closed for user root Sep 18 21:34:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d3bb2652-9739-47af-b7ca-8a7882627c9d tempest-VolumesTestJSON-1979632273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.349s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:34:26 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-d3bb2652-9739-47af-b7ca-8a7882627c9d tempest-VolumesTestJSON-1979632273 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:34:26 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-d3bb2652-9739-47af-b7ca-8a7882627c9d tempest-VolumesTestJSON-1979632273 None] Deleted volume successfully. Sep 18 21:34:26 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d3bb2652-9739-47af-b7ca-8a7882627c9d tempest-VolumesTestJSON-1979632273 None] Lock "cinder-c1a632d9-351a-4ac8-8a96-8deccb17fb19-delete_volume" released by "delete_volume" :: held 1.918s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:34:27 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-e629d159-98e8-43ea-8d63-7575511b9d20 tempest-VolumesTestJSON-1979632273 None] Acquiring lock "cinder-cea26553-21b6-4b6d-ba2f-e46c6b6af2ee-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:34:27 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-e629d159-98e8-43ea-8d63-7575511b9d20 tempest-VolumesTestJSON-1979632273 None] Lock "cinder-cea26553-21b6-4b6d-ba2f-e46c6b6af2ee-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:34:27 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-e629d159-98e8-43ea-8d63-7575511b9d20 tempest-VolumesTestJSON-1979632273 None] Acquiring lock "cinder-quobyte-cea26553-21b6-4b6d-ba2f-e46c6b6af2ee" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:34:27 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-e629d159-98e8-43ea-8d63-7575511b9d20 tempest-VolumesTestJSON-1979632273 None] Lock "cinder-quobyte-cea26553-21b6-4b6d-ba2f-e46c6b6af2ee" acquired by "delete_volume" :: waited 0.026s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:34:27 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[56096736-f3a9-4d38-b41e-5aa5d8975911]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:34:27 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e629d159-98e8-43ea-8d63-7575511b9d20 tempest-VolumesTestJSON-1979632273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-cea26553-21b6-4b6d-ba2f-e46c6b6af2ee {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:34:27 devstack sudo[88343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-cea26553-21b6-4b6d-ba2f-e46c6b6af2ee Sep 18 21:34:27 devstack sudo[88343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:34:28 devstack sudo[88343]: pam_unix(sudo:session): session closed for user root Sep 18 21:34:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e629d159-98e8-43ea-8d63-7575511b9d20 tempest-VolumesTestJSON-1979632273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-cea26553-21b6-4b6d-ba2f-e46c6b6af2ee" returned: 0 in 0.553s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:34:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e629d159-98e8-43ea-8d63-7575511b9d20 tempest-VolumesTestJSON-1979632273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-cea26553-21b6-4b6d-ba2f-e46c6b6af2ee {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:34:28 devstack sudo[88350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-cea26553-21b6-4b6d-ba2f-e46c6b6af2ee Sep 18 21:34:28 devstack sudo[88350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:34:28 devstack sudo[88350]: pam_unix(sudo:session): session closed for user root Sep 18 21:34:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e629d159-98e8-43ea-8d63-7575511b9d20 tempest-VolumesTestJSON-1979632273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-cea26553-21b6-4b6d-ba2f-e46c6b6af2ee" returned: 0 in 0.356s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:34:28 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-e629d159-98e8-43ea-8d63-7575511b9d20 tempest-VolumesTestJSON-1979632273 None] Lock "cinder-quobyte-cea26553-21b6-4b6d-ba2f-e46c6b6af2ee" released by "delete_volume" :: held 0.960s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:34:28 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-e629d159-98e8-43ea-8d63-7575511b9d20 tempest-VolumesTestJSON-1979632273 None] Created reservations ['76f5f438-bbc0-4f16-95a3-57e78cedada7', 'e0b2a620-68d4-48e0-bdb7-6b94c48bea40', '3c337eb6-24c0-4ea1-bba3-4075daca90dd', 'dfdd9b21-c991-4034-808b-0925dac21f2c'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:34:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-e629d159-98e8-43ea-8d63-7575511b9d20 tempest-VolumesTestJSON-1979632273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:34:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-e629d159-98e8-43ea-8d63-7575511b9d20 tempest-VolumesTestJSON-1979632273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:34:28 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-e629d159-98e8-43ea-8d63-7575511b9d20 tempest-VolumesTestJSON-1979632273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:34:28 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-e629d159-98e8-43ea-8d63-7575511b9d20 tempest-VolumesTestJSON-1979632273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:34:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-e629d159-98e8-43ea-8d63-7575511b9d20 tempest-VolumesTestJSON-1979632273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:34:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e629d159-98e8-43ea-8d63-7575511b9d20 tempest-VolumesTestJSON-1979632273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:34:28 devstack sudo[88353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:34:28 devstack sudo[88353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:34:29 devstack sudo[88353]: pam_unix(sudo:session): session closed for user root Sep 18 21:34:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e629d159-98e8-43ea-8d63-7575511b9d20 tempest-VolumesTestJSON-1979632273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.372s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:34:29 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-e629d159-98e8-43ea-8d63-7575511b9d20 tempest-VolumesTestJSON-1979632273 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:34:29 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-e629d159-98e8-43ea-8d63-7575511b9d20 tempest-VolumesTestJSON-1979632273 None] Deleted volume successfully. Sep 18 21:34:29 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-e629d159-98e8-43ea-8d63-7575511b9d20 tempest-VolumesTestJSON-1979632273 None] Lock "cinder-cea26553-21b6-4b6d-ba2f-e46c6b6af2ee-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:34:37 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-8a555d19-15df-46ab-a4f9-223ea0edf359 tempest-GroupsV314Test-257475026 None] Group tempest-GroupsV314Test-Group-2053187557: creating Sep 18 21:34:37 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-8a555d19-15df-46ab-a4f9-223ea0edf359 tempest-GroupsV314Test-257475026 None] Group tempest-GroupsV314Test-Group-2053187557: created successfully Sep 18 21:34:37 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-8a555d19-15df-46ab-a4f9-223ea0edf359 tempest-GroupsV314Test-257475026 None] Create group completed successfully. Sep 18 21:34:39 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-59012d5e-e74f-4674-864b-28deeef4fa8e tempest-GroupsV314Test-257475026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:34:39 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-59012d5e-e74f-4674-864b-28deeef4fa8e tempest-GroupsV314Test-257475026 None] Flow 'volume_create_manager' (558434b6-8fd8-4438-a482-4b8bdf9aa301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:34:39 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-59012d5e-e74f-4674-864b-28deeef4fa8e tempest-GroupsV314Test-257475026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35286e2a-587a-4ffe-9732-8d38a78b0206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:34:40 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-59012d5e-e74f-4674-864b-28deeef4fa8e tempest-GroupsV314Test-257475026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35286e2a-587a-4ffe-9732-8d38a78b0206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:34:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-164032318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=24149235-bf56-4c8d-bcd2-990ef1796f62,host='devstack@QuobyteHD#QuobyteHD',id=574759cc-e8b8-474f-93d8-603e04dcadf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='921809a124274f87a45bcf16a2a7d820',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:34:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:34:40Z,use_quota=True,user_id='a4fa5d01af4141b1b9e1a029e5233ce9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e7464f48-2a37-4e90-aa8d-46e7b90e244b),volume_type_id=e7464f48-2a37-4e90-aa8d-46e7b90e244b)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:34:40 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-59012d5e-e74f-4674-864b-28deeef4fa8e tempest-GroupsV314Test-257475026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8b21ace-a29a-4cfe-af48-308e906e6613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:34:40 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-59012d5e-e74f-4674-864b-28deeef4fa8e tempest-GroupsV314Test-257475026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8b21ace-a29a-4cfe-af48-308e906e6613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:34:40 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-59012d5e-e74f-4674-864b-28deeef4fa8e tempest-GroupsV314Test-257475026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0a1b72c-dc86-44c7-bb90-7c5ffe383fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:34:40 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-59012d5e-e74f-4674-864b-28deeef4fa8e tempest-GroupsV314Test-257475026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0a1b72c-dc86-44c7-bb90-7c5ffe383fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '574759cc-e8b8-474f-93d8-603e04dcadf0', 'volume_name': 'volume-574759cc-e8b8-474f-93d8-603e04dcadf0', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:34:40 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-59012d5e-e74f-4674-864b-28deeef4fa8e tempest-GroupsV314Test-257475026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c53ffa1f-d7bf-42f8-88a6-b285537ffde5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:34:40 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-59012d5e-e74f-4674-864b-28deeef4fa8e tempest-GroupsV314Test-257475026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c53ffa1f-d7bf-42f8-88a6-b285537ffde5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:34:40 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-59012d5e-e74f-4674-864b-28deeef4fa8e tempest-GroupsV314Test-257475026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfb03079-fb70-4ffd-ac55-04ced70426d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:34:40 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-59012d5e-e74f-4674-864b-28deeef4fa8e tempest-GroupsV314Test-257475026 None] Volume 574759cc-e8b8-474f-93d8-603e04dcadf0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-574759cc-e8b8-474f-93d8-603e04dcadf0', 'volume_size': 1} Sep 18 21:34:40 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-59012d5e-e74f-4674-864b-28deeef4fa8e tempest-GroupsV314Test-257475026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:34:40 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-59012d5e-e74f-4674-864b-28deeef4fa8e tempest-GroupsV314Test-257475026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:34:40 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-59012d5e-e74f-4674-864b-28deeef4fa8e tempest-GroupsV314Test-257475026 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=24149235-bf56-4c8d-bcd2-990ef1796f62,created_at=2026-09-18T19:34:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-164032318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=24149235-bf56-4c8d-bcd2-990ef1796f62,host='devstack@QuobyteHD#QuobyteHD',id=574759cc-e8b8-474f-93d8-603e04dcadf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='921809a124274f87a45bcf16a2a7d820',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:34:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:34:40Z,use_quota=True,user_id='a4fa5d01af4141b1b9e1a029e5233ce9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e7464f48-2a37-4e90-aa8d-46e7b90e244b),volume_type_id=e7464f48-2a37-4e90-aa8d-46e7b90e244b)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:34:40 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-59012d5e-e74f-4674-864b-28deeef4fa8e tempest-GroupsV314Test-257475026 None] Creating volume 574759cc-e8b8-474f-93d8-603e04dcadf0 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:34:40 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-59012d5e-e74f-4674-864b-28deeef4fa8e tempest-GroupsV314Test-257475026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:34:40 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-59012d5e-e74f-4674-864b-28deeef4fa8e tempest-GroupsV314Test-257475026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:34:40 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-59012d5e-e74f-4674-864b-28deeef4fa8e tempest-GroupsV314Test-257475026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:34:40 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-59012d5e-e74f-4674-864b-28deeef4fa8e tempest-GroupsV314Test-257475026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:34:40 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-59012d5e-e74f-4674-864b-28deeef4fa8e tempest-GroupsV314Test-257475026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:34:40 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-59012d5e-e74f-4674-864b-28deeef4fa8e tempest-GroupsV314Test-257475026 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:34:40 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-59012d5e-e74f-4674-864b-28deeef4fa8e tempest-GroupsV314Test-257475026 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:34:40 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-59012d5e-e74f-4674-864b-28deeef4fa8e tempest-GroupsV314Test-257475026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-574759cc-e8b8-474f-93d8-603e04dcadf0 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:34:40 devstack sudo[88545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-574759cc-e8b8-474f-93d8-603e04dcadf0 1073741824 Sep 18 21:34:40 devstack sudo[88545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:34:41 devstack sudo[88545]: pam_unix(sudo:session): session closed for user root Sep 18 21:34:41 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-59012d5e-e74f-4674-864b-28deeef4fa8e tempest-GroupsV314Test-257475026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-574759cc-e8b8-474f-93d8-603e04dcadf0 1073741824" returned: 0 in 1.379s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:34:41 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-59012d5e-e74f-4674-864b-28deeef4fa8e tempest-GroupsV314Test-257475026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-574759cc-e8b8-474f-93d8-603e04dcadf0 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:34:41 devstack sudo[88560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-574759cc-e8b8-474f-93d8-603e04dcadf0 Sep 18 21:34:41 devstack sudo[88560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:34:41 devstack sudo[88560]: pam_unix(sudo:session): session closed for user root Sep 18 21:34:41 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-59012d5e-e74f-4674-864b-28deeef4fa8e tempest-GroupsV314Test-257475026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-574759cc-e8b8-474f-93d8-603e04dcadf0" returned: 0 in 0.326s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:34:41 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-59012d5e-e74f-4674-864b-28deeef4fa8e tempest-GroupsV314Test-257475026 None] <== create_volume: return (1824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:34:41 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-59012d5e-e74f-4674-864b-28deeef4fa8e tempest-GroupsV314Test-257475026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.833s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:34:41 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-59012d5e-e74f-4674-864b-28deeef4fa8e tempest-GroupsV314Test-257475026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfb03079-fb70-4ffd-ac55-04ced70426d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-574759cc-e8b8-474f-93d8-603e04dcadf0', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:34:41 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-59012d5e-e74f-4674-864b-28deeef4fa8e tempest-GroupsV314Test-257475026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eda5656b-0591-4a85-b737-dde2b11982a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:34:41 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-59012d5e-e74f-4674-864b-28deeef4fa8e tempest-GroupsV314Test-257475026 None] Volume volume-574759cc-e8b8-474f-93d8-603e04dcadf0 (574759cc-e8b8-474f-93d8-603e04dcadf0): created successfully Sep 18 21:34:41 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-59012d5e-e74f-4674-864b-28deeef4fa8e tempest-GroupsV314Test-257475026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eda5656b-0591-4a85-b737-dde2b11982a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:34:41 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-59012d5e-e74f-4674-864b-28deeef4fa8e tempest-GroupsV314Test-257475026 None] Flow 'volume_create_manager' (558434b6-8fd8-4438-a482-4b8bdf9aa301) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:34:42 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-59012d5e-e74f-4674-864b-28deeef4fa8e tempest-GroupsV314Test-257475026 None] Created volume successfully. Sep 18 21:34:43 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-18e76262-48fc-4d56-aad6-65b1db9ee00a tempest-GroupsV314Test-257475026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:34:43 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-18e76262-48fc-4d56-aad6-65b1db9ee00a tempest-GroupsV314Test-257475026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:34:43 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-18e76262-48fc-4d56-aad6-65b1db9ee00a tempest-GroupsV314Test-257475026 None] Cloning volume 574759cc-e8b8-474f-93d8-603e04dcadf0 to volume a5916a50-0c19-4fa9-a5f2-3fde2ee61520 Sep 18 21:34:43 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-18e76262-48fc-4d56-aad6-65b1db9ee00a tempest-GroupsV314Test-257475026 None] Creating offline snapshot 72c480b5-c1fd-46f5-90c6-b4d0fe3bd41f of volume 574759cc-e8b8-474f-93d8-603e04dcadf0 {{(pid=86136) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 21:34:43 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd19bfa9-9d21-4d24-a152-c22d8b682ff3]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:34:43 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-18e76262-48fc-4d56-aad6-65b1db9ee00a tempest-GroupsV314Test-257475026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-574759cc-e8b8-474f-93d8-603e04dcadf0 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:34:44 devstack sudo[88566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-574759cc-e8b8-474f-93d8-603e04dcadf0 Sep 18 21:34:44 devstack sudo[88566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:34:44 devstack sudo[88566]: pam_unix(sudo:session): session closed for user root Sep 18 21:34:44 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-18e76262-48fc-4d56-aad6-65b1db9ee00a tempest-GroupsV314Test-257475026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-574759cc-e8b8-474f-93d8-603e04dcadf0" returned: 0 in 0.602s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:34:44 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-18e76262-48fc-4d56-aad6-65b1db9ee00a tempest-GroupsV314Test-257475026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-574759cc-e8b8-474f-93d8-603e04dcadf0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-574759cc-e8b8-474f-93d8-603e04dcadf0.72c480b5-c1fd-46f5-90c6-b4d0fe3bd41f 1G {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:34:44 devstack sudo[88572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-574759cc-e8b8-474f-93d8-603e04dcadf0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-574759cc-e8b8-474f-93d8-603e04dcadf0.72c480b5-c1fd-46f5-90c6-b4d0fe3bd41f 1G Sep 18 21:34:44 devstack sudo[88572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:34:45 devstack sudo[88572]: pam_unix(sudo:session): session closed for user root Sep 18 21:34:45 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-18e76262-48fc-4d56-aad6-65b1db9ee00a tempest-GroupsV314Test-257475026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-574759cc-e8b8-474f-93d8-603e04dcadf0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-574759cc-e8b8-474f-93d8-603e04dcadf0.72c480b5-c1fd-46f5-90c6-b4d0fe3bd41f 1G" returned: 0 in 0.486s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:34:45 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-18e76262-48fc-4d56-aad6-65b1db9ee00a tempest-GroupsV314Test-257475026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-574759cc-e8b8-474f-93d8-603e04dcadf0 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-574759cc-e8b8-474f-93d8-603e04dcadf0.72c480b5-c1fd-46f5-90c6-b4d0fe3bd41f {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:34:45 devstack sudo[88578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-574759cc-e8b8-474f-93d8-603e04dcadf0 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-574759cc-e8b8-474f-93d8-603e04dcadf0.72c480b5-c1fd-46f5-90c6-b4d0fe3bd41f Sep 18 21:34:45 devstack sudo[88578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:34:45 devstack sudo[88578]: pam_unix(sudo:session): session closed for user root Sep 18 21:34:45 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-18e76262-48fc-4d56-aad6-65b1db9ee00a tempest-GroupsV314Test-257475026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-574759cc-e8b8-474f-93d8-603e04dcadf0 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-574759cc-e8b8-474f-93d8-603e04dcadf0.72c480b5-c1fd-46f5-90c6-b4d0fe3bd41f" returned: 0 in 0.315s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:34:45 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-18e76262-48fc-4d56-aad6-65b1db9ee00a tempest-GroupsV314Test-257475026 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-574759cc-e8b8-474f-93d8-603e04dcadf0.72c480b5-c1fd-46f5-90c6-b4d0fe3bd41f is being set with open permissions: ugo+rw: NotImplementedError Sep 18 21:34:45 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-18e76262-48fc-4d56-aad6-65b1db9ee00a tempest-GroupsV314Test-257475026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-574759cc-e8b8-474f-93d8-603e04dcadf0.72c480b5-c1fd-46f5-90c6-b4d0fe3bd41f {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:34:45 devstack sudo[88584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-574759cc-e8b8-474f-93d8-603e04dcadf0.72c480b5-c1fd-46f5-90c6-b4d0fe3bd41f Sep 18 21:34:45 devstack sudo[88584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:34:45 devstack sudo[88584]: pam_unix(sudo:session): session closed for user root Sep 18 21:34:45 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-18e76262-48fc-4d56-aad6-65b1db9ee00a tempest-GroupsV314Test-257475026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-574759cc-e8b8-474f-93d8-603e04dcadf0.72c480b5-c1fd-46f5-90c6-b4d0fe3bd41f" returned: 0 in 0.298s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:34:45 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-18e76262-48fc-4d56-aad6-65b1db9ee00a tempest-GroupsV314Test-257475026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-574759cc-e8b8-474f-93d8-603e04dcadf0.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:34:45 devstack sudo[88587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-574759cc-e8b8-474f-93d8-603e04dcadf0.info Sep 18 21:34:45 devstack sudo[88587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:34:45 devstack sudo[88587]: pam_unix(sudo:session): session closed for user root Sep 18 21:34:45 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-18e76262-48fc-4d56-aad6-65b1db9ee00a tempest-GroupsV314Test-257475026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-574759cc-e8b8-474f-93d8-603e04dcadf0.info" returned: 0 in 0.283s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:34:45 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-18e76262-48fc-4d56-aad6-65b1db9ee00a tempest-GroupsV314Test-257475026 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-574759cc-e8b8-474f-93d8-603e04dcadf0.info is being set with open permissions: ugo+rw: NotImplementedError Sep 18 21:34:45 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-18e76262-48fc-4d56-aad6-65b1db9ee00a tempest-GroupsV314Test-257475026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-574759cc-e8b8-474f-93d8-603e04dcadf0.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:34:46 devstack sudo[88590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-574759cc-e8b8-474f-93d8-603e04dcadf0.info Sep 18 21:34:46 devstack sudo[88590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:34:46 devstack sudo[88590]: pam_unix(sudo:session): session closed for user root Sep 18 21:34:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-18e76262-48fc-4d56-aad6-65b1db9ee00a tempest-GroupsV314Test-257475026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-574759cc-e8b8-474f-93d8-603e04dcadf0.info" returned: 0 in 0.271s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:34:46 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-18e76262-48fc-4d56-aad6-65b1db9ee00a tempest-GroupsV314Test-257475026 None] Acquiring lock "cinder-quobyte-a5916a50-0c19-4fa9-a5f2-3fde2ee61520" by "_copy_volume_from_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:34:46 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-18e76262-48fc-4d56-aad6-65b1db9ee00a tempest-GroupsV314Test-257475026 None] Lock "cinder-quobyte-a5916a50-0c19-4fa9-a5f2-3fde2ee61520" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:34:46 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-18e76262-48fc-4d56-aad6-65b1db9ee00a tempest-GroupsV314Test-257475026 None] snapshot: 72c480b5-c1fd-46f5-90c6-b4d0fe3bd41f, volume: a5916a50-0c19-4fa9-a5f2-3fde2ee61520, {{(pid=86136) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 18 21:34:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-18e76262-48fc-4d56-aad6-65b1db9ee00a tempest-GroupsV314Test-257475026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:34:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-18e76262-48fc-4d56-aad6-65b1db9ee00a tempest-GroupsV314Test-257475026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:34:46 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-18e76262-48fc-4d56-aad6-65b1db9ee00a tempest-GroupsV314Test-257475026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:34:46 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-18e76262-48fc-4d56-aad6-65b1db9ee00a tempest-GroupsV314Test-257475026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:34:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-18e76262-48fc-4d56-aad6-65b1db9ee00a tempest-GroupsV314Test-257475026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:34:46 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d2e0c7b-913b-4b04-beb5-6438d37acf99]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:34:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-18e76262-48fc-4d56-aad6-65b1db9ee00a tempest-GroupsV314Test-257475026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-574759cc-e8b8-474f-93d8-603e04dcadf0.72c480b5-c1fd-46f5-90c6-b4d0fe3bd41f {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:34:46 devstack sudo[88596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-574759cc-e8b8-474f-93d8-603e04dcadf0.72c480b5-c1fd-46f5-90c6-b4d0fe3bd41f Sep 18 21:34:46 devstack sudo[88596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:34:46 devstack sudo[88596]: pam_unix(sudo:session): session closed for user root Sep 18 21:34:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-18e76262-48fc-4d56-aad6-65b1db9ee00a tempest-GroupsV314Test-257475026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-574759cc-e8b8-474f-93d8-603e04dcadf0.72c480b5-c1fd-46f5-90c6-b4d0fe3bd41f" returned: 0 in 0.519s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:34:46 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-18e76262-48fc-4d56-aad6-65b1db9ee00a tempest-GroupsV314Test-257475026 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-574759cc-e8b8-474f-93d8-603e04dcadf0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86136) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 21:34:46 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e801b58-ea68-4372-ba02-928c52acebc1]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:34:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-18e76262-48fc-4d56-aad6-65b1db9ee00a tempest-GroupsV314Test-257475026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-574759cc-e8b8-474f-93d8-603e04dcadf0 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:34:47 devstack sudo[88602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-574759cc-e8b8-474f-93d8-603e04dcadf0 Sep 18 21:34:47 devstack sudo[88602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:34:47 devstack sudo[88602]: pam_unix(sudo:session): session closed for user root Sep 18 21:34:47 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-18e76262-48fc-4d56-aad6-65b1db9ee00a tempest-GroupsV314Test-257475026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-574759cc-e8b8-474f-93d8-603e04dcadf0" returned: 0 in 0.518s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:34:47 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-18e76262-48fc-4d56-aad6-65b1db9ee00a tempest-GroupsV314Test-257475026 None] will copy from snapshot at /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-574759cc-e8b8-474f-93d8-603e04dcadf0 {{(pid=86136) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 18 21:34:47 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-18e76262-48fc-4d56-aad6-65b1db9ee00a tempest-GroupsV314Test-257475026 None] Creating direct copy from snapshot {{(pid=86136) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 18 21:34:47 devstack cinder-volume[86136]: DEBUG cinder.utils [None req-18e76262-48fc-4d56-aad6-65b1db9ee00a tempest-GroupsV314Test-257475026 None] Path /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5916a50-0c19-4fa9-a5f2-3fde2ee61520 not found in is_blk_device check {{(pid=86136) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 18 21:34:47 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-18e76262-48fc-4d56-aad6-65b1db9ee00a tempest-GroupsV314Test-257475026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-574759cc-e8b8-474f-93d8-603e04dcadf0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5916a50-0c19-4fa9-a5f2-3fde2ee61520 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:34:47 devstack sudo[88627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-574759cc-e8b8-474f-93d8-603e04dcadf0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5916a50-0c19-4fa9-a5f2-3fde2ee61520 Sep 18 21:34:47 devstack sudo[88627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:34:47 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-35245aa1-39e8-47ea-bc01-e89fc16f7cc1 tempest-ServerActionsTestOtherA-232293627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:34:47 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-35245aa1-39e8-47ea-bc01-e89fc16f7cc1 tempest-ServerActionsTestOtherA-232293627 None] Flow 'volume_create_manager' (a6d9d0be-0c46-4c02-b67c-ba046befeae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:34:47 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-35245aa1-39e8-47ea-bc01-e89fc16f7cc1 tempest-ServerActionsTestOtherA-232293627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff881c86-18d3-495e-b96c-143ed69c8a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:34:47 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-35245aa1-39e8-47ea-bc01-e89fc16f7cc1 tempest-ServerActionsTestOtherA-232293627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff881c86-18d3-495e-b96c-143ed69c8a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:34:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1651712109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90d0d3b3-a480-45e5-9f6c-f7e2019cfdff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f884806450a14e63b1e007cb6396e40e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:34:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:34:47Z,use_quota=True,user_id='5b45b61bc84e4e97964b2e63ff7478c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:34:47 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-35245aa1-39e8-47ea-bc01-e89fc16f7cc1 tempest-ServerActionsTestOtherA-232293627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52722a2c-4fce-44e0-9d5e-ce8905714990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:34:47 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-35245aa1-39e8-47ea-bc01-e89fc16f7cc1 tempest-ServerActionsTestOtherA-232293627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52722a2c-4fce-44e0-9d5e-ce8905714990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:34:47 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-35245aa1-39e8-47ea-bc01-e89fc16f7cc1 tempest-ServerActionsTestOtherA-232293627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff466093-1bdc-4653-8ea7-bee08b2472e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:34:47 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-35245aa1-39e8-47ea-bc01-e89fc16f7cc1 tempest-ServerActionsTestOtherA-232293627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff466093-1bdc-4653-8ea7-bee08b2472e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90d0d3b3-a480-45e5-9f6c-f7e2019cfdff', 'volume_name': 'volume-90d0d3b3-a480-45e5-9f6c-f7e2019cfdff', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:34:47 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-35245aa1-39e8-47ea-bc01-e89fc16f7cc1 tempest-ServerActionsTestOtherA-232293627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65ffe832-1150-4ac3-9f62-ac156240b8e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:34:47 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-35245aa1-39e8-47ea-bc01-e89fc16f7cc1 tempest-ServerActionsTestOtherA-232293627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65ffe832-1150-4ac3-9f62-ac156240b8e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:34:47 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-35245aa1-39e8-47ea-bc01-e89fc16f7cc1 tempest-ServerActionsTestOtherA-232293627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98734195-2fcf-4461-b1d6-be43492b038d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:34:47 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-35245aa1-39e8-47ea-bc01-e89fc16f7cc1 tempest-ServerActionsTestOtherA-232293627 None] Volume 90d0d3b3-a480-45e5-9f6c-f7e2019cfdff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90d0d3b3-a480-45e5-9f6c-f7e2019cfdff', 'volume_size': 1} Sep 18 21:34:47 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-35245aa1-39e8-47ea-bc01-e89fc16f7cc1 tempest-ServerActionsTestOtherA-232293627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:34:57 devstack cinder-volume[86136]: DEBUG dbcounter [-] [86136] Writing DB stats cinder:SELECT=35,cinder:UPDATE=42,cinder:INSERT=10,cinder:DELETE=4 {{(pid=86136) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 21:34:57 devstack cinder-volume[86136]: DEBUG dbcounter [-] [86136] Writing DB stats cinder:SELECT=31,cinder:UPDATE=40,cinder:INSERT=9,cinder:DELETE=4 {{(pid=86136) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 21:34:58 devstack sudo[88627]: pam_unix(sudo:session): session closed for user root Sep 18 21:34:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-18e76262-48fc-4d56-aad6-65b1db9ee00a tempest-GroupsV314Test-257475026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-574759cc-e8b8-474f-93d8-603e04dcadf0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5916a50-0c19-4fa9-a5f2-3fde2ee61520" returned: 0 in 10.692s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:34:58 devstack cinder-volume[86136]: DEBUG cinder.image.image_utils [None req-18e76262-48fc-4d56-aad6-65b1db9ee00a tempest-GroupsV314Test-257475026 None] Image conversion details: src /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-574759cc-e8b8-474f-93d8-603e04dcadf0, size 1024.00 MB, duration 10.69 sec, destination /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5916a50-0c19-4fa9-a5f2-3fde2ee61520 {{(pid=86136) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 18 21:34:58 devstack cinder-volume[86136]: INFO cinder.image.image_utils [None req-18e76262-48fc-4d56-aad6-65b1db9ee00a tempest-GroupsV314Test-257475026 None] Converted 1024.00 MB image at 95.75 MB/s Sep 18 21:34:58 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-18e76262-48fc-4d56-aad6-65b1db9ee00a tempest-GroupsV314Test-257475026 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5916a50-0c19-4fa9-a5f2-3fde2ee61520 is being set with open permissions: ugo+rw: NotImplementedError Sep 18 21:34:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-18e76262-48fc-4d56-aad6-65b1db9ee00a tempest-GroupsV314Test-257475026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5916a50-0c19-4fa9-a5f2-3fde2ee61520 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:34:58 devstack sudo[88715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5916a50-0c19-4fa9-a5f2-3fde2ee61520 Sep 18 21:34:58 devstack sudo[88715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:34:58 devstack sudo[88715]: pam_unix(sudo:session): session closed for user root Sep 18 21:34:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-18e76262-48fc-4d56-aad6-65b1db9ee00a tempest-GroupsV314Test-257475026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5916a50-0c19-4fa9-a5f2-3fde2ee61520" returned: 0 in 0.412s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:34:58 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-18e76262-48fc-4d56-aad6-65b1db9ee00a tempest-GroupsV314Test-257475026 None] Lock "cinder-quobyte-a5916a50-0c19-4fa9-a5f2-3fde2ee61520" released by "_copy_volume_from_snapshot" :: held 12.248s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:34:58 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-18e76262-48fc-4d56-aad6-65b1db9ee00a tempest-GroupsV314Test-257475026 None] Acquiring lock "cinder-quobyte-72c480b5-c1fd-46f5-90c6-b4d0fe3bd41f" by "_delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:34:58 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-18e76262-48fc-4d56-aad6-65b1db9ee00a tempest-GroupsV314Test-257475026 None] Lock "cinder-quobyte-72c480b5-c1fd-46f5-90c6-b4d0fe3bd41f" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:34:58 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-18e76262-48fc-4d56-aad6-65b1db9ee00a tempest-GroupsV314Test-257475026 None] Deleting offline snapshot 72c480b5-c1fd-46f5-90c6-b4d0fe3bd41f of volume 574759cc-e8b8-474f-93d8-603e04dcadf0 {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 21:34:58 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-18e76262-48fc-4d56-aad6-65b1db9ee00a tempest-GroupsV314Test-257475026 None] snapshot_file for this snap is: volume-574759cc-e8b8-474f-93d8-603e04dcadf0.72c480b5-c1fd-46f5-90c6-b4d0fe3bd41f {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 21:34:58 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2814432-647b-4767-a30d-948ac8426ec9]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:34:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-18e76262-48fc-4d56-aad6-65b1db9ee00a tempest-GroupsV314Test-257475026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-574759cc-e8b8-474f-93d8-603e04dcadf0.72c480b5-c1fd-46f5-90c6-b4d0fe3bd41f {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:34:58 devstack sudo[88724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-574759cc-e8b8-474f-93d8-603e04dcadf0.72c480b5-c1fd-46f5-90c6-b4d0fe3bd41f Sep 18 21:34:58 devstack sudo[88724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:34:59 devstack sudo[88724]: pam_unix(sudo:session): session closed for user root Sep 18 21:34:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-18e76262-48fc-4d56-aad6-65b1db9ee00a tempest-GroupsV314Test-257475026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-574759cc-e8b8-474f-93d8-603e04dcadf0.72c480b5-c1fd-46f5-90c6-b4d0fe3bd41f" returned: 0 in 0.493s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:34:59 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-18e76262-48fc-4d56-aad6-65b1db9ee00a tempest-GroupsV314Test-257475026 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-574759cc-e8b8-474f-93d8-603e04dcadf0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86136) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 21:34:59 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd11ef0-2d7e-43f9-af35-08ef5d115b62]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:34:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-18e76262-48fc-4d56-aad6-65b1db9ee00a tempest-GroupsV314Test-257475026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-574759cc-e8b8-474f-93d8-603e04dcadf0 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:34:59 devstack sudo[88743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-574759cc-e8b8-474f-93d8-603e04dcadf0 Sep 18 21:34:59 devstack sudo[88743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:34:59 devstack sudo[88743]: pam_unix(sudo:session): session closed for user root Sep 18 21:34:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-18e76262-48fc-4d56-aad6-65b1db9ee00a tempest-GroupsV314Test-257475026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-574759cc-e8b8-474f-93d8-603e04dcadf0" returned: 0 in 0.657s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:34:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-18e76262-48fc-4d56-aad6-65b1db9ee00a tempest-GroupsV314Test-257475026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-574759cc-e8b8-474f-93d8-603e04dcadf0.72c480b5-c1fd-46f5-90c6-b4d0fe3bd41f {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:34:59 devstack sudo[88749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-574759cc-e8b8-474f-93d8-603e04dcadf0.72c480b5-c1fd-46f5-90c6-b4d0fe3bd41f Sep 18 21:34:59 devstack sudo[88749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:35:00 devstack sudo[88749]: pam_unix(sudo:session): session closed for user root Sep 18 21:35:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-18e76262-48fc-4d56-aad6-65b1db9ee00a tempest-GroupsV314Test-257475026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-574759cc-e8b8-474f-93d8-603e04dcadf0.72c480b5-c1fd-46f5-90c6-b4d0fe3bd41f" returned: 0 in 0.378s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:35:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-18e76262-48fc-4d56-aad6-65b1db9ee00a tempest-GroupsV314Test-257475026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-574759cc-e8b8-474f-93d8-603e04dcadf0.72c480b5-c1fd-46f5-90c6-b4d0fe3bd41f {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:35:00 devstack sudo[88754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-574759cc-e8b8-474f-93d8-603e04dcadf0.72c480b5-c1fd-46f5-90c6-b4d0fe3bd41f Sep 18 21:35:00 devstack sudo[88754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:35:00 devstack sudo[88754]: pam_unix(sudo:session): session closed for user root Sep 18 21:35:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-18e76262-48fc-4d56-aad6-65b1db9ee00a tempest-GroupsV314Test-257475026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-574759cc-e8b8-474f-93d8-603e04dcadf0.72c480b5-c1fd-46f5-90c6-b4d0fe3bd41f" returned: 0 in 0.295s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:35:00 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-18e76262-48fc-4d56-aad6-65b1db9ee00a tempest-GroupsV314Test-257475026 None] Lock "cinder-quobyte-72c480b5-c1fd-46f5-90c6-b4d0fe3bd41f" released by "_delete_snapshot" :: held 1.978s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:35:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-18e76262-48fc-4d56-aad6-65b1db9ee00a tempest-GroupsV314Test-257475026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.803s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:35:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-35245aa1-39e8-47ea-bc01-e89fc16f7cc1 tempest-ServerActionsTestOtherA-232293627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.905s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:35:00 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-35245aa1-39e8-47ea-bc01-e89fc16f7cc1 tempest-ServerActionsTestOtherA-232293627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:34:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1651712109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90d0d3b3-a480-45e5-9f6c-f7e2019cfdff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f884806450a14e63b1e007cb6396e40e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:34:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:34:47Z,use_quota=True,user_id='5b45b61bc84e4e97964b2e63ff7478c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:35:00 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-35245aa1-39e8-47ea-bc01-e89fc16f7cc1 tempest-ServerActionsTestOtherA-232293627 None] Creating volume 90d0d3b3-a480-45e5-9f6c-f7e2019cfdff {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:35:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-35245aa1-39e8-47ea-bc01-e89fc16f7cc1 tempest-ServerActionsTestOtherA-232293627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:35:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-35245aa1-39e8-47ea-bc01-e89fc16f7cc1 tempest-ServerActionsTestOtherA-232293627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:35:00 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-35245aa1-39e8-47ea-bc01-e89fc16f7cc1 tempest-ServerActionsTestOtherA-232293627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:35:00 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-35245aa1-39e8-47ea-bc01-e89fc16f7cc1 tempest-ServerActionsTestOtherA-232293627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:35:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-35245aa1-39e8-47ea-bc01-e89fc16f7cc1 tempest-ServerActionsTestOtherA-232293627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:35:00 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-35245aa1-39e8-47ea-bc01-e89fc16f7cc1 tempest-ServerActionsTestOtherA-232293627 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:35:00 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-35245aa1-39e8-47ea-bc01-e89fc16f7cc1 tempest-ServerActionsTestOtherA-232293627 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:35:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-35245aa1-39e8-47ea-bc01-e89fc16f7cc1 tempest-ServerActionsTestOtherA-232293627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-90d0d3b3-a480-45e5-9f6c-f7e2019cfdff 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:35:00 devstack sudo[88759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-90d0d3b3-a480-45e5-9f6c-f7e2019cfdff 1073741824 Sep 18 21:35:00 devstack sudo[88759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:35:00 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-18e76262-48fc-4d56-aad6-65b1db9ee00a tempest-GroupsV314Test-257475026 None] Create group from source-group-24149235-bf56-4c8d-bcd2-990ef1796f62 completed successfully. Sep 18 21:35:01 devstack sudo[88759]: pam_unix(sudo:session): session closed for user root Sep 18 21:35:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-35245aa1-39e8-47ea-bc01-e89fc16f7cc1 tempest-ServerActionsTestOtherA-232293627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-90d0d3b3-a480-45e5-9f6c-f7e2019cfdff 1073741824" returned: 0 in 0.748s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:35:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-35245aa1-39e8-47ea-bc01-e89fc16f7cc1 tempest-ServerActionsTestOtherA-232293627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-90d0d3b3-a480-45e5-9f6c-f7e2019cfdff {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:35:01 devstack sudo[88778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-90d0d3b3-a480-45e5-9f6c-f7e2019cfdff Sep 18 21:35:01 devstack sudo[88778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:35:01 devstack sudo[88778]: pam_unix(sudo:session): session closed for user root Sep 18 21:35:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-35245aa1-39e8-47ea-bc01-e89fc16f7cc1 tempest-ServerActionsTestOtherA-232293627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-90d0d3b3-a480-45e5-9f6c-f7e2019cfdff" returned: 0 in 0.493s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:35:01 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-35245aa1-39e8-47ea-bc01-e89fc16f7cc1 tempest-ServerActionsTestOtherA-232293627 None] <== create_volume: return (1321ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:35:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-35245aa1-39e8-47ea-bc01-e89fc16f7cc1 tempest-ServerActionsTestOtherA-232293627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.326s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:35:02 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-35245aa1-39e8-47ea-bc01-e89fc16f7cc1 tempest-ServerActionsTestOtherA-232293627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98734195-2fcf-4461-b1d6-be43492b038d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90d0d3b3-a480-45e5-9f6c-f7e2019cfdff', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:35:02 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-35245aa1-39e8-47ea-bc01-e89fc16f7cc1 tempest-ServerActionsTestOtherA-232293627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2922e34d-e89a-4472-ab0e-9774658edf9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:35:02 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-35245aa1-39e8-47ea-bc01-e89fc16f7cc1 tempest-ServerActionsTestOtherA-232293627 None] Volume volume-90d0d3b3-a480-45e5-9f6c-f7e2019cfdff (90d0d3b3-a480-45e5-9f6c-f7e2019cfdff): created successfully Sep 18 21:35:02 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-35245aa1-39e8-47ea-bc01-e89fc16f7cc1 tempest-ServerActionsTestOtherA-232293627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2922e34d-e89a-4472-ab0e-9774658edf9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:35:02 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-35245aa1-39e8-47ea-bc01-e89fc16f7cc1 tempest-ServerActionsTestOtherA-232293627 None] Flow 'volume_create_manager' (a6d9d0be-0c46-4c02-b67c-ba046befeae7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:35:02 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-35245aa1-39e8-47ea-bc01-e89fc16f7cc1 tempest-ServerActionsTestOtherA-232293627 None] Created volume successfully. Sep 18 21:35:02 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-2a5d4746-a4a9-41d8-8972-a63db4b84e73 tempest-GroupsV314Test-257475026 None] Acquiring lock "cinder-quobyte-a5916a50-0c19-4fa9-a5f2-3fde2ee61520" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:35:02 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-2a5d4746-a4a9-41d8-8972-a63db4b84e73 tempest-GroupsV314Test-257475026 None] Lock "cinder-quobyte-a5916a50-0c19-4fa9-a5f2-3fde2ee61520" acquired by "delete_volume" :: waited 0.026s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:35:02 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ac5fab-99c6-4c8f-bcc4-a94e668095ce]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:35:02 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-2a5d4746-a4a9-41d8-8972-a63db4b84e73 tempest-GroupsV314Test-257475026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5916a50-0c19-4fa9-a5f2-3fde2ee61520 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:35:03 devstack sudo[88814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5916a50-0c19-4fa9-a5f2-3fde2ee61520 Sep 18 21:35:03 devstack sudo[88814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:35:03 devstack sudo[88814]: pam_unix(sudo:session): session closed for user root Sep 18 21:35:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-2a5d4746-a4a9-41d8-8972-a63db4b84e73 tempest-GroupsV314Test-257475026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5916a50-0c19-4fa9-a5f2-3fde2ee61520" returned: 0 in 0.743s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:35:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-2a5d4746-a4a9-41d8-8972-a63db4b84e73 tempest-GroupsV314Test-257475026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5916a50-0c19-4fa9-a5f2-3fde2ee61520 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:35:03 devstack sudo[88827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5916a50-0c19-4fa9-a5f2-3fde2ee61520 Sep 18 21:35:03 devstack sudo[88827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:35:04 devstack sudo[88827]: pam_unix(sudo:session): session closed for user root Sep 18 21:35:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-2a5d4746-a4a9-41d8-8972-a63db4b84e73 tempest-GroupsV314Test-257475026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5916a50-0c19-4fa9-a5f2-3fde2ee61520" returned: 0 in 1.024s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:35:04 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-2a5d4746-a4a9-41d8-8972-a63db4b84e73 tempest-GroupsV314Test-257475026 None] Lock "cinder-quobyte-a5916a50-0c19-4fa9-a5f2-3fde2ee61520" released by "delete_volume" :: held 1.874s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:35:04 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-2a5d4746-a4a9-41d8-8972-a63db4b84e73 tempest-GroupsV314Test-257475026 None] Created reservations ['0d907407-2a48-47e5-b215-0900476a77dc'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:35:04 devstack cinder-volume[86136]: WARNING cinder.quota [None req-2a5d4746-a4a9-41d8-8972-a63db4b84e73 tempest-GroupsV314Test-257475026 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1553739697 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1553739697, it is now deprecated. Please use the default quota class for default quota. Sep 18 21:35:04 devstack cinder-volume[86136]: WARNING cinder.quota [None req-2a5d4746-a4a9-41d8-8972-a63db4b84e73 tempest-GroupsV314Test-257475026 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1553739697 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1553739697, it is now deprecated. Please use the default quota class for default quota. Sep 18 21:35:04 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-2a5d4746-a4a9-41d8-8972-a63db4b84e73 tempest-GroupsV314Test-257475026 None] Created reservations ['bccf20ed-1ee0-4626-98d3-0c482578f08a', '1afa0a69-c85c-4ea9-b8fc-81e74371c954', 'd6636d7f-c197-45a3-a892-f47cf2de73e1', '88384b4b-5f6a-4881-b3c6-0d0d77ab110c'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:35:05 devstack cinder-volume[86136]: DEBUG oslo_service.periodic_task [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86136) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 21:35:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:35:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:35:05 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:35:05 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:35:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:35:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:35:05 devstack sudo[88872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:35:05 devstack sudo[88872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:35:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-2a5d4746-a4a9-41d8-8972-a63db4b84e73 tempest-GroupsV314Test-257475026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:35:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-2a5d4746-a4a9-41d8-8972-a63db4b84e73 tempest-GroupsV314Test-257475026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:35:05 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-2a5d4746-a4a9-41d8-8972-a63db4b84e73 tempest-GroupsV314Test-257475026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:35:05 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-2a5d4746-a4a9-41d8-8972-a63db4b84e73 tempest-GroupsV314Test-257475026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:35:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-2a5d4746-a4a9-41d8-8972-a63db4b84e73 tempest-GroupsV314Test-257475026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:35:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-2a5d4746-a4a9-41d8-8972-a63db4b84e73 tempest-GroupsV314Test-257475026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:35:05 devstack sudo[88876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:35:05 devstack sudo[88876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:35:05 devstack sudo[88872]: pam_unix(sudo:session): session closed for user root Sep 18 21:35:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.510s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:35:05 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:35:05 devstack cinder-volume[86136]: DEBUG oslo_service.periodic_task [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Running periodic task VolumeManager._thread_info {{(pid=86136) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 21:35:05 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] thread count: 8 {{(pid=86136) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 18 21:35:05 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] thread info: [<_MainThread(MainThread, started 138548347871360)>, , , , , , , ] {{(pid=86136) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 18 21:35:05 devstack sudo[88876]: pam_unix(sudo:session): session closed for user root Sep 18 21:35:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-2a5d4746-a4a9-41d8-8972-a63db4b84e73 tempest-GroupsV314Test-257475026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.629s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:35:05 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-2a5d4746-a4a9-41d8-8972-a63db4b84e73 tempest-GroupsV314Test-257475026 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:35:05 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-2a5d4746-a4a9-41d8-8972-a63db4b84e73 tempest-GroupsV314Test-257475026 None] Delete group completed successfully. Sep 18 21:35:06 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-9f8adeae-eecb-440f-ad12-8078203f1d77 tempest-GroupsV314Test-257475026 None] Acquiring lock "cinder-quobyte-574759cc-e8b8-474f-93d8-603e04dcadf0" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:35:06 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-9f8adeae-eecb-440f-ad12-8078203f1d77 tempest-GroupsV314Test-257475026 None] Lock "cinder-quobyte-574759cc-e8b8-474f-93d8-603e04dcadf0" acquired by "delete_volume" :: waited 0.027s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:35:06 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0bfeb44-9764-435a-8616-e470df788017]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:35:06 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9f8adeae-eecb-440f-ad12-8078203f1d77 tempest-GroupsV314Test-257475026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-574759cc-e8b8-474f-93d8-603e04dcadf0 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:35:06 devstack sudo[88890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-574759cc-e8b8-474f-93d8-603e04dcadf0 Sep 18 21:35:06 devstack sudo[88890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:35:07 devstack sudo[88890]: pam_unix(sudo:session): session closed for user root Sep 18 21:35:07 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9f8adeae-eecb-440f-ad12-8078203f1d77 tempest-GroupsV314Test-257475026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-574759cc-e8b8-474f-93d8-603e04dcadf0" returned: 0 in 0.659s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:35:07 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9f8adeae-eecb-440f-ad12-8078203f1d77 tempest-GroupsV314Test-257475026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-574759cc-e8b8-474f-93d8-603e04dcadf0 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:35:07 devstack sudo[88897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-574759cc-e8b8-474f-93d8-603e04dcadf0 Sep 18 21:35:07 devstack sudo[88897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:35:07 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-72a2c0cf-8b60-49f5-897b-db4e1a90656b tempest-AttachVolumeShelveTestJSON-544571647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:35:07 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-72a2c0cf-8b60-49f5-897b-db4e1a90656b tempest-AttachVolumeShelveTestJSON-544571647 None] Flow 'volume_create_manager' (5fb1812b-5103-4d8a-ad8d-871af59ff36d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:35:07 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-72a2c0cf-8b60-49f5-897b-db4e1a90656b tempest-AttachVolumeShelveTestJSON-544571647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c82e26c-831d-4b8f-83cd-62ff91fb043a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:35:07 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-72a2c0cf-8b60-49f5-897b-db4e1a90656b tempest-AttachVolumeShelveTestJSON-544571647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c82e26c-831d-4b8f-83cd-62ff91fb043a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:35:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-563818185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4be57fb4-3f00-40ea-8d38-4ce1bdbd37ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f297a002a20f494797a7d87675e7838b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:35:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:35:07Z,use_quota=True,user_id='6a8d29b3c5dd4834b04f1f228e4ed597',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:35:07 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-72a2c0cf-8b60-49f5-897b-db4e1a90656b tempest-AttachVolumeShelveTestJSON-544571647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6699ef5b-ce2b-4182-8c78-086387332439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:35:07 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-72a2c0cf-8b60-49f5-897b-db4e1a90656b tempest-AttachVolumeShelveTestJSON-544571647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6699ef5b-ce2b-4182-8c78-086387332439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:35:07 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-72a2c0cf-8b60-49f5-897b-db4e1a90656b tempest-AttachVolumeShelveTestJSON-544571647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74d9feef-3f2d-484b-ba9c-4f022b32e5da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:35:07 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-72a2c0cf-8b60-49f5-897b-db4e1a90656b tempest-AttachVolumeShelveTestJSON-544571647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74d9feef-3f2d-484b-ba9c-4f022b32e5da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4be57fb4-3f00-40ea-8d38-4ce1bdbd37ac', 'volume_name': 'volume-4be57fb4-3f00-40ea-8d38-4ce1bdbd37ac', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:35:07 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-72a2c0cf-8b60-49f5-897b-db4e1a90656b tempest-AttachVolumeShelveTestJSON-544571647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c7e7a3e-9928-4078-a85c-8d7a614af449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:35:07 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-72a2c0cf-8b60-49f5-897b-db4e1a90656b tempest-AttachVolumeShelveTestJSON-544571647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c7e7a3e-9928-4078-a85c-8d7a614af449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:35:07 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-72a2c0cf-8b60-49f5-897b-db4e1a90656b tempest-AttachVolumeShelveTestJSON-544571647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c53bc0c3-5182-46bf-8093-15deb53e0cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:35:07 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-72a2c0cf-8b60-49f5-897b-db4e1a90656b tempest-AttachVolumeShelveTestJSON-544571647 None] Volume 4be57fb4-3f00-40ea-8d38-4ce1bdbd37ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4be57fb4-3f00-40ea-8d38-4ce1bdbd37ac', 'volume_size': 1} Sep 18 21:35:07 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-72a2c0cf-8b60-49f5-897b-db4e1a90656b tempest-AttachVolumeShelveTestJSON-544571647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:35:07 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-72a2c0cf-8b60-49f5-897b-db4e1a90656b tempest-AttachVolumeShelveTestJSON-544571647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:35:07 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-72a2c0cf-8b60-49f5-897b-db4e1a90656b tempest-AttachVolumeShelveTestJSON-544571647 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:35:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-563818185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4be57fb4-3f00-40ea-8d38-4ce1bdbd37ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f297a002a20f494797a7d87675e7838b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:35:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:35:07Z,use_quota=True,user_id='6a8d29b3c5dd4834b04f1f228e4ed597',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:35:07 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-72a2c0cf-8b60-49f5-897b-db4e1a90656b tempest-AttachVolumeShelveTestJSON-544571647 None] Creating volume 4be57fb4-3f00-40ea-8d38-4ce1bdbd37ac {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:35:07 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-72a2c0cf-8b60-49f5-897b-db4e1a90656b tempest-AttachVolumeShelveTestJSON-544571647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:35:07 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-72a2c0cf-8b60-49f5-897b-db4e1a90656b tempest-AttachVolumeShelveTestJSON-544571647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:35:07 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-72a2c0cf-8b60-49f5-897b-db4e1a90656b tempest-AttachVolumeShelveTestJSON-544571647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:35:07 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-72a2c0cf-8b60-49f5-897b-db4e1a90656b tempest-AttachVolumeShelveTestJSON-544571647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:35:07 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-72a2c0cf-8b60-49f5-897b-db4e1a90656b tempest-AttachVolumeShelveTestJSON-544571647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:35:07 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-72a2c0cf-8b60-49f5-897b-db4e1a90656b tempest-AttachVolumeShelveTestJSON-544571647 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:35:07 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-72a2c0cf-8b60-49f5-897b-db4e1a90656b tempest-AttachVolumeShelveTestJSON-544571647 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:35:07 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-72a2c0cf-8b60-49f5-897b-db4e1a90656b tempest-AttachVolumeShelveTestJSON-544571647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4be57fb4-3f00-40ea-8d38-4ce1bdbd37ac 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:35:07 devstack sudo[88907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4be57fb4-3f00-40ea-8d38-4ce1bdbd37ac 1073741824 Sep 18 21:35:07 devstack sudo[88907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:35:07 devstack sudo[88897]: pam_unix(sudo:session): session closed for user root Sep 18 21:35:07 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9f8adeae-eecb-440f-ad12-8078203f1d77 tempest-GroupsV314Test-257475026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-574759cc-e8b8-474f-93d8-603e04dcadf0" returned: 0 in 0.523s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:35:07 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-9f8adeae-eecb-440f-ad12-8078203f1d77 tempest-GroupsV314Test-257475026 None] Lock "cinder-quobyte-574759cc-e8b8-474f-93d8-603e04dcadf0" released by "delete_volume" :: held 1.322s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:35:07 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-9f8adeae-eecb-440f-ad12-8078203f1d77 tempest-GroupsV314Test-257475026 None] Created reservations ['6cfb2d18-e847-4ceb-a2c4-5ebfd2bbc792'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:35:07 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-6d7e6c4f-6ab8-4813-95ce-733cf1c5510a req-ec5ee1bb-716b-4ced-bd61-22e742d058c4 tempest-TaggedAttachmentsTest-481802302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:35:08 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-9f8adeae-eecb-440f-ad12-8078203f1d77 tempest-GroupsV314Test-257475026 None] Created reservations ['f7c7e412-3b38-47f2-9874-1a134fbc8531', '3ee4fbe6-dcaa-466e-b8e2-15cedb63551b', 'f04dccb4-f020-47bd-9718-9852d6547ab6', '4c5c8e72-b058-4deb-85f8-1b833e2907e5'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:35:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-9f8adeae-eecb-440f-ad12-8078203f1d77 tempest-GroupsV314Test-257475026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:35:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-9f8adeae-eecb-440f-ad12-8078203f1d77 tempest-GroupsV314Test-257475026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:35:08 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-9f8adeae-eecb-440f-ad12-8078203f1d77 tempest-GroupsV314Test-257475026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:35:08 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-9f8adeae-eecb-440f-ad12-8078203f1d77 tempest-GroupsV314Test-257475026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:35:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-9f8adeae-eecb-440f-ad12-8078203f1d77 tempest-GroupsV314Test-257475026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:35:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9f8adeae-eecb-440f-ad12-8078203f1d77 tempest-GroupsV314Test-257475026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:35:08 devstack sudo[88916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:35:08 devstack sudo[88916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:35:08 devstack sudo[88907]: pam_unix(sudo:session): session closed for user root Sep 18 21:35:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-72a2c0cf-8b60-49f5-897b-db4e1a90656b tempest-AttachVolumeShelveTestJSON-544571647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4be57fb4-3f00-40ea-8d38-4ce1bdbd37ac 1073741824" returned: 0 in 0.746s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:35:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-72a2c0cf-8b60-49f5-897b-db4e1a90656b tempest-AttachVolumeShelveTestJSON-544571647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4be57fb4-3f00-40ea-8d38-4ce1bdbd37ac {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:35:08 devstack sudo[88918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4be57fb4-3f00-40ea-8d38-4ce1bdbd37ac Sep 18 21:35:08 devstack sudo[88918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:35:08 devstack sudo[88916]: pam_unix(sudo:session): session closed for user root Sep 18 21:35:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9f8adeae-eecb-440f-ad12-8078203f1d77 tempest-GroupsV314Test-257475026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.339s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:35:08 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-9f8adeae-eecb-440f-ad12-8078203f1d77 tempest-GroupsV314Test-257475026 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:35:08 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-9f8adeae-eecb-440f-ad12-8078203f1d77 tempest-GroupsV314Test-257475026 None] Delete group completed successfully. Sep 18 21:35:08 devstack sudo[88918]: pam_unix(sudo:session): session closed for user root Sep 18 21:35:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-72a2c0cf-8b60-49f5-897b-db4e1a90656b tempest-AttachVolumeShelveTestJSON-544571647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4be57fb4-3f00-40ea-8d38-4ce1bdbd37ac" returned: 0 in 0.267s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:35:08 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-72a2c0cf-8b60-49f5-897b-db4e1a90656b tempest-AttachVolumeShelveTestJSON-544571647 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:35:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-72a2c0cf-8b60-49f5-897b-db4e1a90656b tempest-AttachVolumeShelveTestJSON-544571647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:35:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-6d7e6c4f-6ab8-4813-95ce-733cf1c5510a req-ec5ee1bb-716b-4ced-bd61-22e742d058c4 tempest-TaggedAttachmentsTest-481802302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.687s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:35:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-6d7e6c4f-6ab8-4813-95ce-733cf1c5510a req-ec5ee1bb-716b-4ced-bd61-22e742d058c4 tempest-TaggedAttachmentsTest-481802302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:35:08 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-72a2c0cf-8b60-49f5-897b-db4e1a90656b tempest-AttachVolumeShelveTestJSON-544571647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c53bc0c3-5182-46bf-8093-15deb53e0cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4be57fb4-3f00-40ea-8d38-4ce1bdbd37ac', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:35:08 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-72a2c0cf-8b60-49f5-897b-db4e1a90656b tempest-AttachVolumeShelveTestJSON-544571647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d0ec319-a8f8-4b1d-b9c9-27ef0a90e85b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:35:08 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-72a2c0cf-8b60-49f5-897b-db4e1a90656b tempest-AttachVolumeShelveTestJSON-544571647 None] Volume volume-4be57fb4-3f00-40ea-8d38-4ce1bdbd37ac (4be57fb4-3f00-40ea-8d38-4ce1bdbd37ac): created successfully Sep 18 21:35:08 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-72a2c0cf-8b60-49f5-897b-db4e1a90656b tempest-AttachVolumeShelveTestJSON-544571647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d0ec319-a8f8-4b1d-b9c9-27ef0a90e85b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:35:08 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-72a2c0cf-8b60-49f5-897b-db4e1a90656b tempest-AttachVolumeShelveTestJSON-544571647 None] Flow 'volume_create_manager' (5fb1812b-5103-4d8a-ad8d-871af59ff36d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:35:08 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [req-6d7e6c4f-6ab8-4813-95ce-733cf1c5510a req-ec5ee1bb-716b-4ced-bd61-22e742d058c4 tempest-TaggedAttachmentsTest-481802302 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff', 'name': 'volume-9e6c96a3-617c-46b8-a151-e42ac1bf7916', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '964e1386-ea61-469d-a5bc-0fc1f797589f', 'enforce_multipath': True} {{(pid=86136) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 18 21:35:08 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-72a2c0cf-8b60-49f5-897b-db4e1a90656b tempest-AttachVolumeShelveTestJSON-544571647 None] Created volume successfully. Sep 18 21:35:08 devstack cinder-volume[86136]: INFO cinder.volume.manager [req-6d7e6c4f-6ab8-4813-95ce-733cf1c5510a req-ec5ee1bb-716b-4ced-bd61-22e742d058c4 tempest-TaggedAttachmentsTest-481802302 None] attachment_update completed successfully. Sep 18 21:35:13 devstack cinder-volume[86136]: INFO cinder.volume.manager [req-53c21524-04ac-417d-a7b9-5b29b0812854 req-92b68d37-0b08-4aa0-90f5-4c6024cd78b7 tempest-TaggedAttachmentsTest-481802302 None] Terminate volume connection completed successfully. Sep 18 21:35:13 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [req-53c21524-04ac-417d-a7b9-5b29b0812854 req-92b68d37-0b08-4aa0-90f5-4c6024cd78b7 tempest-TaggedAttachmentsTest-481802302 None] Deleting attachment 964e1386-ea61-469d-a5bc-0fc1f797589f. {{(pid=86136) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 18 21:35:18 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-223cab2d-2ba0-4ad1-a8be-cfd3df5871db tempest-GroupsV320Test-408038110 None] Group tempest-GroupsV320Test-Group-261238960: creating Sep 18 21:35:18 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-223cab2d-2ba0-4ad1-a8be-cfd3df5871db tempest-GroupsV320Test-408038110 None] Group tempest-GroupsV320Test-Group-261238960: created successfully Sep 18 21:35:18 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-223cab2d-2ba0-4ad1-a8be-cfd3df5871db tempest-GroupsV320Test-408038110 None] Create group completed successfully. Sep 18 21:35:20 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-347d832e-fdb7-456a-9a2d-67021c360645 tempest-GroupsV320Test-408038110 None] Created reservations ['702aab14-0eb2-4b69-bac7-cf3cfbc69d5c'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:35:20 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-347d832e-fdb7-456a-9a2d-67021c360645 tempest-GroupsV320Test-408038110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:35:20 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-347d832e-fdb7-456a-9a2d-67021c360645 tempest-GroupsV320Test-408038110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:35:20 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-347d832e-fdb7-456a-9a2d-67021c360645 tempest-GroupsV320Test-408038110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:35:20 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-347d832e-fdb7-456a-9a2d-67021c360645 tempest-GroupsV320Test-408038110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:35:20 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-347d832e-fdb7-456a-9a2d-67021c360645 tempest-GroupsV320Test-408038110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:35:20 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-347d832e-fdb7-456a-9a2d-67021c360645 tempest-GroupsV320Test-408038110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:35:20 devstack sudo[89504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:35:20 devstack sudo[89504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:35:20 devstack sudo[89504]: pam_unix(sudo:session): session closed for user root Sep 18 21:35:20 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-347d832e-fdb7-456a-9a2d-67021c360645 tempest-GroupsV320Test-408038110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.302s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:35:20 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-347d832e-fdb7-456a-9a2d-67021c360645 tempest-GroupsV320Test-408038110 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:35:20 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-347d832e-fdb7-456a-9a2d-67021c360645 tempest-GroupsV320Test-408038110 None] Delete group completed successfully. Sep 18 21:35:22 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [req-2bea9674-859a-4ecb-aed2-c16092d1d629 req-b9b571a9-78ef-47f2-ac18-ed1979187347 tempest-AttachVolumeShelveTestJSON-544571647 None] No connector for attachment 55f8111b-b008-43f6-add4-491a56086379; skipping storage backend terminate_connection call. {{(pid=86136) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 18 21:35:22 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [req-2bea9674-859a-4ecb-aed2-c16092d1d629 req-b9b571a9-78ef-47f2-ac18-ed1979187347 tempest-AttachVolumeShelveTestJSON-544571647 None] Deleting attachment 55f8111b-b008-43f6-add4-491a56086379. {{(pid=86136) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 18 21:35:25 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-191488ce-c255-4346-aac4-253109c8200e tempest-TaggedAttachmentsTest-481802302 None] Acquiring lock "cinder-9e6c96a3-617c-46b8-a151-e42ac1bf7916-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:35:25 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-191488ce-c255-4346-aac4-253109c8200e tempest-TaggedAttachmentsTest-481802302 None] Lock "cinder-9e6c96a3-617c-46b8-a151-e42ac1bf7916-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:35:25 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-191488ce-c255-4346-aac4-253109c8200e tempest-TaggedAttachmentsTest-481802302 None] Acquiring lock "cinder-quobyte-9e6c96a3-617c-46b8-a151-e42ac1bf7916" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:35:26 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-191488ce-c255-4346-aac4-253109c8200e tempest-TaggedAttachmentsTest-481802302 None] Lock "cinder-quobyte-9e6c96a3-617c-46b8-a151-e42ac1bf7916" acquired by "delete_volume" :: waited 0.035s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:35:26 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c0fe69-60ca-4c3e-a174-15ee609463c0]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:35:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-191488ce-c255-4346-aac4-253109c8200e tempest-TaggedAttachmentsTest-481802302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9e6c96a3-617c-46b8-a151-e42ac1bf7916 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:35:26 devstack sudo[89523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9e6c96a3-617c-46b8-a151-e42ac1bf7916 Sep 18 21:35:26 devstack sudo[89523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:35:26 devstack sudo[89523]: pam_unix(sudo:session): session closed for user root Sep 18 21:35:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-191488ce-c255-4346-aac4-253109c8200e tempest-TaggedAttachmentsTest-481802302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9e6c96a3-617c-46b8-a151-e42ac1bf7916" returned: 0 in 0.517s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:35:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-191488ce-c255-4346-aac4-253109c8200e tempest-TaggedAttachmentsTest-481802302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9e6c96a3-617c-46b8-a151-e42ac1bf7916 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:35:26 devstack sudo[89528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9e6c96a3-617c-46b8-a151-e42ac1bf7916 Sep 18 21:35:26 devstack sudo[89528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:35:26 devstack sudo[89528]: pam_unix(sudo:session): session closed for user root Sep 18 21:35:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-191488ce-c255-4346-aac4-253109c8200e tempest-TaggedAttachmentsTest-481802302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9e6c96a3-617c-46b8-a151-e42ac1bf7916" returned: 0 in 0.390s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:35:27 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-191488ce-c255-4346-aac4-253109c8200e tempest-TaggedAttachmentsTest-481802302 None] Lock "cinder-quobyte-9e6c96a3-617c-46b8-a151-e42ac1bf7916" released by "delete_volume" :: held 0.990s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:35:27 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-191488ce-c255-4346-aac4-253109c8200e tempest-TaggedAttachmentsTest-481802302 None] Created reservations ['55a262b3-6f3a-426a-b173-0dddb60b89f6', 'c53ded61-890f-40c2-810c-ab5379ab6038', '378f04db-ee43-4f8c-bb5d-135e4935660b', '43783741-8407-4532-a607-28a482a04b18'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:35:27 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-191488ce-c255-4346-aac4-253109c8200e tempest-TaggedAttachmentsTest-481802302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:35:27 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-191488ce-c255-4346-aac4-253109c8200e tempest-TaggedAttachmentsTest-481802302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:35:27 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-191488ce-c255-4346-aac4-253109c8200e tempest-TaggedAttachmentsTest-481802302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:35:27 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-191488ce-c255-4346-aac4-253109c8200e tempest-TaggedAttachmentsTest-481802302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:35:27 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-191488ce-c255-4346-aac4-253109c8200e tempest-TaggedAttachmentsTest-481802302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:35:27 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-191488ce-c255-4346-aac4-253109c8200e tempest-TaggedAttachmentsTest-481802302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:35:27 devstack sudo[89531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:35:27 devstack sudo[89531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:35:27 devstack sudo[89531]: pam_unix(sudo:session): session closed for user root Sep 18 21:35:27 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-191488ce-c255-4346-aac4-253109c8200e tempest-TaggedAttachmentsTest-481802302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.325s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:35:27 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-191488ce-c255-4346-aac4-253109c8200e tempest-TaggedAttachmentsTest-481802302 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:35:27 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-191488ce-c255-4346-aac4-253109c8200e tempest-TaggedAttachmentsTest-481802302 None] Deleted volume successfully. Sep 18 21:35:27 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-191488ce-c255-4346-aac4-253109c8200e tempest-TaggedAttachmentsTest-481802302 None] Lock "cinder-9e6c96a3-617c-46b8-a151-e42ac1bf7916-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:35:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-278804fc-57b4-4261-b7c8-e31254fa07d3 req-ab8777e9-5ab3-40fc-9169-18baf4bbe45c tempest-ServerActionsTestOtherA-232293627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:35:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-278804fc-57b4-4261-b7c8-e31254fa07d3 req-ab8777e9-5ab3-40fc-9169-18baf4bbe45c tempest-ServerActionsTestOtherA-232293627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:35:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-278804fc-57b4-4261-b7c8-e31254fa07d3 req-ab8777e9-5ab3-40fc-9169-18baf4bbe45c tempest-ServerActionsTestOtherA-232293627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:35:31 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [req-278804fc-57b4-4261-b7c8-e31254fa07d3 req-ab8777e9-5ab3-40fc-9169-18baf4bbe45c tempest-ServerActionsTestOtherA-232293627 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff', 'name': 'volume-90d0d3b3-a480-45e5-9f6c-f7e2019cfdff', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1c9a6b01-ea8a-4c56-bf3e-5eea41e205e0', 'enforce_multipath': True} {{(pid=86136) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 18 21:35:31 devstack cinder-volume[86136]: INFO cinder.volume.manager [req-278804fc-57b4-4261-b7c8-e31254fa07d3 req-ab8777e9-5ab3-40fc-9169-18baf4bbe45c tempest-ServerActionsTestOtherA-232293627 None] attachment_update completed successfully. Sep 18 21:35:36 devstack cinder-volume[86136]: INFO cinder.volume.manager [req-771baa78-4498-4d22-9b0c-435fbd34beed req-8964e555-74af-418a-b51a-73a9e355ad72 tempest-ServerActionsTestOtherA-232293627 None] Terminate volume connection completed successfully. Sep 18 21:35:36 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [req-771baa78-4498-4d22-9b0c-435fbd34beed req-8964e555-74af-418a-b51a-73a9e355ad72 tempest-ServerActionsTestOtherA-232293627 None] Deleting attachment 1c9a6b01-ea8a-4c56-bf3e-5eea41e205e0. {{(pid=86136) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 18 21:35:37 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-771baa78-4498-4d22-9b0c-435fbd34beed req-178150d7-2cd9-4bd6-a828-ed16e01c5234 tempest-ServerActionsTestOtherA-232293627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:35:37 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-771baa78-4498-4d22-9b0c-435fbd34beed req-178150d7-2cd9-4bd6-a828-ed16e01c5234 tempest-ServerActionsTestOtherA-232293627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:35:37 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-771baa78-4498-4d22-9b0c-435fbd34beed req-178150d7-2cd9-4bd6-a828-ed16e01c5234 tempest-ServerActionsTestOtherA-232293627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:35:37 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [req-771baa78-4498-4d22-9b0c-435fbd34beed req-178150d7-2cd9-4bd6-a828-ed16e01c5234 tempest-ServerActionsTestOtherA-232293627 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff', 'name': 'volume-90d0d3b3-a480-45e5-9f6c-f7e2019cfdff', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '226f0a42-5a02-4121-a36e-627159f1939f', 'enforce_multipath': True} {{(pid=86136) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 18 21:35:37 devstack cinder-volume[86136]: INFO cinder.volume.manager [req-771baa78-4498-4d22-9b0c-435fbd34beed req-178150d7-2cd9-4bd6-a828-ed16e01c5234 tempest-ServerActionsTestOtherA-232293627 None] attachment_update completed successfully. Sep 18 21:35:46 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6919d9a-2ecd-4ed9-abdd-ba57a37f1395 tempest-VolumeQuotasAdminTestJSON-1317131634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:35:46 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f6919d9a-2ecd-4ed9-abdd-ba57a37f1395 tempest-VolumeQuotasAdminTestJSON-1317131634 None] Flow 'volume_create_manager' (2d2abdc5-d025-486a-b1b3-775eb96d60a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:35:46 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f6919d9a-2ecd-4ed9-abdd-ba57a37f1395 tempest-VolumeQuotasAdminTestJSON-1317131634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69659b59-9837-4951-8706-6d099850cabf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:35:46 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f6919d9a-2ecd-4ed9-abdd-ba57a37f1395 tempest-VolumeQuotasAdminTestJSON-1317131634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69659b59-9837-4951-8706-6d099850cabf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:35:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-809051710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07430f90-7d5c-4692-9f8d-44f3b5fc078b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a48e1a5e003b4c1b9670926e2b2b5c96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:35:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:35:46Z,use_quota=True,user_id='ab857cdd98a74fbb917ab97b95c758b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:35:46 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f6919d9a-2ecd-4ed9-abdd-ba57a37f1395 tempest-VolumeQuotasAdminTestJSON-1317131634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0406f69-44d0-4b30-8164-2533e3c37b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:35:46 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f6919d9a-2ecd-4ed9-abdd-ba57a37f1395 tempest-VolumeQuotasAdminTestJSON-1317131634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0406f69-44d0-4b30-8164-2533e3c37b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:35:46 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f6919d9a-2ecd-4ed9-abdd-ba57a37f1395 tempest-VolumeQuotasAdminTestJSON-1317131634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09563a4f-51a4-4150-ad0a-d6732b5b27a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:35:46 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f6919d9a-2ecd-4ed9-abdd-ba57a37f1395 tempest-VolumeQuotasAdminTestJSON-1317131634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09563a4f-51a4-4150-ad0a-d6732b5b27a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07430f90-7d5c-4692-9f8d-44f3b5fc078b', 'volume_name': 'volume-07430f90-7d5c-4692-9f8d-44f3b5fc078b', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:35:46 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f6919d9a-2ecd-4ed9-abdd-ba57a37f1395 tempest-VolumeQuotasAdminTestJSON-1317131634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8aa3cdf-2b26-41e6-bc87-ea9b100b925c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:35:46 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f6919d9a-2ecd-4ed9-abdd-ba57a37f1395 tempest-VolumeQuotasAdminTestJSON-1317131634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8aa3cdf-2b26-41e6-bc87-ea9b100b925c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:35:46 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f6919d9a-2ecd-4ed9-abdd-ba57a37f1395 tempest-VolumeQuotasAdminTestJSON-1317131634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05150a4e-d08b-4e36-922d-6e19aa87f5b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:35:46 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-f6919d9a-2ecd-4ed9-abdd-ba57a37f1395 tempest-VolumeQuotasAdminTestJSON-1317131634 None] Volume 07430f90-7d5c-4692-9f8d-44f3b5fc078b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07430f90-7d5c-4692-9f8d-44f3b5fc078b', 'volume_size': 1} Sep 18 21:35:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-f6919d9a-2ecd-4ed9-abdd-ba57a37f1395 tempest-VolumeQuotasAdminTestJSON-1317131634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:35:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-f6919d9a-2ecd-4ed9-abdd-ba57a37f1395 tempest-VolumeQuotasAdminTestJSON-1317131634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:35:46 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-f6919d9a-2ecd-4ed9-abdd-ba57a37f1395 tempest-VolumeQuotasAdminTestJSON-1317131634 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:35:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-809051710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07430f90-7d5c-4692-9f8d-44f3b5fc078b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a48e1a5e003b4c1b9670926e2b2b5c96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:35:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:35:46Z,use_quota=True,user_id='ab857cdd98a74fbb917ab97b95c758b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:35:46 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-f6919d9a-2ecd-4ed9-abdd-ba57a37f1395 tempest-VolumeQuotasAdminTestJSON-1317131634 None] Creating volume 07430f90-7d5c-4692-9f8d-44f3b5fc078b {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:35:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-f6919d9a-2ecd-4ed9-abdd-ba57a37f1395 tempest-VolumeQuotasAdminTestJSON-1317131634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:35:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-f6919d9a-2ecd-4ed9-abdd-ba57a37f1395 tempest-VolumeQuotasAdminTestJSON-1317131634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:35:46 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-f6919d9a-2ecd-4ed9-abdd-ba57a37f1395 tempest-VolumeQuotasAdminTestJSON-1317131634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:35:46 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-f6919d9a-2ecd-4ed9-abdd-ba57a37f1395 tempest-VolumeQuotasAdminTestJSON-1317131634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:35:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-f6919d9a-2ecd-4ed9-abdd-ba57a37f1395 tempest-VolumeQuotasAdminTestJSON-1317131634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:35:46 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-f6919d9a-2ecd-4ed9-abdd-ba57a37f1395 tempest-VolumeQuotasAdminTestJSON-1317131634 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:35:46 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-f6919d9a-2ecd-4ed9-abdd-ba57a37f1395 tempest-VolumeQuotasAdminTestJSON-1317131634 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:35:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f6919d9a-2ecd-4ed9-abdd-ba57a37f1395 tempest-VolumeQuotasAdminTestJSON-1317131634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-07430f90-7d5c-4692-9f8d-44f3b5fc078b 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:35:46 devstack sudo[90611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-07430f90-7d5c-4692-9f8d-44f3b5fc078b 1073741824 Sep 18 21:35:46 devstack sudo[90611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:35:47 devstack sudo[90611]: pam_unix(sudo:session): session closed for user root Sep 18 21:35:47 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f6919d9a-2ecd-4ed9-abdd-ba57a37f1395 tempest-VolumeQuotasAdminTestJSON-1317131634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-07430f90-7d5c-4692-9f8d-44f3b5fc078b 1073741824" returned: 0 in 0.683s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:35:47 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f6919d9a-2ecd-4ed9-abdd-ba57a37f1395 tempest-VolumeQuotasAdminTestJSON-1317131634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-07430f90-7d5c-4692-9f8d-44f3b5fc078b {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:35:47 devstack sudo[90618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-07430f90-7d5c-4692-9f8d-44f3b5fc078b Sep 18 21:35:47 devstack sudo[90618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:35:47 devstack sudo[90618]: pam_unix(sudo:session): session closed for user root Sep 18 21:35:47 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f6919d9a-2ecd-4ed9-abdd-ba57a37f1395 tempest-VolumeQuotasAdminTestJSON-1317131634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-07430f90-7d5c-4692-9f8d-44f3b5fc078b" returned: 0 in 0.346s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:35:47 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-f6919d9a-2ecd-4ed9-abdd-ba57a37f1395 tempest-VolumeQuotasAdminTestJSON-1317131634 None] <== create_volume: return (1100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:35:47 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-f6919d9a-2ecd-4ed9-abdd-ba57a37f1395 tempest-VolumeQuotasAdminTestJSON-1317131634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:35:47 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f6919d9a-2ecd-4ed9-abdd-ba57a37f1395 tempest-VolumeQuotasAdminTestJSON-1317131634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05150a4e-d08b-4e36-922d-6e19aa87f5b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07430f90-7d5c-4692-9f8d-44f3b5fc078b', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:35:47 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f6919d9a-2ecd-4ed9-abdd-ba57a37f1395 tempest-VolumeQuotasAdminTestJSON-1317131634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aab7fe7b-9a3b-400b-9bd2-345a6cc70554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:35:47 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-f6919d9a-2ecd-4ed9-abdd-ba57a37f1395 tempest-VolumeQuotasAdminTestJSON-1317131634 None] Volume volume-07430f90-7d5c-4692-9f8d-44f3b5fc078b (07430f90-7d5c-4692-9f8d-44f3b5fc078b): created successfully Sep 18 21:35:47 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f6919d9a-2ecd-4ed9-abdd-ba57a37f1395 tempest-VolumeQuotasAdminTestJSON-1317131634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aab7fe7b-9a3b-400b-9bd2-345a6cc70554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:35:47 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f6919d9a-2ecd-4ed9-abdd-ba57a37f1395 tempest-VolumeQuotasAdminTestJSON-1317131634 None] Flow 'volume_create_manager' (2d2abdc5-d025-486a-b1b3-775eb96d60a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:35:47 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-f6919d9a-2ecd-4ed9-abdd-ba57a37f1395 tempest-VolumeQuotasAdminTestJSON-1317131634 None] Created volume successfully. Sep 18 21:35:48 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-c04d7572-5c83-4298-b304-f1b3ffb4a2f1 tempest-VolumeQuotasAdminTestJSON-1317131634 None] Acquiring lock "cinder-07430f90-7d5c-4692-9f8d-44f3b5fc078b-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:35:48 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-c04d7572-5c83-4298-b304-f1b3ffb4a2f1 tempest-VolumeQuotasAdminTestJSON-1317131634 None] Lock "cinder-07430f90-7d5c-4692-9f8d-44f3b5fc078b-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:35:48 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-c04d7572-5c83-4298-b304-f1b3ffb4a2f1 tempest-VolumeQuotasAdminTestJSON-1317131634 None] Acquiring lock "cinder-quobyte-07430f90-7d5c-4692-9f8d-44f3b5fc078b" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:35:48 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-c04d7572-5c83-4298-b304-f1b3ffb4a2f1 tempest-VolumeQuotasAdminTestJSON-1317131634 None] Lock "cinder-quobyte-07430f90-7d5c-4692-9f8d-44f3b5fc078b" acquired by "delete_volume" :: waited 0.030s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:35:48 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c13ebf2-21b3-4106-8926-6f16b5928fc8]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:35:48 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c04d7572-5c83-4298-b304-f1b3ffb4a2f1 tempest-VolumeQuotasAdminTestJSON-1317131634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-07430f90-7d5c-4692-9f8d-44f3b5fc078b {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:35:48 devstack sudo[90621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-07430f90-7d5c-4692-9f8d-44f3b5fc078b Sep 18 21:35:48 devstack sudo[90621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:35:49 devstack sudo[90621]: pam_unix(sudo:session): session closed for user root Sep 18 21:35:49 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c04d7572-5c83-4298-b304-f1b3ffb4a2f1 tempest-VolumeQuotasAdminTestJSON-1317131634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-07430f90-7d5c-4692-9f8d-44f3b5fc078b" returned: 0 in 0.638s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:35:49 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c04d7572-5c83-4298-b304-f1b3ffb4a2f1 tempest-VolumeQuotasAdminTestJSON-1317131634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-07430f90-7d5c-4692-9f8d-44f3b5fc078b {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:35:49 devstack sudo[90632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-07430f90-7d5c-4692-9f8d-44f3b5fc078b Sep 18 21:35:49 devstack sudo[90632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:35:49 devstack sudo[90632]: pam_unix(sudo:session): session closed for user root Sep 18 21:35:49 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c04d7572-5c83-4298-b304-f1b3ffb4a2f1 tempest-VolumeQuotasAdminTestJSON-1317131634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-07430f90-7d5c-4692-9f8d-44f3b5fc078b" returned: 0 in 0.464s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:35:49 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-c04d7572-5c83-4298-b304-f1b3ffb4a2f1 tempest-VolumeQuotasAdminTestJSON-1317131634 None] Lock "cinder-quobyte-07430f90-7d5c-4692-9f8d-44f3b5fc078b" released by "delete_volume" :: held 1.175s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:35:49 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-c04d7572-5c83-4298-b304-f1b3ffb4a2f1 tempest-VolumeQuotasAdminTestJSON-1317131634 None] Created reservations ['c0d5ba80-d8d6-4bb9-8220-6f3f48a3278b', 'ed445d74-d537-4f0f-95a9-e4f5306ecba5', '5dbfb766-ab21-4adf-9f1c-5bb51de01d7e', '4bb6c3a3-670c-4f24-8b69-a9aeb408b242'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:35:50 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c04d7572-5c83-4298-b304-f1b3ffb4a2f1 tempest-VolumeQuotasAdminTestJSON-1317131634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:35:50 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c04d7572-5c83-4298-b304-f1b3ffb4a2f1 tempest-VolumeQuotasAdminTestJSON-1317131634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:35:50 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-c04d7572-5c83-4298-b304-f1b3ffb4a2f1 tempest-VolumeQuotasAdminTestJSON-1317131634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:35:50 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-c04d7572-5c83-4298-b304-f1b3ffb4a2f1 tempest-VolumeQuotasAdminTestJSON-1317131634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:35:50 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c04d7572-5c83-4298-b304-f1b3ffb4a2f1 tempest-VolumeQuotasAdminTestJSON-1317131634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:35:50 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c04d7572-5c83-4298-b304-f1b3ffb4a2f1 tempest-VolumeQuotasAdminTestJSON-1317131634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:35:50 devstack sudo[90645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:35:50 devstack sudo[90645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:35:50 devstack sudo[90645]: pam_unix(sudo:session): session closed for user root Sep 18 21:35:50 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c04d7572-5c83-4298-b304-f1b3ffb4a2f1 tempest-VolumeQuotasAdminTestJSON-1317131634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.408s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:35:50 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-c04d7572-5c83-4298-b304-f1b3ffb4a2f1 tempest-VolumeQuotasAdminTestJSON-1317131634 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:35:50 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-c04d7572-5c83-4298-b304-f1b3ffb4a2f1 tempest-VolumeQuotasAdminTestJSON-1317131634 None] Deleted volume successfully. Sep 18 21:35:50 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-c04d7572-5c83-4298-b304-f1b3ffb4a2f1 tempest-VolumeQuotasAdminTestJSON-1317131634 None] Lock "cinder-07430f90-7d5c-4692-9f8d-44f3b5fc078b-delete_volume" released by "delete_volume" :: held 1.986s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:35:51 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-720e8fb2-845b-45ef-a524-acbcdabfe8e2 tempest-VolumeQuotasAdminTestJSON-1317131634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:35:51 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-720e8fb2-845b-45ef-a524-acbcdabfe8e2 tempest-VolumeQuotasAdminTestJSON-1317131634 None] Flow 'volume_create_manager' (e0c284dc-9a9f-4bae-81c0-ec8f76a97204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:35:51 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-720e8fb2-845b-45ef-a524-acbcdabfe8e2 tempest-VolumeQuotasAdminTestJSON-1317131634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05d06f8d-3fb1-407a-9c49-f5fe373ae9f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:35:51 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-720e8fb2-845b-45ef-a524-acbcdabfe8e2 tempest-VolumeQuotasAdminTestJSON-1317131634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05d06f8d-3fb1-407a-9c49-f5fe373ae9f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:35:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-552049151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75023729-90ff-4c39-8e6b-b542da2cf4a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a48e1a5e003b4c1b9670926e2b2b5c96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:35:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:35:52Z,use_quota=True,user_id='ab857cdd98a74fbb917ab97b95c758b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:35:51 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-720e8fb2-845b-45ef-a524-acbcdabfe8e2 tempest-VolumeQuotasAdminTestJSON-1317131634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6acb714-f760-460b-9dd2-455d5b77957d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:35:51 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-720e8fb2-845b-45ef-a524-acbcdabfe8e2 tempest-VolumeQuotasAdminTestJSON-1317131634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6acb714-f760-460b-9dd2-455d5b77957d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:35:51 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-720e8fb2-845b-45ef-a524-acbcdabfe8e2 tempest-VolumeQuotasAdminTestJSON-1317131634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df930ac0-0b64-406c-a6af-a5bfe805af2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:35:51 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-720e8fb2-845b-45ef-a524-acbcdabfe8e2 tempest-VolumeQuotasAdminTestJSON-1317131634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df930ac0-0b64-406c-a6af-a5bfe805af2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75023729-90ff-4c39-8e6b-b542da2cf4a6', 'volume_name': 'volume-75023729-90ff-4c39-8e6b-b542da2cf4a6', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:35:51 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-720e8fb2-845b-45ef-a524-acbcdabfe8e2 tempest-VolumeQuotasAdminTestJSON-1317131634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39b2e76a-0caa-4271-bb15-10d9512ccf1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:35:51 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-720e8fb2-845b-45ef-a524-acbcdabfe8e2 tempest-VolumeQuotasAdminTestJSON-1317131634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39b2e76a-0caa-4271-bb15-10d9512ccf1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:35:51 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-720e8fb2-845b-45ef-a524-acbcdabfe8e2 tempest-VolumeQuotasAdminTestJSON-1317131634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6c5f780-13ec-44b5-8b88-3b9f4007ee74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:35:51 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-720e8fb2-845b-45ef-a524-acbcdabfe8e2 tempest-VolumeQuotasAdminTestJSON-1317131634 None] Volume 75023729-90ff-4c39-8e6b-b542da2cf4a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75023729-90ff-4c39-8e6b-b542da2cf4a6', 'volume_size': 1} Sep 18 21:35:51 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-720e8fb2-845b-45ef-a524-acbcdabfe8e2 tempest-VolumeQuotasAdminTestJSON-1317131634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:35:51 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-720e8fb2-845b-45ef-a524-acbcdabfe8e2 tempest-VolumeQuotasAdminTestJSON-1317131634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:35:51 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-720e8fb2-845b-45ef-a524-acbcdabfe8e2 tempest-VolumeQuotasAdminTestJSON-1317131634 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:35:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-552049151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75023729-90ff-4c39-8e6b-b542da2cf4a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a48e1a5e003b4c1b9670926e2b2b5c96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:35:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:35:52Z,use_quota=True,user_id='ab857cdd98a74fbb917ab97b95c758b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:35:51 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-720e8fb2-845b-45ef-a524-acbcdabfe8e2 tempest-VolumeQuotasAdminTestJSON-1317131634 None] Creating volume 75023729-90ff-4c39-8e6b-b542da2cf4a6 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:35:51 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-720e8fb2-845b-45ef-a524-acbcdabfe8e2 tempest-VolumeQuotasAdminTestJSON-1317131634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:35:51 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-720e8fb2-845b-45ef-a524-acbcdabfe8e2 tempest-VolumeQuotasAdminTestJSON-1317131634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:35:51 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-720e8fb2-845b-45ef-a524-acbcdabfe8e2 tempest-VolumeQuotasAdminTestJSON-1317131634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:35:51 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-720e8fb2-845b-45ef-a524-acbcdabfe8e2 tempest-VolumeQuotasAdminTestJSON-1317131634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:35:51 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-720e8fb2-845b-45ef-a524-acbcdabfe8e2 tempest-VolumeQuotasAdminTestJSON-1317131634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:35:51 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-720e8fb2-845b-45ef-a524-acbcdabfe8e2 tempest-VolumeQuotasAdminTestJSON-1317131634 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:35:51 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-720e8fb2-845b-45ef-a524-acbcdabfe8e2 tempest-VolumeQuotasAdminTestJSON-1317131634 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:35:51 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-720e8fb2-845b-45ef-a524-acbcdabfe8e2 tempest-VolumeQuotasAdminTestJSON-1317131634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-75023729-90ff-4c39-8e6b-b542da2cf4a6 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:35:51 devstack sudo[90664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-75023729-90ff-4c39-8e6b-b542da2cf4a6 1073741824 Sep 18 21:35:51 devstack sudo[90664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:35:52 devstack sudo[90664]: pam_unix(sudo:session): session closed for user root Sep 18 21:35:52 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-720e8fb2-845b-45ef-a524-acbcdabfe8e2 tempest-VolumeQuotasAdminTestJSON-1317131634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-75023729-90ff-4c39-8e6b-b542da2cf4a6 1073741824" returned: 0 in 0.485s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:35:52 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-720e8fb2-845b-45ef-a524-acbcdabfe8e2 tempest-VolumeQuotasAdminTestJSON-1317131634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-75023729-90ff-4c39-8e6b-b542da2cf4a6 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:35:52 devstack sudo[90669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-75023729-90ff-4c39-8e6b-b542da2cf4a6 Sep 18 21:35:52 devstack sudo[90669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:35:52 devstack sudo[90669]: pam_unix(sudo:session): session closed for user root Sep 18 21:35:52 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-720e8fb2-845b-45ef-a524-acbcdabfe8e2 tempest-VolumeQuotasAdminTestJSON-1317131634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-75023729-90ff-4c39-8e6b-b542da2cf4a6" returned: 0 in 0.266s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:35:52 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-720e8fb2-845b-45ef-a524-acbcdabfe8e2 tempest-VolumeQuotasAdminTestJSON-1317131634 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:35:52 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-720e8fb2-845b-45ef-a524-acbcdabfe8e2 tempest-VolumeQuotasAdminTestJSON-1317131634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:35:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-720e8fb2-845b-45ef-a524-acbcdabfe8e2 tempest-VolumeQuotasAdminTestJSON-1317131634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6c5f780-13ec-44b5-8b88-3b9f4007ee74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75023729-90ff-4c39-8e6b-b542da2cf4a6', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:35:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-720e8fb2-845b-45ef-a524-acbcdabfe8e2 tempest-VolumeQuotasAdminTestJSON-1317131634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68a950cb-4816-44a2-afbe-715b8d46f8e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:35:52 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-720e8fb2-845b-45ef-a524-acbcdabfe8e2 tempest-VolumeQuotasAdminTestJSON-1317131634 None] Volume volume-75023729-90ff-4c39-8e6b-b542da2cf4a6 (75023729-90ff-4c39-8e6b-b542da2cf4a6): created successfully Sep 18 21:35:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-720e8fb2-845b-45ef-a524-acbcdabfe8e2 tempest-VolumeQuotasAdminTestJSON-1317131634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68a950cb-4816-44a2-afbe-715b8d46f8e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:35:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-720e8fb2-845b-45ef-a524-acbcdabfe8e2 tempest-VolumeQuotasAdminTestJSON-1317131634 None] Flow 'volume_create_manager' (e0c284dc-9a9f-4bae-81c0-ec8f76a97204) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:35:52 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-720e8fb2-845b-45ef-a524-acbcdabfe8e2 tempest-VolumeQuotasAdminTestJSON-1317131634 None] Created volume successfully. Sep 18 21:35:54 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-882f2adb-fe47-4d88-b899-400b46a6873f tempest-VolumeQuotasAdminTestJSON-1815188640 None] Transfer volume completed successfully. Sep 18 21:35:55 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-5c46bf38-3221-42bb-b4dc-b00f986945c1 tempest-VolumeQuotasAdminTestJSON-875142567 None] Acquiring lock "cinder-75023729-90ff-4c39-8e6b-b542da2cf4a6-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:35:55 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-5c46bf38-3221-42bb-b4dc-b00f986945c1 tempest-VolumeQuotasAdminTestJSON-875142567 None] Lock "cinder-75023729-90ff-4c39-8e6b-b542da2cf4a6-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:35:55 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-5c46bf38-3221-42bb-b4dc-b00f986945c1 tempest-VolumeQuotasAdminTestJSON-875142567 None] Acquiring lock "cinder-quobyte-75023729-90ff-4c39-8e6b-b542da2cf4a6" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:35:55 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-5c46bf38-3221-42bb-b4dc-b00f986945c1 tempest-VolumeQuotasAdminTestJSON-875142567 None] Lock "cinder-quobyte-75023729-90ff-4c39-8e6b-b542da2cf4a6" acquired by "delete_volume" :: waited 0.023s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:35:55 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d5a676-eb8f-4963-97c2-6e1a8cb31575]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:35:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5c46bf38-3221-42bb-b4dc-b00f986945c1 tempest-VolumeQuotasAdminTestJSON-875142567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-75023729-90ff-4c39-8e6b-b542da2cf4a6 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:35:55 devstack sudo[90672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-75023729-90ff-4c39-8e6b-b542da2cf4a6 Sep 18 21:35:55 devstack sudo[90672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:35:56 devstack sudo[90672]: pam_unix(sudo:session): session closed for user root Sep 18 21:35:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5c46bf38-3221-42bb-b4dc-b00f986945c1 tempest-VolumeQuotasAdminTestJSON-875142567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-75023729-90ff-4c39-8e6b-b542da2cf4a6" returned: 0 in 0.532s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:35:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5c46bf38-3221-42bb-b4dc-b00f986945c1 tempest-VolumeQuotasAdminTestJSON-875142567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-75023729-90ff-4c39-8e6b-b542da2cf4a6 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:35:56 devstack sudo[90678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-75023729-90ff-4c39-8e6b-b542da2cf4a6 Sep 18 21:35:56 devstack sudo[90678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:35:56 devstack sudo[90678]: pam_unix(sudo:session): session closed for user root Sep 18 21:35:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5c46bf38-3221-42bb-b4dc-b00f986945c1 tempest-VolumeQuotasAdminTestJSON-875142567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-75023729-90ff-4c39-8e6b-b542da2cf4a6" returned: 0 in 0.392s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:35:56 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-5c46bf38-3221-42bb-b4dc-b00f986945c1 tempest-VolumeQuotasAdminTestJSON-875142567 None] Lock "cinder-quobyte-75023729-90ff-4c39-8e6b-b542da2cf4a6" released by "delete_volume" :: held 0.989s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:35:56 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-5c46bf38-3221-42bb-b4dc-b00f986945c1 tempest-VolumeQuotasAdminTestJSON-875142567 None] Created reservations ['2a21604d-8975-44cc-b084-638270b7ed2e', '19bf2d54-a43d-4e1a-92af-2aa6d4e68209', '6b5dc544-ccf0-4bde-9051-7e0d5928b627', '4decb405-66df-4bd5-8c01-faf790c9cc30'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:35:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-5c46bf38-3221-42bb-b4dc-b00f986945c1 tempest-VolumeQuotasAdminTestJSON-875142567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:35:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-5c46bf38-3221-42bb-b4dc-b00f986945c1 tempest-VolumeQuotasAdminTestJSON-875142567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:35:56 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-5c46bf38-3221-42bb-b4dc-b00f986945c1 tempest-VolumeQuotasAdminTestJSON-875142567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:35:56 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-5c46bf38-3221-42bb-b4dc-b00f986945c1 tempest-VolumeQuotasAdminTestJSON-875142567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:35:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-5c46bf38-3221-42bb-b4dc-b00f986945c1 tempest-VolumeQuotasAdminTestJSON-875142567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:35:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5c46bf38-3221-42bb-b4dc-b00f986945c1 tempest-VolumeQuotasAdminTestJSON-875142567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:35:56 devstack sudo[90687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:35:56 devstack sudo[90687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:35:57 devstack sudo[90687]: pam_unix(sudo:session): session closed for user root Sep 18 21:35:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5c46bf38-3221-42bb-b4dc-b00f986945c1 tempest-VolumeQuotasAdminTestJSON-875142567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.543s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:35:57 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-5c46bf38-3221-42bb-b4dc-b00f986945c1 tempest-VolumeQuotasAdminTestJSON-875142567 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:35:57 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-5c46bf38-3221-42bb-b4dc-b00f986945c1 tempest-VolumeQuotasAdminTestJSON-875142567 None] Deleted volume successfully. Sep 18 21:35:57 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-5c46bf38-3221-42bb-b4dc-b00f986945c1 tempest-VolumeQuotasAdminTestJSON-875142567 None] Lock "cinder-75023729-90ff-4c39-8e6b-b542da2cf4a6-delete_volume" released by "delete_volume" :: held 1.922s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:36:05 devstack cinder-volume[86136]: DEBUG oslo_service.periodic_task [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86136) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 21:36:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:36:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:36:05 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:36:05 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:36:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:36:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:36:05 devstack sudo[90767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:36:05 devstack sudo[90767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:36:05 devstack sudo[90767]: pam_unix(sudo:session): session closed for user root Sep 18 21:36:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.431s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:36:05 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:36:05 devstack cinder-volume[86136]: DEBUG oslo_service.periodic_task [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Running periodic task VolumeManager._thread_info {{(pid=86136) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 21:36:05 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] thread count: 8 {{(pid=86136) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 18 21:36:05 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] thread info: [<_MainThread(MainThread, started 138548347871360)>, , , , , , , ] {{(pid=86136) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 18 21:36:05 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-24676671-2831-4ff0-a517-1cf7225debda tempest-AttachVolumeShelveTestJSON-544571647 None] Acquiring lock "cinder-4be57fb4-3f00-40ea-8d38-4ce1bdbd37ac-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:36:05 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-24676671-2831-4ff0-a517-1cf7225debda tempest-AttachVolumeShelveTestJSON-544571647 None] Lock "cinder-4be57fb4-3f00-40ea-8d38-4ce1bdbd37ac-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:36:05 devstack cinder-volume[86136]: DEBUG dbcounter [-] [86136] Writing DB stats cinder:UPDATE=69,cinder:SELECT=72,cinder:INSERT=16,cinder:DELETE=3 {{(pid=86136) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 21:36:05 devstack cinder-volume[86136]: DEBUG dbcounter [-] [86136] Writing DB stats cinder:UPDATE=69,cinder:SELECT=69,cinder:INSERT=11,cinder:DELETE=4 {{(pid=86136) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 21:36:05 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-24676671-2831-4ff0-a517-1cf7225debda tempest-AttachVolumeShelveTestJSON-544571647 None] Acquiring lock "cinder-quobyte-4be57fb4-3f00-40ea-8d38-4ce1bdbd37ac" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:36:06 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-24676671-2831-4ff0-a517-1cf7225debda tempest-AttachVolumeShelveTestJSON-544571647 None] Lock "cinder-quobyte-4be57fb4-3f00-40ea-8d38-4ce1bdbd37ac" acquired by "delete_volume" :: waited 0.023s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:36:06 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b2908e7-5cb1-45ef-9511-90f6d135475d]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:36:06 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-24676671-2831-4ff0-a517-1cf7225debda tempest-AttachVolumeShelveTestJSON-544571647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4be57fb4-3f00-40ea-8d38-4ce1bdbd37ac {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:36:06 devstack sudo[90771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4be57fb4-3f00-40ea-8d38-4ce1bdbd37ac Sep 18 21:36:06 devstack sudo[90771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:36:06 devstack sudo[90771]: pam_unix(sudo:session): session closed for user root Sep 18 21:36:06 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-24676671-2831-4ff0-a517-1cf7225debda tempest-AttachVolumeShelveTestJSON-544571647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4be57fb4-3f00-40ea-8d38-4ce1bdbd37ac" returned: 0 in 0.475s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:36:06 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-24676671-2831-4ff0-a517-1cf7225debda tempest-AttachVolumeShelveTestJSON-544571647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4be57fb4-3f00-40ea-8d38-4ce1bdbd37ac {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:36:06 devstack sudo[90780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4be57fb4-3f00-40ea-8d38-4ce1bdbd37ac Sep 18 21:36:06 devstack sudo[90780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:36:06 devstack sudo[90780]: pam_unix(sudo:session): session closed for user root Sep 18 21:36:06 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-24676671-2831-4ff0-a517-1cf7225debda tempest-AttachVolumeShelveTestJSON-544571647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4be57fb4-3f00-40ea-8d38-4ce1bdbd37ac" returned: 0 in 0.440s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:36:07 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-24676671-2831-4ff0-a517-1cf7225debda tempest-AttachVolumeShelveTestJSON-544571647 None] Lock "cinder-quobyte-4be57fb4-3f00-40ea-8d38-4ce1bdbd37ac" released by "delete_volume" :: held 0.997s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:36:07 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-24676671-2831-4ff0-a517-1cf7225debda tempest-AttachVolumeShelveTestJSON-544571647 None] Created reservations ['933df024-63cc-4af9-a76f-fff9a12e4b66', '5b86afe1-0f7a-447d-ad50-1f5eb6883f73', 'c16d1e98-65f6-4dba-9f52-973b4c36a44e', 'c30bf807-fdf6-42bf-9337-3829f1556825'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:36:07 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-24676671-2831-4ff0-a517-1cf7225debda tempest-AttachVolumeShelveTestJSON-544571647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:36:07 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-24676671-2831-4ff0-a517-1cf7225debda tempest-AttachVolumeShelveTestJSON-544571647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:36:07 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-24676671-2831-4ff0-a517-1cf7225debda tempest-AttachVolumeShelveTestJSON-544571647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:36:07 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-24676671-2831-4ff0-a517-1cf7225debda tempest-AttachVolumeShelveTestJSON-544571647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:36:07 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-24676671-2831-4ff0-a517-1cf7225debda tempest-AttachVolumeShelveTestJSON-544571647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:36:07 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-24676671-2831-4ff0-a517-1cf7225debda tempest-AttachVolumeShelveTestJSON-544571647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:36:07 devstack sudo[90788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:36:07 devstack sudo[90788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:36:07 devstack sudo[90788]: pam_unix(sudo:session): session closed for user root Sep 18 21:36:07 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-24676671-2831-4ff0-a517-1cf7225debda tempest-AttachVolumeShelveTestJSON-544571647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.325s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:36:07 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-24676671-2831-4ff0-a517-1cf7225debda tempest-AttachVolumeShelveTestJSON-544571647 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:36:07 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-24676671-2831-4ff0-a517-1cf7225debda tempest-AttachVolumeShelveTestJSON-544571647 None] Deleted volume successfully. Sep 18 21:36:07 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-24676671-2831-4ff0-a517-1cf7225debda tempest-AttachVolumeShelveTestJSON-544571647 None] Lock "cinder-4be57fb4-3f00-40ea-8d38-4ce1bdbd37ac-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:36:08 devstack cinder-volume[86136]: INFO cinder.volume.manager [req-f18c2538-a2b6-4f33-949d-06ca1d59f2a2 req-9a5bfdd0-ea0d-4a82-9f6a-abb0b41d0271 tempest-ServerActionsTestOtherA-232293627 None] Terminate volume connection completed successfully. Sep 18 21:36:08 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [req-f18c2538-a2b6-4f33-949d-06ca1d59f2a2 req-9a5bfdd0-ea0d-4a82-9f6a-abb0b41d0271 tempest-ServerActionsTestOtherA-232293627 None] Deleting attachment 226f0a42-5a02-4121-a36e-627159f1939f. {{(pid=86136) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 18 21:36:09 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-f38c4902-0a03-4053-9a17-93b9727c1ec3 tempest-VolumeQuotasNegativeTestJSON-955412057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:36:09 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f38c4902-0a03-4053-9a17-93b9727c1ec3 tempest-VolumeQuotasNegativeTestJSON-955412057 None] Flow 'volume_create_manager' (ce42f320-0647-460d-a4ff-270b60977a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:36:09 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f38c4902-0a03-4053-9a17-93b9727c1ec3 tempest-VolumeQuotasNegativeTestJSON-955412057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f78aad7-0e3f-420c-806b-dbc0dc2c77ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:36:09 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f38c4902-0a03-4053-9a17-93b9727c1ec3 tempest-VolumeQuotasNegativeTestJSON-955412057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f78aad7-0e3f-420c-806b-dbc0dc2c77ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:36:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-679865558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=726d7c01-a9ad-4e74-a459-34e2e66d13b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e286795d82284ef69cdbe479c0a85abd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:36:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:36:10Z,use_quota=True,user_id='24e0ea43773f458dbdb1bbcf8ea8b00c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:36:09 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f38c4902-0a03-4053-9a17-93b9727c1ec3 tempest-VolumeQuotasNegativeTestJSON-955412057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f144d7b-c56f-4f61-8cef-00772a4e42b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:36:09 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f38c4902-0a03-4053-9a17-93b9727c1ec3 tempest-VolumeQuotasNegativeTestJSON-955412057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f144d7b-c56f-4f61-8cef-00772a4e42b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:36:09 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f38c4902-0a03-4053-9a17-93b9727c1ec3 tempest-VolumeQuotasNegativeTestJSON-955412057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (440d8fab-1b9f-40f5-824e-17e686255bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:36:09 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f38c4902-0a03-4053-9a17-93b9727c1ec3 tempest-VolumeQuotasNegativeTestJSON-955412057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (440d8fab-1b9f-40f5-824e-17e686255bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '726d7c01-a9ad-4e74-a459-34e2e66d13b5', 'volume_name': 'volume-726d7c01-a9ad-4e74-a459-34e2e66d13b5', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:36:09 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f38c4902-0a03-4053-9a17-93b9727c1ec3 tempest-VolumeQuotasNegativeTestJSON-955412057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (394d0c2b-ff35-4105-97aa-c0c4d1f60372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:36:09 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f38c4902-0a03-4053-9a17-93b9727c1ec3 tempest-VolumeQuotasNegativeTestJSON-955412057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (394d0c2b-ff35-4105-97aa-c0c4d1f60372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:36:09 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f38c4902-0a03-4053-9a17-93b9727c1ec3 tempest-VolumeQuotasNegativeTestJSON-955412057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaf4edd9-e707-4847-8abe-c1dc34be6778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:36:09 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-f38c4902-0a03-4053-9a17-93b9727c1ec3 tempest-VolumeQuotasNegativeTestJSON-955412057 None] Volume 726d7c01-a9ad-4e74-a459-34e2e66d13b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-726d7c01-a9ad-4e74-a459-34e2e66d13b5', 'volume_size': 1} Sep 18 21:36:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-f38c4902-0a03-4053-9a17-93b9727c1ec3 tempest-VolumeQuotasNegativeTestJSON-955412057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:36:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-f38c4902-0a03-4053-9a17-93b9727c1ec3 tempest-VolumeQuotasNegativeTestJSON-955412057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:36:09 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-f38c4902-0a03-4053-9a17-93b9727c1ec3 tempest-VolumeQuotasNegativeTestJSON-955412057 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:36:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-679865558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=726d7c01-a9ad-4e74-a459-34e2e66d13b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e286795d82284ef69cdbe479c0a85abd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:36:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:36:10Z,use_quota=True,user_id='24e0ea43773f458dbdb1bbcf8ea8b00c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:36:09 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-f38c4902-0a03-4053-9a17-93b9727c1ec3 tempest-VolumeQuotasNegativeTestJSON-955412057 None] Creating volume 726d7c01-a9ad-4e74-a459-34e2e66d13b5 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:36:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-f38c4902-0a03-4053-9a17-93b9727c1ec3 tempest-VolumeQuotasNegativeTestJSON-955412057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:36:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-f38c4902-0a03-4053-9a17-93b9727c1ec3 tempest-VolumeQuotasNegativeTestJSON-955412057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:36:09 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-f38c4902-0a03-4053-9a17-93b9727c1ec3 tempest-VolumeQuotasNegativeTestJSON-955412057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:36:09 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-f38c4902-0a03-4053-9a17-93b9727c1ec3 tempest-VolumeQuotasNegativeTestJSON-955412057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:36:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-f38c4902-0a03-4053-9a17-93b9727c1ec3 tempest-VolumeQuotasNegativeTestJSON-955412057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:36:09 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-f38c4902-0a03-4053-9a17-93b9727c1ec3 tempest-VolumeQuotasNegativeTestJSON-955412057 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:36:09 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-f38c4902-0a03-4053-9a17-93b9727c1ec3 tempest-VolumeQuotasNegativeTestJSON-955412057 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:36:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f38c4902-0a03-4053-9a17-93b9727c1ec3 tempest-VolumeQuotasNegativeTestJSON-955412057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-726d7c01-a9ad-4e74-a459-34e2e66d13b5 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:36:10 devstack sudo[90819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-726d7c01-a9ad-4e74-a459-34e2e66d13b5 1073741824 Sep 18 21:36:10 devstack sudo[90819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:36:10 devstack sudo[90819]: pam_unix(sudo:session): session closed for user root Sep 18 21:36:10 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f38c4902-0a03-4053-9a17-93b9727c1ec3 tempest-VolumeQuotasNegativeTestJSON-955412057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-726d7c01-a9ad-4e74-a459-34e2e66d13b5 1073741824" returned: 0 in 0.672s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:36:10 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f38c4902-0a03-4053-9a17-93b9727c1ec3 tempest-VolumeQuotasNegativeTestJSON-955412057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-726d7c01-a9ad-4e74-a459-34e2e66d13b5 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:36:10 devstack sudo[90845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-726d7c01-a9ad-4e74-a459-34e2e66d13b5 Sep 18 21:36:10 devstack sudo[90845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:36:11 devstack sudo[90845]: pam_unix(sudo:session): session closed for user root Sep 18 21:36:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f38c4902-0a03-4053-9a17-93b9727c1ec3 tempest-VolumeQuotasNegativeTestJSON-955412057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-726d7c01-a9ad-4e74-a459-34e2e66d13b5" returned: 0 in 0.339s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:36:11 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-f38c4902-0a03-4053-9a17-93b9727c1ec3 tempest-VolumeQuotasNegativeTestJSON-955412057 None] <== create_volume: return (1080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:36:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-f38c4902-0a03-4053-9a17-93b9727c1ec3 tempest-VolumeQuotasNegativeTestJSON-955412057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:36:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f38c4902-0a03-4053-9a17-93b9727c1ec3 tempest-VolumeQuotasNegativeTestJSON-955412057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaf4edd9-e707-4847-8abe-c1dc34be6778) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-726d7c01-a9ad-4e74-a459-34e2e66d13b5', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:36:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f38c4902-0a03-4053-9a17-93b9727c1ec3 tempest-VolumeQuotasNegativeTestJSON-955412057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfc1231f-6fbc-48cc-acae-0cdb0698bba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:36:11 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-f38c4902-0a03-4053-9a17-93b9727c1ec3 tempest-VolumeQuotasNegativeTestJSON-955412057 None] Volume volume-726d7c01-a9ad-4e74-a459-34e2e66d13b5 (726d7c01-a9ad-4e74-a459-34e2e66d13b5): created successfully Sep 18 21:36:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f38c4902-0a03-4053-9a17-93b9727c1ec3 tempest-VolumeQuotasNegativeTestJSON-955412057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfc1231f-6fbc-48cc-acae-0cdb0698bba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:36:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f38c4902-0a03-4053-9a17-93b9727c1ec3 tempest-VolumeQuotasNegativeTestJSON-955412057 None] Flow 'volume_create_manager' (ce42f320-0647-460d-a4ff-270b60977a8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:36:11 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-f38c4902-0a03-4053-9a17-93b9727c1ec3 tempest-VolumeQuotasNegativeTestJSON-955412057 None] Created volume successfully. Sep 18 21:36:13 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-ff7e97f0-208d-4f71-8ca6-da6b67617f0c tempest-VolumeQuotasNegativeTestJSON-955412057 None] Acquiring lock "cinder-726d7c01-a9ad-4e74-a459-34e2e66d13b5-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:36:13 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-ff7e97f0-208d-4f71-8ca6-da6b67617f0c tempest-VolumeQuotasNegativeTestJSON-955412057 None] Lock "cinder-726d7c01-a9ad-4e74-a459-34e2e66d13b5-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:36:13 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-ff7e97f0-208d-4f71-8ca6-da6b67617f0c tempest-VolumeQuotasNegativeTestJSON-955412057 None] Acquiring lock "cinder-quobyte-726d7c01-a9ad-4e74-a459-34e2e66d13b5" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:36:13 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-ff7e97f0-208d-4f71-8ca6-da6b67617f0c tempest-VolumeQuotasNegativeTestJSON-955412057 None] Lock "cinder-quobyte-726d7c01-a9ad-4e74-a459-34e2e66d13b5" acquired by "delete_volume" :: waited 0.031s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:36:13 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[d619ab61-9b3a-4511-84ce-a12c5664d859]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:36:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ff7e97f0-208d-4f71-8ca6-da6b67617f0c tempest-VolumeQuotasNegativeTestJSON-955412057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-726d7c01-a9ad-4e74-a459-34e2e66d13b5 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:36:14 devstack sudo[90946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-726d7c01-a9ad-4e74-a459-34e2e66d13b5 Sep 18 21:36:14 devstack sudo[90946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:36:14 devstack sudo[90946]: pam_unix(sudo:session): session closed for user root Sep 18 21:36:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ff7e97f0-208d-4f71-8ca6-da6b67617f0c tempest-VolumeQuotasNegativeTestJSON-955412057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-726d7c01-a9ad-4e74-a459-34e2e66d13b5" returned: 0 in 0.557s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:36:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ff7e97f0-208d-4f71-8ca6-da6b67617f0c tempest-VolumeQuotasNegativeTestJSON-955412057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-726d7c01-a9ad-4e74-a459-34e2e66d13b5 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:36:14 devstack sudo[90960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-726d7c01-a9ad-4e74-a459-34e2e66d13b5 Sep 18 21:36:14 devstack sudo[90960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:36:15 devstack sudo[90960]: pam_unix(sudo:session): session closed for user root Sep 18 21:36:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ff7e97f0-208d-4f71-8ca6-da6b67617f0c tempest-VolumeQuotasNegativeTestJSON-955412057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-726d7c01-a9ad-4e74-a459-34e2e66d13b5" returned: 0 in 0.528s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:36:15 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-ff7e97f0-208d-4f71-8ca6-da6b67617f0c tempest-VolumeQuotasNegativeTestJSON-955412057 None] Lock "cinder-quobyte-726d7c01-a9ad-4e74-a459-34e2e66d13b5" released by "delete_volume" :: held 1.185s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:36:15 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-ff7e97f0-208d-4f71-8ca6-da6b67617f0c tempest-VolumeQuotasNegativeTestJSON-955412057 None] Created reservations ['d4e2e611-ad24-4ee5-a027-2c07f2d062a5', '73dde0ab-06ca-4afc-a15a-b718bacfb788', '3124a004-4cd3-43b9-9542-264df8122f2e', '15f5a05f-0596-4f84-acfa-6abd8e55a410'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:36:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-ff7e97f0-208d-4f71-8ca6-da6b67617f0c tempest-VolumeQuotasNegativeTestJSON-955412057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:36:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-ff7e97f0-208d-4f71-8ca6-da6b67617f0c tempest-VolumeQuotasNegativeTestJSON-955412057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:36:15 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-ff7e97f0-208d-4f71-8ca6-da6b67617f0c tempest-VolumeQuotasNegativeTestJSON-955412057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:36:15 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-ff7e97f0-208d-4f71-8ca6-da6b67617f0c tempest-VolumeQuotasNegativeTestJSON-955412057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:36:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-ff7e97f0-208d-4f71-8ca6-da6b67617f0c tempest-VolumeQuotasNegativeTestJSON-955412057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:36:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ff7e97f0-208d-4f71-8ca6-da6b67617f0c tempest-VolumeQuotasNegativeTestJSON-955412057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:36:15 devstack sudo[90968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:36:15 devstack sudo[90968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:36:15 devstack sudo[90968]: pam_unix(sudo:session): session closed for user root Sep 18 21:36:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ff7e97f0-208d-4f71-8ca6-da6b67617f0c tempest-VolumeQuotasNegativeTestJSON-955412057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.306s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:36:15 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-ff7e97f0-208d-4f71-8ca6-da6b67617f0c tempest-VolumeQuotasNegativeTestJSON-955412057 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:36:15 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-ff7e97f0-208d-4f71-8ca6-da6b67617f0c tempest-VolumeQuotasNegativeTestJSON-955412057 None] Deleted volume successfully. Sep 18 21:36:15 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-ff7e97f0-208d-4f71-8ca6-da6b67617f0c tempest-VolumeQuotasNegativeTestJSON-955412057 None] Lock "cinder-726d7c01-a9ad-4e74-a459-34e2e66d13b5-delete_volume" released by "delete_volume" :: held 1.951s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:36:19 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-736ea9b0-a02f-4d95-b44b-6855e7f8f3da tempest-ServerActionsTestOtherA-232293627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:36:19 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-736ea9b0-a02f-4d95-b44b-6855e7f8f3da tempest-ServerActionsTestOtherA-232293627 None] Flow 'volume_create_manager' (26cc252c-0dc8-4adf-9dd3-28d5a9996172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:36:19 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-736ea9b0-a02f-4d95-b44b-6855e7f8f3da tempest-ServerActionsTestOtherA-232293627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b813aa0-4a30-4682-b1fa-f69bd02613a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:36:19 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-736ea9b0-a02f-4d95-b44b-6855e7f8f3da tempest-ServerActionsTestOtherA-232293627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b813aa0-4a30-4682-b1fa-f69bd02613a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:36:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1911084884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ab86e2d-fb18-4f12-bb73-cece1359268e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f884806450a14e63b1e007cb6396e40e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:36:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:36:19Z,use_quota=True,user_id='5b45b61bc84e4e97964b2e63ff7478c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:36:19 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-736ea9b0-a02f-4d95-b44b-6855e7f8f3da tempest-ServerActionsTestOtherA-232293627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df8269ce-874b-436d-98f0-632e0c388842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:36:19 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-736ea9b0-a02f-4d95-b44b-6855e7f8f3da tempest-ServerActionsTestOtherA-232293627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df8269ce-874b-436d-98f0-632e0c388842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:36:19 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-736ea9b0-a02f-4d95-b44b-6855e7f8f3da tempest-ServerActionsTestOtherA-232293627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e56e4eb2-d09b-4a69-b78b-9d827b424471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:36:19 devstack cinder-volume[86136]: DEBUG cinder.image.glance [None req-736ea9b0-a02f-4d95-b44b-6855e7f8f3da tempest-ServerActionsTestOtherA-232293627 None] Creating Keystone auth plugin from conf {{(pid=86136) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 18 21:36:20 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-736ea9b0-a02f-4d95-b44b-6855e7f8f3da tempest-ServerActionsTestOtherA-232293627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e56e4eb2-d09b-4a69-b78b-9d827b424471) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4ab86e2d-fb18-4f12-bb73-cece1359268e', 'volume_name': 'volume-4ab86e2d-fb18-4f12-bb73-cece1359268e', 'volume_size': 1, 'image_id': 'a7adbe6d-c72a-4ef2-82c6-e788c5101a2c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a7adbe6d-c72a-4ef2-82c6-e788c5101a2c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'eae9b2cfe4f146fb9d7ac38006d73cd9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a7adbe6d-c72a-4ef2-82c6-e788c5101a2c', 'created_at': datetime.datetime(2026, 9, 18, 19, 27, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 18, 19, 27, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a7adbe6d-c72a-4ef2-82c6-e788c5101a2c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:36:20 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-736ea9b0-a02f-4d95-b44b-6855e7f8f3da tempest-ServerActionsTestOtherA-232293627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3ec9d8c-c050-4608-a2e5-2b4b5d5dc6e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:36:20 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-736ea9b0-a02f-4d95-b44b-6855e7f8f3da tempest-ServerActionsTestOtherA-232293627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3ec9d8c-c050-4608-a2e5-2b4b5d5dc6e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:36:20 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-736ea9b0-a02f-4d95-b44b-6855e7f8f3da tempest-ServerActionsTestOtherA-232293627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92ab3acd-8ab5-44b5-9c88-f2a26dd81054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:36:20 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-736ea9b0-a02f-4d95-b44b-6855e7f8f3da tempest-ServerActionsTestOtherA-232293627 None] Volume 4ab86e2d-fb18-4f12-bb73-cece1359268e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4ab86e2d-fb18-4f12-bb73-cece1359268e', 'volume_size': 1, 'image_id': 'a7adbe6d-c72a-4ef2-82c6-e788c5101a2c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a7adbe6d-c72a-4ef2-82c6-e788c5101a2c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'eae9b2cfe4f146fb9d7ac38006d73cd9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a7adbe6d-c72a-4ef2-82c6-e788c5101a2c', 'created_at': datetime.datetime(2026, 9, 18, 19, 27, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 18, 19, 27, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a7adbe6d-c72a-4ef2-82c6-e788c5101a2c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 18 21:36:20 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-736ea9b0-a02f-4d95-b44b-6855e7f8f3da tempest-ServerActionsTestOtherA-232293627 None] Trying to clone 4ab86e2d-fb18-4f12-bb73-cece1359268e from image a7adbe6d-c72a-4ef2-82c6-e788c5101a2c at location (None, [{'url': 'file:///opt/stack/data/glance/images/a7adbe6d-c72a-4ef2-82c6-e788c5101a2c', 'metadata': {}}]). {{(pid=86136) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 18 21:36:21 devstack cinder-volume[86136]: DEBUG cinder.image.image_utils [None req-736ea9b0-a02f-4d95-b44b-6855e7f8f3da tempest-ServerActionsTestOtherA-232293627 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_zyvth33edevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86136) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 18 21:36:21 devstack cinder-volume[86136]: INFO cinder.image.image_utils [None req-736ea9b0-a02f-4d95-b44b-6855e7f8f3da tempest-ServerActionsTestOtherA-232293627 None] Image download 20.69 MB at 20.69 MB/s Sep 18 21:36:21 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[135791d7-100d-4631-8184-a1f953232a9f]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:36:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-736ea9b0-a02f-4d95-b44b-6855e7f8f3da tempest-ServerActionsTestOtherA-232293627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_zyvth33edevstack@QuobyteHD {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:36:21 devstack sudo[90999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_zyvth33edevstack@QuobyteHD Sep 18 21:36:21 devstack sudo[90999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:36:21 devstack sudo[90999]: pam_unix(sudo:session): session closed for user root Sep 18 21:36:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-736ea9b0-a02f-4d95-b44b-6855e7f8f3da tempest-ServerActionsTestOtherA-232293627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_zyvth33edevstack@QuobyteHD" returned: 0 in 0.450s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:36:21 devstack cinder-volume[86136]: DEBUG cinder.image.image_utils [None req-736ea9b0-a02f-4d95-b44b-6855e7f8f3da tempest-ServerActionsTestOtherA-232293627 None] Temporary image a7adbe6d-c72a-4ef2-82c6-e788c5101a2c is fetched for user 5b45b61bc84e4e97964b2e63ff7478c9. {{(pid=86136) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 18 21:36:21 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd82382e-8e8d-4eaf-b942-1ec4326e8002]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:36:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-736ea9b0-a02f-4d95-b44b-6855e7f8f3da tempest-ServerActionsTestOtherA-232293627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_zyvth33edevstack@QuobyteHD {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:36:21 devstack sudo[91005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_zyvth33edevstack@QuobyteHD Sep 18 21:36:21 devstack sudo[91005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:36:22 devstack sudo[91005]: pam_unix(sudo:session): session closed for user root Sep 18 21:36:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-736ea9b0-a02f-4d95-b44b-6855e7f8f3da tempest-ServerActionsTestOtherA-232293627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_zyvth33edevstack@QuobyteHD" returned: 0 in 0.640s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:36:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-736ea9b0-a02f-4d95-b44b-6855e7f8f3da tempest-ServerActionsTestOtherA-232293627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:36:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-736ea9b0-a02f-4d95-b44b-6855e7f8f3da tempest-ServerActionsTestOtherA-232293627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:36:22 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-736ea9b0-a02f-4d95-b44b-6855e7f8f3da tempest-ServerActionsTestOtherA-232293627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:36:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1911084884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ab86e2d-fb18-4f12-bb73-cece1359268e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f884806450a14e63b1e007cb6396e40e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:36:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:36:19Z,use_quota=True,user_id='5b45b61bc84e4e97964b2e63ff7478c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:36:22 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-736ea9b0-a02f-4d95-b44b-6855e7f8f3da tempest-ServerActionsTestOtherA-232293627 None] Creating volume 4ab86e2d-fb18-4f12-bb73-cece1359268e {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:36:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-736ea9b0-a02f-4d95-b44b-6855e7f8f3da tempest-ServerActionsTestOtherA-232293627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:36:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-736ea9b0-a02f-4d95-b44b-6855e7f8f3da tempest-ServerActionsTestOtherA-232293627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:36:22 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-736ea9b0-a02f-4d95-b44b-6855e7f8f3da tempest-ServerActionsTestOtherA-232293627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:36:22 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-736ea9b0-a02f-4d95-b44b-6855e7f8f3da tempest-ServerActionsTestOtherA-232293627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:36:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-736ea9b0-a02f-4d95-b44b-6855e7f8f3da tempest-ServerActionsTestOtherA-232293627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:36:22 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-736ea9b0-a02f-4d95-b44b-6855e7f8f3da tempest-ServerActionsTestOtherA-232293627 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:36:22 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-736ea9b0-a02f-4d95-b44b-6855e7f8f3da tempest-ServerActionsTestOtherA-232293627 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:36:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-736ea9b0-a02f-4d95-b44b-6855e7f8f3da tempest-ServerActionsTestOtherA-232293627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4ab86e2d-fb18-4f12-bb73-cece1359268e 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:36:22 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [req-c6ec56dd-a51e-4be2-8e65-a884f2ee27e0 req-c194e560-d7fc-412f-9016-0379b4c60fdf tempest-VolumesGetTestJSON-1930228810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:36:22 devstack sudo[91010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4ab86e2d-fb18-4f12-bb73-cece1359268e 1073741824 Sep 18 21:36:22 devstack sudo[91010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:36:22 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [req-c6ec56dd-a51e-4be2-8e65-a884f2ee27e0 req-c194e560-d7fc-412f-9016-0379b4c60fdf tempest-VolumesGetTestJSON-1930228810 None] Flow 'volume_create_manager' (b283f0fa-188b-4f64-bcce-175b254ab1a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:36:22 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [req-c6ec56dd-a51e-4be2-8e65-a884f2ee27e0 req-c194e560-d7fc-412f-9016-0379b4c60fdf tempest-VolumesGetTestJSON-1930228810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e98cd37-11fe-4489-9582-8e2f99b7dd96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:36:22 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [req-c6ec56dd-a51e-4be2-8e65-a884f2ee27e0 req-c194e560-d7fc-412f-9016-0379b4c60fdf tempest-VolumesGetTestJSON-1930228810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e98cd37-11fe-4489-9582-8e2f99b7dd96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1332453063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3034f8e3-f8ab-45c0-ae1f-08f015e7d642,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='daa129ad6b7047f0a182afb6bcd96f0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:36:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:36:22Z,use_quota=True,user_id='30461dfe3bc54137a0bccf455b184d89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:36:22 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [req-c6ec56dd-a51e-4be2-8e65-a884f2ee27e0 req-c194e560-d7fc-412f-9016-0379b4c60fdf tempest-VolumesGetTestJSON-1930228810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f3c055b-3620-400a-a6ac-c167a812803b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:36:22 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [req-c6ec56dd-a51e-4be2-8e65-a884f2ee27e0 req-c194e560-d7fc-412f-9016-0379b4c60fdf tempest-VolumesGetTestJSON-1930228810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f3c055b-3620-400a-a6ac-c167a812803b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:36:22 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [req-c6ec56dd-a51e-4be2-8e65-a884f2ee27e0 req-c194e560-d7fc-412f-9016-0379b4c60fdf tempest-VolumesGetTestJSON-1930228810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41b4d0cb-f31b-4ef0-a29c-19e95ea53d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:36:22 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [req-c6ec56dd-a51e-4be2-8e65-a884f2ee27e0 req-c194e560-d7fc-412f-9016-0379b4c60fdf tempest-VolumesGetTestJSON-1930228810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41b4d0cb-f31b-4ef0-a29c-19e95ea53d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3034f8e3-f8ab-45c0-ae1f-08f015e7d642', 'volume_name': 'volume-3034f8e3-f8ab-45c0-ae1f-08f015e7d642', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:36:22 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [req-c6ec56dd-a51e-4be2-8e65-a884f2ee27e0 req-c194e560-d7fc-412f-9016-0379b4c60fdf tempest-VolumesGetTestJSON-1930228810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b623fe9f-3053-43c6-b5d3-c644091448cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:36:22 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [req-c6ec56dd-a51e-4be2-8e65-a884f2ee27e0 req-c194e560-d7fc-412f-9016-0379b4c60fdf tempest-VolumesGetTestJSON-1930228810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b623fe9f-3053-43c6-b5d3-c644091448cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:36:22 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [req-c6ec56dd-a51e-4be2-8e65-a884f2ee27e0 req-c194e560-d7fc-412f-9016-0379b4c60fdf tempest-VolumesGetTestJSON-1930228810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00e2de7d-b13b-4947-963d-3438ca426089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:36:22 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [req-c6ec56dd-a51e-4be2-8e65-a884f2ee27e0 req-c194e560-d7fc-412f-9016-0379b4c60fdf tempest-VolumesGetTestJSON-1930228810 None] Volume 3034f8e3-f8ab-45c0-ae1f-08f015e7d642: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3034f8e3-f8ab-45c0-ae1f-08f015e7d642', 'volume_size': 1} Sep 18 21:36:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-c6ec56dd-a51e-4be2-8e65-a884f2ee27e0 req-c194e560-d7fc-412f-9016-0379b4c60fdf tempest-VolumesGetTestJSON-1930228810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:36:22 devstack sudo[91010]: pam_unix(sudo:session): session closed for user root Sep 18 21:36:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-736ea9b0-a02f-4d95-b44b-6855e7f8f3da tempest-ServerActionsTestOtherA-232293627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4ab86e2d-fb18-4f12-bb73-cece1359268e 1073741824" returned: 0 in 0.525s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:36:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-736ea9b0-a02f-4d95-b44b-6855e7f8f3da tempest-ServerActionsTestOtherA-232293627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4ab86e2d-fb18-4f12-bb73-cece1359268e {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:36:23 devstack sudo[91016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4ab86e2d-fb18-4f12-bb73-cece1359268e Sep 18 21:36:23 devstack sudo[91016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:36:23 devstack sudo[91016]: pam_unix(sudo:session): session closed for user root Sep 18 21:36:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-736ea9b0-a02f-4d95-b44b-6855e7f8f3da tempest-ServerActionsTestOtherA-232293627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4ab86e2d-fb18-4f12-bb73-cece1359268e" returned: 0 in 0.262s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:36:23 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-736ea9b0-a02f-4d95-b44b-6855e7f8f3da tempest-ServerActionsTestOtherA-232293627 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:36:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-736ea9b0-a02f-4d95-b44b-6855e7f8f3da tempest-ServerActionsTestOtherA-232293627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:36:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-c6ec56dd-a51e-4be2-8e65-a884f2ee27e0 req-c194e560-d7fc-412f-9016-0379b4c60fdf tempest-VolumesGetTestJSON-1930228810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.733s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:36:23 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [req-c6ec56dd-a51e-4be2-8e65-a884f2ee27e0 req-c194e560-d7fc-412f-9016-0379b4c60fdf tempest-VolumesGetTestJSON-1930228810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1332453063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3034f8e3-f8ab-45c0-ae1f-08f015e7d642,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='daa129ad6b7047f0a182afb6bcd96f0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:36:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:36:22Z,use_quota=True,user_id='30461dfe3bc54137a0bccf455b184d89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:36:23 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [req-c6ec56dd-a51e-4be2-8e65-a884f2ee27e0 req-c194e560-d7fc-412f-9016-0379b4c60fdf tempest-VolumesGetTestJSON-1930228810 None] Creating volume 3034f8e3-f8ab-45c0-ae1f-08f015e7d642 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:36:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-c6ec56dd-a51e-4be2-8e65-a884f2ee27e0 req-c194e560-d7fc-412f-9016-0379b4c60fdf tempest-VolumesGetTestJSON-1930228810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:36:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-c6ec56dd-a51e-4be2-8e65-a884f2ee27e0 req-c194e560-d7fc-412f-9016-0379b4c60fdf tempest-VolumesGetTestJSON-1930228810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:36:23 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [req-c6ec56dd-a51e-4be2-8e65-a884f2ee27e0 req-c194e560-d7fc-412f-9016-0379b4c60fdf tempest-VolumesGetTestJSON-1930228810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:36:23 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [req-c6ec56dd-a51e-4be2-8e65-a884f2ee27e0 req-c194e560-d7fc-412f-9016-0379b4c60fdf tempest-VolumesGetTestJSON-1930228810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:36:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-c6ec56dd-a51e-4be2-8e65-a884f2ee27e0 req-c194e560-d7fc-412f-9016-0379b4c60fdf tempest-VolumesGetTestJSON-1930228810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:36:23 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [req-c6ec56dd-a51e-4be2-8e65-a884f2ee27e0 req-c194e560-d7fc-412f-9016-0379b4c60fdf tempest-VolumesGetTestJSON-1930228810 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:36:23 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [req-c6ec56dd-a51e-4be2-8e65-a884f2ee27e0 req-c194e560-d7fc-412f-9016-0379b4c60fdf tempest-VolumesGetTestJSON-1930228810 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:36:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [req-c6ec56dd-a51e-4be2-8e65-a884f2ee27e0 req-c194e560-d7fc-412f-9016-0379b4c60fdf tempest-VolumesGetTestJSON-1930228810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3034f8e3-f8ab-45c0-ae1f-08f015e7d642 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:36:23 devstack sudo[91019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3034f8e3-f8ab-45c0-ae1f-08f015e7d642 1073741824 Sep 18 21:36:23 devstack sudo[91019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:36:23 devstack cinder-volume[86136]: DEBUG cinder.volume.volume_utils [None req-736ea9b0-a02f-4d95-b44b-6855e7f8f3da tempest-ServerActionsTestOtherA-232293627 None] Attempting download of a7adbe6d-c72a-4ef2-82c6-e788c5101a2c ((None, [{'url': 'file:///opt/stack/data/glance/images/a7adbe6d-c72a-4ef2-82c6-e788c5101a2c', 'metadata': {}}])) to volume 4ab86e2d-fb18-4f12-bb73-cece1359268e. {{(pid=86136) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 18 21:36:23 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[46481eec-a0ac-4d47-a2c5-d9e2d2e0ca43]: (4, 'raw') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:36:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-736ea9b0-a02f-4d95-b44b-6855e7f8f3da tempest-ServerActionsTestOtherA-232293627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_7rx6ll66 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:36:23 devstack sudo[91021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_7rx6ll66 Sep 18 21:36:23 devstack sudo[91021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:36:23 devstack sudo[91019]: pam_unix(sudo:session): session closed for user root Sep 18 21:36:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [req-c6ec56dd-a51e-4be2-8e65-a884f2ee27e0 req-c194e560-d7fc-412f-9016-0379b4c60fdf tempest-VolumesGetTestJSON-1930228810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3034f8e3-f8ab-45c0-ae1f-08f015e7d642 1073741824" returned: 0 in 0.597s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:36:23 devstack sudo[91021]: pam_unix(sudo:session): session closed for user root Sep 18 21:36:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [req-c6ec56dd-a51e-4be2-8e65-a884f2ee27e0 req-c194e560-d7fc-412f-9016-0379b4c60fdf tempest-VolumesGetTestJSON-1930228810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3034f8e3-f8ab-45c0-ae1f-08f015e7d642 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:36:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-736ea9b0-a02f-4d95-b44b-6855e7f8f3da tempest-ServerActionsTestOtherA-232293627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_7rx6ll66" returned: 0 in 0.517s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:36:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-736ea9b0-a02f-4d95-b44b-6855e7f8f3da tempest-ServerActionsTestOtherA-232293627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_7rx6ll66 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:36:23 devstack sudo[91029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3034f8e3-f8ab-45c0-ae1f-08f015e7d642 Sep 18 21:36:23 devstack sudo[91029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:36:24 devstack sudo[91030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_7rx6ll66 Sep 18 21:36:24 devstack sudo[91030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:36:24 devstack sudo[91029]: pam_unix(sudo:session): session closed for user root Sep 18 21:36:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [req-c6ec56dd-a51e-4be2-8e65-a884f2ee27e0 req-c194e560-d7fc-412f-9016-0379b4c60fdf tempest-VolumesGetTestJSON-1930228810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3034f8e3-f8ab-45c0-ae1f-08f015e7d642" returned: 0 in 0.348s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:36:24 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [req-c6ec56dd-a51e-4be2-8e65-a884f2ee27e0 req-c194e560-d7fc-412f-9016-0379b4c60fdf tempest-VolumesGetTestJSON-1930228810 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:36:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-c6ec56dd-a51e-4be2-8e65-a884f2ee27e0 req-c194e560-d7fc-412f-9016-0379b4c60fdf tempest-VolumesGetTestJSON-1930228810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:36:24 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [req-c6ec56dd-a51e-4be2-8e65-a884f2ee27e0 req-c194e560-d7fc-412f-9016-0379b4c60fdf tempest-VolumesGetTestJSON-1930228810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00e2de7d-b13b-4947-963d-3438ca426089) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3034f8e3-f8ab-45c0-ae1f-08f015e7d642', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:36:24 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [req-c6ec56dd-a51e-4be2-8e65-a884f2ee27e0 req-c194e560-d7fc-412f-9016-0379b4c60fdf tempest-VolumesGetTestJSON-1930228810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ab65852-b3a1-4029-8be3-beafd0be65d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:36:24 devstack sudo[91030]: pam_unix(sudo:session): session closed for user root Sep 18 21:36:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-736ea9b0-a02f-4d95-b44b-6855e7f8f3da tempest-ServerActionsTestOtherA-232293627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_7rx6ll66" returned: 1 in 0.378s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:36:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-736ea9b0-a02f-4d95-b44b-6855e7f8f3da tempest-ServerActionsTestOtherA-232293627 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_7rx6ll66' failed. Not Retrying. {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 18 21:36:24 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d7aa12-93fe-4ae3-9b09-65c596558c75]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:36:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-736ea9b0-a02f-4d95-b44b-6855e7f8f3da tempest-ServerActionsTestOtherA-232293627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_zyvth33edevstack@QuobyteHD {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:36:24 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [req-c6ec56dd-a51e-4be2-8e65-a884f2ee27e0 req-c194e560-d7fc-412f-9016-0379b4c60fdf tempest-VolumesGetTestJSON-1930228810 None] Volume volume-3034f8e3-f8ab-45c0-ae1f-08f015e7d642 (3034f8e3-f8ab-45c0-ae1f-08f015e7d642): created successfully Sep 18 21:36:24 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [req-c6ec56dd-a51e-4be2-8e65-a884f2ee27e0 req-c194e560-d7fc-412f-9016-0379b4c60fdf tempest-VolumesGetTestJSON-1930228810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ab65852-b3a1-4029-8be3-beafd0be65d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:36:24 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [req-c6ec56dd-a51e-4be2-8e65-a884f2ee27e0 req-c194e560-d7fc-412f-9016-0379b4c60fdf tempest-VolumesGetTestJSON-1930228810 None] Flow 'volume_create_manager' (b283f0fa-188b-4f64-bcce-175b254ab1a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:36:24 devstack cinder-volume[86136]: INFO cinder.volume.manager [req-c6ec56dd-a51e-4be2-8e65-a884f2ee27e0 req-c194e560-d7fc-412f-9016-0379b4c60fdf tempest-VolumesGetTestJSON-1930228810 None] Created volume successfully. Sep 18 21:36:24 devstack sudo[91036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_zyvth33edevstack@QuobyteHD Sep 18 21:36:24 devstack sudo[91036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:36:24 devstack sudo[91036]: pam_unix(sudo:session): session closed for user root Sep 18 21:36:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-736ea9b0-a02f-4d95-b44b-6855e7f8f3da tempest-ServerActionsTestOtherA-232293627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_zyvth33edevstack@QuobyteHD" returned: 0 in 0.439s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:36:24 devstack cinder-volume[86136]: DEBUG cinder.image.image_utils [None req-736ea9b0-a02f-4d95-b44b-6855e7f8f3da tempest-ServerActionsTestOtherA-232293627 None] a7adbe6d-c72a-4ef2-82c6-e788c5101a2c was qcow2, converting to qcow2 {{(pid=86136) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 18 21:36:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-736ea9b0-a02f-4d95-b44b-6855e7f8f3da tempest-ServerActionsTestOtherA-232293627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_zyvth33edevstack@QuobyteHD /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4ab86e2d-fb18-4f12-bb73-cece1359268e {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:36:24 devstack sudo[91042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_zyvth33edevstack@QuobyteHD /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4ab86e2d-fb18-4f12-bb73-cece1359268e Sep 18 21:36:24 devstack sudo[91042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:36:25 devstack cinder-volume[86136]: DEBUG cinder.coordination [req-b34521ee-6efb-4ebb-b9de-30f0bc20be07 req-1ec747e3-b361-443b-8e9f-12f408a1af42 tempest-VolumesGetTestJSON-1930228810 None] Acquiring lock "cinder-3034f8e3-f8ab-45c0-ae1f-08f015e7d642-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:36:25 devstack cinder-volume[86136]: DEBUG cinder.coordination [req-b34521ee-6efb-4ebb-b9de-30f0bc20be07 req-1ec747e3-b361-443b-8e9f-12f408a1af42 tempest-VolumesGetTestJSON-1930228810 None] Lock "cinder-3034f8e3-f8ab-45c0-ae1f-08f015e7d642-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:36:25 devstack cinder-volume[86136]: DEBUG cinder.coordination [req-b34521ee-6efb-4ebb-b9de-30f0bc20be07 req-1ec747e3-b361-443b-8e9f-12f408a1af42 tempest-VolumesGetTestJSON-1930228810 None] Acquiring lock "cinder-quobyte-3034f8e3-f8ab-45c0-ae1f-08f015e7d642" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:36:25 devstack cinder-volume[86136]: DEBUG cinder.coordination [req-b34521ee-6efb-4ebb-b9de-30f0bc20be07 req-1ec747e3-b361-443b-8e9f-12f408a1af42 tempest-VolumesGetTestJSON-1930228810 None] Lock "cinder-quobyte-3034f8e3-f8ab-45c0-ae1f-08f015e7d642" acquired by "delete_volume" :: waited 0.033s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:36:25 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[805949d0-ffc2-4cb0-b00e-d1410a323db3]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:36:25 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [req-b34521ee-6efb-4ebb-b9de-30f0bc20be07 req-1ec747e3-b361-443b-8e9f-12f408a1af42 tempest-VolumesGetTestJSON-1930228810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3034f8e3-f8ab-45c0-ae1f-08f015e7d642 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:36:25 devstack sudo[91048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3034f8e3-f8ab-45c0-ae1f-08f015e7d642 Sep 18 21:36:25 devstack sudo[91048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:36:25 devstack sudo[91048]: pam_unix(sudo:session): session closed for user root Sep 18 21:36:25 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [req-b34521ee-6efb-4ebb-b9de-30f0bc20be07 req-1ec747e3-b361-443b-8e9f-12f408a1af42 tempest-VolumesGetTestJSON-1930228810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3034f8e3-f8ab-45c0-ae1f-08f015e7d642" returned: 0 in 0.527s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:36:25 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [req-b34521ee-6efb-4ebb-b9de-30f0bc20be07 req-1ec747e3-b361-443b-8e9f-12f408a1af42 tempest-VolumesGetTestJSON-1930228810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3034f8e3-f8ab-45c0-ae1f-08f015e7d642 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:36:25 devstack sudo[91061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3034f8e3-f8ab-45c0-ae1f-08f015e7d642 Sep 18 21:36:25 devstack sudo[91061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:36:26 devstack sudo[91061]: pam_unix(sudo:session): session closed for user root Sep 18 21:36:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [req-b34521ee-6efb-4ebb-b9de-30f0bc20be07 req-1ec747e3-b361-443b-8e9f-12f408a1af42 tempest-VolumesGetTestJSON-1930228810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3034f8e3-f8ab-45c0-ae1f-08f015e7d642" returned: 0 in 0.396s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:36:26 devstack cinder-volume[86136]: DEBUG cinder.coordination [req-b34521ee-6efb-4ebb-b9de-30f0bc20be07 req-1ec747e3-b361-443b-8e9f-12f408a1af42 tempest-VolumesGetTestJSON-1930228810 None] Lock "cinder-quobyte-3034f8e3-f8ab-45c0-ae1f-08f015e7d642" released by "delete_volume" :: held 0.987s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:36:26 devstack cinder-volume[86136]: DEBUG cinder.quota [req-b34521ee-6efb-4ebb-b9de-30f0bc20be07 req-1ec747e3-b361-443b-8e9f-12f408a1af42 tempest-VolumesGetTestJSON-1930228810 None] Created reservations ['b91f6b3f-e109-441f-ba30-5510a15a82f2', '29d4c1b7-ed28-4ebd-9237-923fd0eb792f', '543bba21-33ba-4ab7-8d5f-30c05b4801ed', '80dc3b64-8ddd-425c-ae90-1e4c44a5d502'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:36:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-b34521ee-6efb-4ebb-b9de-30f0bc20be07 req-1ec747e3-b361-443b-8e9f-12f408a1af42 tempest-VolumesGetTestJSON-1930228810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:36:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-b34521ee-6efb-4ebb-b9de-30f0bc20be07 req-1ec747e3-b361-443b-8e9f-12f408a1af42 tempest-VolumesGetTestJSON-1930228810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:36:26 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [req-b34521ee-6efb-4ebb-b9de-30f0bc20be07 req-1ec747e3-b361-443b-8e9f-12f408a1af42 tempest-VolumesGetTestJSON-1930228810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:36:26 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [req-b34521ee-6efb-4ebb-b9de-30f0bc20be07 req-1ec747e3-b361-443b-8e9f-12f408a1af42 tempest-VolumesGetTestJSON-1930228810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:36:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-b34521ee-6efb-4ebb-b9de-30f0bc20be07 req-1ec747e3-b361-443b-8e9f-12f408a1af42 tempest-VolumesGetTestJSON-1930228810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:36:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [req-b34521ee-6efb-4ebb-b9de-30f0bc20be07 req-1ec747e3-b361-443b-8e9f-12f408a1af42 tempest-VolumesGetTestJSON-1930228810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:36:26 devstack sudo[91064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:36:26 devstack sudo[91064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:36:26 devstack sudo[91064]: pam_unix(sudo:session): session closed for user root Sep 18 21:36:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [req-b34521ee-6efb-4ebb-b9de-30f0bc20be07 req-1ec747e3-b361-443b-8e9f-12f408a1af42 tempest-VolumesGetTestJSON-1930228810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.309s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:36:26 devstack cinder-volume[86136]: DEBUG cinder.manager [req-b34521ee-6efb-4ebb-b9de-30f0bc20be07 req-1ec747e3-b361-443b-8e9f-12f408a1af42 tempest-VolumesGetTestJSON-1930228810 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:36:26 devstack cinder-volume[86136]: INFO cinder.volume.manager [req-b34521ee-6efb-4ebb-b9de-30f0bc20be07 req-1ec747e3-b361-443b-8e9f-12f408a1af42 tempest-VolumesGetTestJSON-1930228810 None] Deleted volume successfully. Sep 18 21:36:26 devstack cinder-volume[86136]: DEBUG cinder.coordination [req-b34521ee-6efb-4ebb-b9de-30f0bc20be07 req-1ec747e3-b361-443b-8e9f-12f408a1af42 tempest-VolumesGetTestJSON-1930228810 None] Lock "cinder-3034f8e3-f8ab-45c0-ae1f-08f015e7d642-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:36:27 devstack sudo[91042]: pam_unix(sudo:session): session closed for user root Sep 18 21:36:27 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-736ea9b0-a02f-4d95-b44b-6855e7f8f3da tempest-ServerActionsTestOtherA-232293627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_zyvth33edevstack@QuobyteHD /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4ab86e2d-fb18-4f12-bb73-cece1359268e" returned: 0 in 2.559s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:36:27 devstack cinder-volume[86136]: DEBUG cinder.image.image_utils [None req-736ea9b0-a02f-4d95-b44b-6855e7f8f3da tempest-ServerActionsTestOtherA-232293627 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_zyvth33edevstack@QuobyteHD, size 112.00 MB, duration 2.56 sec, destination /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4ab86e2d-fb18-4f12-bb73-cece1359268e {{(pid=86136) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 18 21:36:27 devstack cinder-volume[86136]: INFO cinder.image.image_utils [None req-736ea9b0-a02f-4d95-b44b-6855e7f8f3da tempest-ServerActionsTestOtherA-232293627 None] Converted 112.00 MB image at 43.75 MB/s Sep 18 21:36:27 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-736ea9b0-a02f-4d95-b44b-6855e7f8f3da tempest-ServerActionsTestOtherA-232293627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4ab86e2d-fb18-4f12-bb73-cece1359268e 1G {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:36:27 devstack sudo[91067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4ab86e2d-fb18-4f12-bb73-cece1359268e 1G Sep 18 21:36:27 devstack sudo[91067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:36:27 devstack sudo[91067]: pam_unix(sudo:session): session closed for user root Sep 18 21:36:27 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-736ea9b0-a02f-4d95-b44b-6855e7f8f3da tempest-ServerActionsTestOtherA-232293627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4ab86e2d-fb18-4f12-bb73-cece1359268e 1G" returned: 0 in 0.460s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:36:27 devstack cinder-volume[86136]: DEBUG cinder.volume.volume_utils [None req-736ea9b0-a02f-4d95-b44b-6855e7f8f3da tempest-ServerActionsTestOtherA-232293627 None] Downloaded image a7adbe6d-c72a-4ef2-82c6-e788c5101a2c ((None, [{'url': 'file:///opt/stack/data/glance/images/a7adbe6d-c72a-4ef2-82c6-e788c5101a2c', 'metadata': {}}])) to volume 4ab86e2d-fb18-4f12-bb73-cece1359268e successfully. {{(pid=86136) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 18 21:36:27 devstack cinder-volume[86136]: DEBUG cinder.image.image_utils [None req-736ea9b0-a02f-4d95-b44b-6855e7f8f3da tempest-ServerActionsTestOtherA-232293627 None] Temporary image a7adbe6d-c72a-4ef2-82c6-e788c5101a2c for user 5b45b61bc84e4e97964b2e63ff7478c9 is deleted. {{(pid=86136) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 18 21:36:27 devstack cinder-volume[86136]: DEBUG cinder.volume.volume_utils [None req-736ea9b0-a02f-4d95-b44b-6855e7f8f3da tempest-ServerActionsTestOtherA-232293627 None] Marking volume 4ab86e2d-fb18-4f12-bb73-cece1359268e as bootable. {{(pid=86136) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 18 21:36:27 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-736ea9b0-a02f-4d95-b44b-6855e7f8f3da tempest-ServerActionsTestOtherA-232293627 None] Copying metadata from image a7adbe6d-c72a-4ef2-82c6-e788c5101a2c to 4ab86e2d-fb18-4f12-bb73-cece1359268e. {{(pid=86136) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 18 21:36:27 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-736ea9b0-a02f-4d95-b44b-6855e7f8f3da tempest-ServerActionsTestOtherA-232293627 None] Creating volume glance metadata for volume 4ab86e2d-fb18-4f12-bb73-cece1359268e backed by image a7adbe6d-c72a-4ef2-82c6-e788c5101a2c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a7adbe6d-c72a-4ef2-82c6-e788c5101a2c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86136) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 18 21:36:27 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-736ea9b0-a02f-4d95-b44b-6855e7f8f3da tempest-ServerActionsTestOtherA-232293627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92ab3acd-8ab5-44b5-9c88-f2a26dd81054) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ab86e2d-fb18-4f12-bb73-cece1359268e', 'volume_size': 1, 'image_id': 'a7adbe6d-c72a-4ef2-82c6-e788c5101a2c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a7adbe6d-c72a-4ef2-82c6-e788c5101a2c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'eae9b2cfe4f146fb9d7ac38006d73cd9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a7adbe6d-c72a-4ef2-82c6-e788c5101a2c', 'created_at': datetime.datetime(2026, 9, 18, 19, 27, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 18, 19, 27, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a7adbe6d-c72a-4ef2-82c6-e788c5101a2c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:36:27 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-736ea9b0-a02f-4d95-b44b-6855e7f8f3da tempest-ServerActionsTestOtherA-232293627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bedc4b8d-54c4-41db-859c-7f0f9901d44d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:36:27 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-736ea9b0-a02f-4d95-b44b-6855e7f8f3da tempest-ServerActionsTestOtherA-232293627 None] Volume volume-4ab86e2d-fb18-4f12-bb73-cece1359268e (4ab86e2d-fb18-4f12-bb73-cece1359268e): created successfully Sep 18 21:36:27 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-736ea9b0-a02f-4d95-b44b-6855e7f8f3da tempest-ServerActionsTestOtherA-232293627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bedc4b8d-54c4-41db-859c-7f0f9901d44d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:36:27 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-736ea9b0-a02f-4d95-b44b-6855e7f8f3da tempest-ServerActionsTestOtherA-232293627 None] Flow 'volume_create_manager' (26cc252c-0dc8-4adf-9dd3-28d5a9996172) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:36:28 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-736ea9b0-a02f-4d95-b44b-6855e7f8f3da tempest-ServerActionsTestOtherA-232293627 None] Created volume successfully. Sep 18 21:36:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-ef55a32c-d0d2-4bc1-ac76-464f825faa0d req-a5caf999-c0b8-4b8e-b4aa-55892ed4cb24 tempest-ServerActionsTestOtherA-232293627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:36:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-ef55a32c-d0d2-4bc1-ac76-464f825faa0d req-a5caf999-c0b8-4b8e-b4aa-55892ed4cb24 tempest-ServerActionsTestOtherA-232293627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:36:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-ef55a32c-d0d2-4bc1-ac76-464f825faa0d req-a5caf999-c0b8-4b8e-b4aa-55892ed4cb24 tempest-ServerActionsTestOtherA-232293627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:36:31 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [req-ef55a32c-d0d2-4bc1-ac76-464f825faa0d req-a5caf999-c0b8-4b8e-b4aa-55892ed4cb24 tempest-ServerActionsTestOtherA-232293627 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff', 'name': 'volume-4ab86e2d-fb18-4f12-bb73-cece1359268e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0956e845-e9ab-4cb6-9a28-835fa356fccd', 'enforce_multipath': True} {{(pid=86136) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 18 21:36:31 devstack cinder-volume[86136]: INFO cinder.volume.manager [req-ef55a32c-d0d2-4bc1-ac76-464f825faa0d req-a5caf999-c0b8-4b8e-b4aa-55892ed4cb24 tempest-ServerActionsTestOtherA-232293627 None] attachment_update completed successfully. Sep 18 21:36:38 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-8c253c57-f40a-4a62-aef5-7fffc039e869 tempest-BackendsCapabilitiesAdminTestsJSON-86743904 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6893119812012, 'free_capacity_gb': 1775.6893119812012, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86136) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 18 21:36:38 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2ad96551-ffd0-4394-8873-1148f7d53e01 tempest-BackendsCapabilitiesAdminTestsJSON-86743904 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6893119812012, 'free_capacity_gb': 1775.6893119812012, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86136) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 18 21:36:39 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f6f9f41-7a7e-4e4b-b010-0a137c557592 tempest-VolumesImageMetadata-1673542771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:36:39 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-5f6f9f41-7a7e-4e4b-b010-0a137c557592 tempest-VolumesImageMetadata-1673542771 None] Flow 'volume_create_manager' (a197d63a-7bba-4d23-8aac-d9519f90d504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:36:39 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-5f6f9f41-7a7e-4e4b-b010-0a137c557592 tempest-VolumesImageMetadata-1673542771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09ce3a1d-cd3e-4e0c-9490-8b516978c3c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:36:39 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-5f6f9f41-7a7e-4e4b-b010-0a137c557592 tempest-VolumesImageMetadata-1673542771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09ce3a1d-cd3e-4e0c-9490-8b516978c3c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1506523538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9a535f8-485e-4e23-9acd-cd84fdedf7dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14c82a2e8ba34c47922776c7c21502c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:36:39Z,use_quota=True,user_id='bf69eb4c2d664abe90910f93d0d7738e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:36:39 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-5f6f9f41-7a7e-4e4b-b010-0a137c557592 tempest-VolumesImageMetadata-1673542771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce41585a-38a4-4d6b-b9aa-14f3284e4c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:36:39 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-5f6f9f41-7a7e-4e4b-b010-0a137c557592 tempest-VolumesImageMetadata-1673542771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce41585a-38a4-4d6b-b9aa-14f3284e4c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:36:39 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-5f6f9f41-7a7e-4e4b-b010-0a137c557592 tempest-VolumesImageMetadata-1673542771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (deee3c41-9e23-453a-bfbf-481e591de301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:36:39 devstack cinder-volume[86136]: DEBUG cinder.image.glance [None req-5f6f9f41-7a7e-4e4b-b010-0a137c557592 tempest-VolumesImageMetadata-1673542771 None] Creating Keystone auth plugin from conf {{(pid=86136) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 18 21:36:40 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-5f6f9f41-7a7e-4e4b-b010-0a137c557592 tempest-VolumesImageMetadata-1673542771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (deee3c41-9e23-453a-bfbf-481e591de301) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b9a535f8-485e-4e23-9acd-cd84fdedf7dc', 'volume_name': 'volume-b9a535f8-485e-4e23-9acd-cd84fdedf7dc', 'volume_size': 1, 'image_id': 'a7adbe6d-c72a-4ef2-82c6-e788c5101a2c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a7adbe6d-c72a-4ef2-82c6-e788c5101a2c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'eae9b2cfe4f146fb9d7ac38006d73cd9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a7adbe6d-c72a-4ef2-82c6-e788c5101a2c', 'created_at': datetime.datetime(2026, 9, 18, 19, 27, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 18, 19, 27, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a7adbe6d-c72a-4ef2-82c6-e788c5101a2c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:36:40 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-5f6f9f41-7a7e-4e4b-b010-0a137c557592 tempest-VolumesImageMetadata-1673542771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fefcca3-ce73-4b22-84b1-e7234dede956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:36:40 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-5f6f9f41-7a7e-4e4b-b010-0a137c557592 tempest-VolumesImageMetadata-1673542771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fefcca3-ce73-4b22-84b1-e7234dede956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:36:40 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-5f6f9f41-7a7e-4e4b-b010-0a137c557592 tempest-VolumesImageMetadata-1673542771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c052a68c-2856-4179-9af5-31ba6874fbea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:36:40 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-5f6f9f41-7a7e-4e4b-b010-0a137c557592 tempest-VolumesImageMetadata-1673542771 None] Volume b9a535f8-485e-4e23-9acd-cd84fdedf7dc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b9a535f8-485e-4e23-9acd-cd84fdedf7dc', 'volume_size': 1, 'image_id': 'a7adbe6d-c72a-4ef2-82c6-e788c5101a2c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a7adbe6d-c72a-4ef2-82c6-e788c5101a2c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'eae9b2cfe4f146fb9d7ac38006d73cd9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a7adbe6d-c72a-4ef2-82c6-e788c5101a2c', 'created_at': datetime.datetime(2026, 9, 18, 19, 27, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 18, 19, 27, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a7adbe6d-c72a-4ef2-82c6-e788c5101a2c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 18 21:36:40 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f6f9f41-7a7e-4e4b-b010-0a137c557592 tempest-VolumesImageMetadata-1673542771 None] Trying to clone b9a535f8-485e-4e23-9acd-cd84fdedf7dc from image a7adbe6d-c72a-4ef2-82c6-e788c5101a2c at location (None, [{'url': 'file:///opt/stack/data/glance/images/a7adbe6d-c72a-4ef2-82c6-e788c5101a2c', 'metadata': {}}]). {{(pid=86136) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 18 21:36:40 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bac3584-7cec-474c-b9d4-6939e9b749c5 tempest-AttachVolumeTestJSON-1287281091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:36:40 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-4bac3584-7cec-474c-b9d4-6939e9b749c5 tempest-AttachVolumeTestJSON-1287281091 None] Flow 'volume_create_manager' (c8ea2d04-cd10-41b3-a02b-00194ac468a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:36:40 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-4bac3584-7cec-474c-b9d4-6939e9b749c5 tempest-AttachVolumeTestJSON-1287281091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72ac1f97-8764-4b8d-8479-4deca104a470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:36:40 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-4bac3584-7cec-474c-b9d4-6939e9b749c5 tempest-AttachVolumeTestJSON-1287281091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72ac1f97-8764-4b8d-8479-4deca104a470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1638543780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bcfb86f-79cc-4079-abee-e264e5ada6bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79bcd1aa64ac4dff810185818cb31273',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:36:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:36:40Z,use_quota=True,user_id='d10943648fea4421b3587860331c232b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:36:40 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-4bac3584-7cec-474c-b9d4-6939e9b749c5 tempest-AttachVolumeTestJSON-1287281091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53db7623-f0c0-4300-a43e-32270347719c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:36:40 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-4bac3584-7cec-474c-b9d4-6939e9b749c5 tempest-AttachVolumeTestJSON-1287281091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53db7623-f0c0-4300-a43e-32270347719c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:36:40 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-4bac3584-7cec-474c-b9d4-6939e9b749c5 tempest-AttachVolumeTestJSON-1287281091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75868d8b-8b88-4065-a361-02bf02c99397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:36:40 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-4bac3584-7cec-474c-b9d4-6939e9b749c5 tempest-AttachVolumeTestJSON-1287281091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75868d8b-8b88-4065-a361-02bf02c99397) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bcfb86f-79cc-4079-abee-e264e5ada6bb', 'volume_name': 'volume-7bcfb86f-79cc-4079-abee-e264e5ada6bb', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:36:40 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-4bac3584-7cec-474c-b9d4-6939e9b749c5 tempest-AttachVolumeTestJSON-1287281091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63cab5b3-36a4-4a3f-b96b-79430edaf7c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:36:40 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-4bac3584-7cec-474c-b9d4-6939e9b749c5 tempest-AttachVolumeTestJSON-1287281091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63cab5b3-36a4-4a3f-b96b-79430edaf7c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:36:40 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-4bac3584-7cec-474c-b9d4-6939e9b749c5 tempest-AttachVolumeTestJSON-1287281091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ded85a78-07b2-409b-a1f1-b18de02704a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:36:40 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-4bac3584-7cec-474c-b9d4-6939e9b749c5 tempest-AttachVolumeTestJSON-1287281091 None] Volume 7bcfb86f-79cc-4079-abee-e264e5ada6bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bcfb86f-79cc-4079-abee-e264e5ada6bb', 'volume_size': 1} Sep 18 21:36:40 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-4bac3584-7cec-474c-b9d4-6939e9b749c5 tempest-AttachVolumeTestJSON-1287281091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:36:40 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-4bac3584-7cec-474c-b9d4-6939e9b749c5 tempest-AttachVolumeTestJSON-1287281091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:36:40 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-4bac3584-7cec-474c-b9d4-6939e9b749c5 tempest-AttachVolumeTestJSON-1287281091 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1638543780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bcfb86f-79cc-4079-abee-e264e5ada6bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79bcd1aa64ac4dff810185818cb31273',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:36:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:36:40Z,use_quota=True,user_id='d10943648fea4421b3587860331c232b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:36:40 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-4bac3584-7cec-474c-b9d4-6939e9b749c5 tempest-AttachVolumeTestJSON-1287281091 None] Creating volume 7bcfb86f-79cc-4079-abee-e264e5ada6bb {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:36:40 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-4bac3584-7cec-474c-b9d4-6939e9b749c5 tempest-AttachVolumeTestJSON-1287281091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:36:40 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-4bac3584-7cec-474c-b9d4-6939e9b749c5 tempest-AttachVolumeTestJSON-1287281091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:36:40 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-4bac3584-7cec-474c-b9d4-6939e9b749c5 tempest-AttachVolumeTestJSON-1287281091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:36:40 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-4bac3584-7cec-474c-b9d4-6939e9b749c5 tempest-AttachVolumeTestJSON-1287281091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:36:40 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-4bac3584-7cec-474c-b9d4-6939e9b749c5 tempest-AttachVolumeTestJSON-1287281091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:36:40 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-4bac3584-7cec-474c-b9d4-6939e9b749c5 tempest-AttachVolumeTestJSON-1287281091 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:36:40 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-4bac3584-7cec-474c-b9d4-6939e9b749c5 tempest-AttachVolumeTestJSON-1287281091 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:36:40 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-4bac3584-7cec-474c-b9d4-6939e9b749c5 tempest-AttachVolumeTestJSON-1287281091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7bcfb86f-79cc-4079-abee-e264e5ada6bb 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:36:40 devstack sudo[91564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7bcfb86f-79cc-4079-abee-e264e5ada6bb 1073741824 Sep 18 21:36:40 devstack sudo[91564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:36:41 devstack cinder-volume[86136]: DEBUG cinder.image.image_utils [None req-5f6f9f41-7a7e-4e4b-b010-0a137c557592 tempest-VolumesImageMetadata-1673542771 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_whu5mh4udevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86136) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 18 21:36:41 devstack cinder-volume[86136]: INFO cinder.image.image_utils [None req-5f6f9f41-7a7e-4e4b-b010-0a137c557592 tempest-VolumesImageMetadata-1673542771 None] Image download 20.69 MB at 20.69 MB/s Sep 18 21:36:41 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a89bd69-63d0-4414-b43c-2feb1dd45b2d]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:36:41 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5f6f9f41-7a7e-4e4b-b010-0a137c557592 tempest-VolumesImageMetadata-1673542771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_whu5mh4udevstack@QuobyteHD {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:36:41 devstack sudo[91571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_whu5mh4udevstack@QuobyteHD Sep 18 21:36:41 devstack sudo[91571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:36:41 devstack sudo[91564]: pam_unix(sudo:session): session closed for user root Sep 18 21:36:41 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-4bac3584-7cec-474c-b9d4-6939e9b749c5 tempest-AttachVolumeTestJSON-1287281091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7bcfb86f-79cc-4079-abee-e264e5ada6bb 1073741824" returned: 0 in 1.014s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:36:41 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-4bac3584-7cec-474c-b9d4-6939e9b749c5 tempest-AttachVolumeTestJSON-1287281091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7bcfb86f-79cc-4079-abee-e264e5ada6bb {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:36:41 devstack sudo[91573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7bcfb86f-79cc-4079-abee-e264e5ada6bb Sep 18 21:36:41 devstack sudo[91573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:36:41 devstack sudo[91571]: pam_unix(sudo:session): session closed for user root Sep 18 21:36:41 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5f6f9f41-7a7e-4e4b-b010-0a137c557592 tempest-VolumesImageMetadata-1673542771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_whu5mh4udevstack@QuobyteHD" returned: 0 in 0.686s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:36:41 devstack cinder-volume[86136]: DEBUG cinder.image.image_utils [None req-5f6f9f41-7a7e-4e4b-b010-0a137c557592 tempest-VolumesImageMetadata-1673542771 None] Temporary image a7adbe6d-c72a-4ef2-82c6-e788c5101a2c is fetched for user bf69eb4c2d664abe90910f93d0d7738e. {{(pid=86136) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 18 21:36:42 devstack sudo[91573]: pam_unix(sudo:session): session closed for user root Sep 18 21:36:42 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-4bac3584-7cec-474c-b9d4-6939e9b749c5 tempest-AttachVolumeTestJSON-1287281091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7bcfb86f-79cc-4079-abee-e264e5ada6bb" returned: 0 in 0.524s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:36:42 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-4bac3584-7cec-474c-b9d4-6939e9b749c5 tempest-AttachVolumeTestJSON-1287281091 None] <== create_volume: return (1640ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:36:42 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-4bac3584-7cec-474c-b9d4-6939e9b749c5 tempest-AttachVolumeTestJSON-1287281091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.650s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:36:42 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-4bac3584-7cec-474c-b9d4-6939e9b749c5 tempest-AttachVolumeTestJSON-1287281091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ded85a78-07b2-409b-a1f1-b18de02704a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bcfb86f-79cc-4079-abee-e264e5ada6bb', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:36:42 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-4bac3584-7cec-474c-b9d4-6939e9b749c5 tempest-AttachVolumeTestJSON-1287281091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8df9ba9a-c419-442a-8d1e-3576a2ebee33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:36:42 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-4bac3584-7cec-474c-b9d4-6939e9b749c5 tempest-AttachVolumeTestJSON-1287281091 None] Volume volume-7bcfb86f-79cc-4079-abee-e264e5ada6bb (7bcfb86f-79cc-4079-abee-e264e5ada6bb): created successfully Sep 18 21:36:42 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-4bac3584-7cec-474c-b9d4-6939e9b749c5 tempest-AttachVolumeTestJSON-1287281091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8df9ba9a-c419-442a-8d1e-3576a2ebee33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:36:42 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-4bac3584-7cec-474c-b9d4-6939e9b749c5 tempest-AttachVolumeTestJSON-1287281091 None] Flow 'volume_create_manager' (c8ea2d04-cd10-41b3-a02b-00194ac468a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:36:42 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db71dff-272c-45a5-a592-b16cdeb6b6cc]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:36:42 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5f6f9f41-7a7e-4e4b-b010-0a137c557592 tempest-VolumesImageMetadata-1673542771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_whu5mh4udevstack@QuobyteHD {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:36:42 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-4bac3584-7cec-474c-b9d4-6939e9b749c5 tempest-AttachVolumeTestJSON-1287281091 None] Created volume successfully. Sep 18 21:36:42 devstack sudo[91582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_whu5mh4udevstack@QuobyteHD Sep 18 21:36:42 devstack sudo[91582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:36:42 devstack sudo[91582]: pam_unix(sudo:session): session closed for user root Sep 18 21:36:42 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5f6f9f41-7a7e-4e4b-b010-0a137c557592 tempest-VolumesImageMetadata-1673542771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_whu5mh4udevstack@QuobyteHD" returned: 0 in 0.548s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:36:42 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-5f6f9f41-7a7e-4e4b-b010-0a137c557592 tempest-VolumesImageMetadata-1673542771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:36:42 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-5f6f9f41-7a7e-4e4b-b010-0a137c557592 tempest-VolumesImageMetadata-1673542771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:36:42 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-5f6f9f41-7a7e-4e4b-b010-0a137c557592 tempest-VolumesImageMetadata-1673542771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1506523538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9a535f8-485e-4e23-9acd-cd84fdedf7dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14c82a2e8ba34c47922776c7c21502c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:36:39Z,use_quota=True,user_id='bf69eb4c2d664abe90910f93d0d7738e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:36:42 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-5f6f9f41-7a7e-4e4b-b010-0a137c557592 tempest-VolumesImageMetadata-1673542771 None] Creating volume b9a535f8-485e-4e23-9acd-cd84fdedf7dc {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:36:42 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-5f6f9f41-7a7e-4e4b-b010-0a137c557592 tempest-VolumesImageMetadata-1673542771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:36:42 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-5f6f9f41-7a7e-4e4b-b010-0a137c557592 tempest-VolumesImageMetadata-1673542771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:36:42 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-5f6f9f41-7a7e-4e4b-b010-0a137c557592 tempest-VolumesImageMetadata-1673542771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:36:42 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-5f6f9f41-7a7e-4e4b-b010-0a137c557592 tempest-VolumesImageMetadata-1673542771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:36:42 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-5f6f9f41-7a7e-4e4b-b010-0a137c557592 tempest-VolumesImageMetadata-1673542771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:36:42 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-5f6f9f41-7a7e-4e4b-b010-0a137c557592 tempest-VolumesImageMetadata-1673542771 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:36:42 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-5f6f9f41-7a7e-4e4b-b010-0a137c557592 tempest-VolumesImageMetadata-1673542771 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:36:42 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5f6f9f41-7a7e-4e4b-b010-0a137c557592 tempest-VolumesImageMetadata-1673542771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b9a535f8-485e-4e23-9acd-cd84fdedf7dc 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:36:42 devstack sudo[91588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b9a535f8-485e-4e23-9acd-cd84fdedf7dc 1073741824 Sep 18 21:36:42 devstack sudo[91588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:36:43 devstack sudo[91588]: pam_unix(sudo:session): session closed for user root Sep 18 21:36:43 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5f6f9f41-7a7e-4e4b-b010-0a137c557592 tempest-VolumesImageMetadata-1673542771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b9a535f8-485e-4e23-9acd-cd84fdedf7dc 1073741824" returned: 0 in 0.866s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:36:43 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5f6f9f41-7a7e-4e4b-b010-0a137c557592 tempest-VolumesImageMetadata-1673542771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b9a535f8-485e-4e23-9acd-cd84fdedf7dc {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:36:43 devstack sudo[91599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b9a535f8-485e-4e23-9acd-cd84fdedf7dc Sep 18 21:36:43 devstack sudo[91599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:36:44 devstack sudo[91599]: pam_unix(sudo:session): session closed for user root Sep 18 21:36:44 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5f6f9f41-7a7e-4e4b-b010-0a137c557592 tempest-VolumesImageMetadata-1673542771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b9a535f8-485e-4e23-9acd-cd84fdedf7dc" returned: 0 in 0.639s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:36:44 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-5f6f9f41-7a7e-4e4b-b010-0a137c557592 tempest-VolumesImageMetadata-1673542771 None] <== create_volume: return (1618ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:36:44 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-5f6f9f41-7a7e-4e4b-b010-0a137c557592 tempest-VolumesImageMetadata-1673542771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.629s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:36:44 devstack cinder-volume[86136]: DEBUG cinder.volume.volume_utils [None req-5f6f9f41-7a7e-4e4b-b010-0a137c557592 tempest-VolumesImageMetadata-1673542771 None] Attempting download of a7adbe6d-c72a-4ef2-82c6-e788c5101a2c ((None, [{'url': 'file:///opt/stack/data/glance/images/a7adbe6d-c72a-4ef2-82c6-e788c5101a2c', 'metadata': {}}])) to volume b9a535f8-485e-4e23-9acd-cd84fdedf7dc. {{(pid=86136) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 18 21:36:44 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84b6241-44e2-4fcc-9576-6bc473ec060d]: (4, 'raw') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:36:44 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5f6f9f41-7a7e-4e4b-b010-0a137c557592 tempest-VolumesImageMetadata-1673542771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_rnqqgcun {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:36:44 devstack sudo[91611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_rnqqgcun Sep 18 21:36:44 devstack sudo[91611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:36:44 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-416f7eed-f4b1-48fa-8ab2-7d16689ae076 req-ff637e74-521f-4777-abe8-2b37c171b5f7 tempest-AttachVolumeTestJSON-1287281091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:36:44 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-416f7eed-f4b1-48fa-8ab2-7d16689ae076 req-ff637e74-521f-4777-abe8-2b37c171b5f7 tempest-AttachVolumeTestJSON-1287281091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:36:44 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-416f7eed-f4b1-48fa-8ab2-7d16689ae076 req-ff637e74-521f-4777-abe8-2b37c171b5f7 tempest-AttachVolumeTestJSON-1287281091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.036s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:36:44 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [req-416f7eed-f4b1-48fa-8ab2-7d16689ae076 req-ff637e74-521f-4777-abe8-2b37c171b5f7 tempest-AttachVolumeTestJSON-1287281091 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff', 'name': 'volume-7bcfb86f-79cc-4079-abee-e264e5ada6bb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '50e0eec0-13e1-4eb9-94e9-67c145f9cb6e', 'enforce_multipath': True} {{(pid=86136) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 18 21:36:45 devstack cinder-volume[86136]: INFO cinder.volume.manager [req-416f7eed-f4b1-48fa-8ab2-7d16689ae076 req-ff637e74-521f-4777-abe8-2b37c171b5f7 tempest-AttachVolumeTestJSON-1287281091 None] attachment_update completed successfully. Sep 18 21:36:45 devstack sudo[91611]: pam_unix(sudo:session): session closed for user root Sep 18 21:36:45 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5f6f9f41-7a7e-4e4b-b010-0a137c557592 tempest-VolumesImageMetadata-1673542771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_rnqqgcun" returned: 0 in 0.687s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:36:45 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5f6f9f41-7a7e-4e4b-b010-0a137c557592 tempest-VolumesImageMetadata-1673542771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_rnqqgcun {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:36:45 devstack sudo[91618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_rnqqgcun Sep 18 21:36:45 devstack sudo[91618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:36:45 devstack sudo[91618]: pam_unix(sudo:session): session closed for user root Sep 18 21:36:45 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5f6f9f41-7a7e-4e4b-b010-0a137c557592 tempest-VolumesImageMetadata-1673542771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_rnqqgcun" returned: 1 in 0.530s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:36:45 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5f6f9f41-7a7e-4e4b-b010-0a137c557592 tempest-VolumesImageMetadata-1673542771 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_rnqqgcun' failed. Not Retrying. {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 18 21:36:45 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[302b84ad-cc87-4b70-8a85-866b48dc33de]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:36:45 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5f6f9f41-7a7e-4e4b-b010-0a137c557592 tempest-VolumesImageMetadata-1673542771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_whu5mh4udevstack@QuobyteHD {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:36:45 devstack sudo[91622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_whu5mh4udevstack@QuobyteHD Sep 18 21:36:45 devstack sudo[91622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:36:46 devstack sudo[91622]: pam_unix(sudo:session): session closed for user root Sep 18 21:36:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5f6f9f41-7a7e-4e4b-b010-0a137c557592 tempest-VolumesImageMetadata-1673542771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_whu5mh4udevstack@QuobyteHD" returned: 0 in 0.514s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:36:46 devstack cinder-volume[86136]: DEBUG cinder.image.image_utils [None req-5f6f9f41-7a7e-4e4b-b010-0a137c557592 tempest-VolumesImageMetadata-1673542771 None] a7adbe6d-c72a-4ef2-82c6-e788c5101a2c was qcow2, converting to qcow2 {{(pid=86136) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 18 21:36:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5f6f9f41-7a7e-4e4b-b010-0a137c557592 tempest-VolumesImageMetadata-1673542771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_whu5mh4udevstack@QuobyteHD /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b9a535f8-485e-4e23-9acd-cd84fdedf7dc {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:36:46 devstack sudo[91630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_whu5mh4udevstack@QuobyteHD /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b9a535f8-485e-4e23-9acd-cd84fdedf7dc Sep 18 21:36:46 devstack sudo[91630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:36:49 devstack sudo[91630]: pam_unix(sudo:session): session closed for user root Sep 18 21:36:49 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5f6f9f41-7a7e-4e4b-b010-0a137c557592 tempest-VolumesImageMetadata-1673542771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_whu5mh4udevstack@QuobyteHD /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b9a535f8-485e-4e23-9acd-cd84fdedf7dc" returned: 0 in 3.389s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:36:49 devstack cinder-volume[86136]: DEBUG cinder.image.image_utils [None req-5f6f9f41-7a7e-4e4b-b010-0a137c557592 tempest-VolumesImageMetadata-1673542771 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_whu5mh4udevstack@QuobyteHD, size 112.00 MB, duration 3.39 sec, destination /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b9a535f8-485e-4e23-9acd-cd84fdedf7dc {{(pid=86136) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 18 21:36:49 devstack cinder-volume[86136]: INFO cinder.image.image_utils [None req-5f6f9f41-7a7e-4e4b-b010-0a137c557592 tempest-VolumesImageMetadata-1673542771 None] Converted 112.00 MB image at 33.02 MB/s Sep 18 21:36:49 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5f6f9f41-7a7e-4e4b-b010-0a137c557592 tempest-VolumesImageMetadata-1673542771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b9a535f8-485e-4e23-9acd-cd84fdedf7dc 1G {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:36:49 devstack sudo[91651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b9a535f8-485e-4e23-9acd-cd84fdedf7dc 1G Sep 18 21:36:49 devstack sudo[91651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:36:50 devstack sudo[91651]: pam_unix(sudo:session): session closed for user root Sep 18 21:36:50 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5f6f9f41-7a7e-4e4b-b010-0a137c557592 tempest-VolumesImageMetadata-1673542771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b9a535f8-485e-4e23-9acd-cd84fdedf7dc 1G" returned: 0 in 0.505s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:36:50 devstack cinder-volume[86136]: DEBUG cinder.volume.volume_utils [None req-5f6f9f41-7a7e-4e4b-b010-0a137c557592 tempest-VolumesImageMetadata-1673542771 None] Downloaded image a7adbe6d-c72a-4ef2-82c6-e788c5101a2c ((None, [{'url': 'file:///opt/stack/data/glance/images/a7adbe6d-c72a-4ef2-82c6-e788c5101a2c', 'metadata': {}}])) to volume b9a535f8-485e-4e23-9acd-cd84fdedf7dc successfully. {{(pid=86136) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 18 21:36:50 devstack cinder-volume[86136]: DEBUG cinder.image.image_utils [None req-5f6f9f41-7a7e-4e4b-b010-0a137c557592 tempest-VolumesImageMetadata-1673542771 None] Temporary image a7adbe6d-c72a-4ef2-82c6-e788c5101a2c for user bf69eb4c2d664abe90910f93d0d7738e is deleted. {{(pid=86136) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 18 21:36:50 devstack cinder-volume[86136]: DEBUG cinder.volume.volume_utils [None req-5f6f9f41-7a7e-4e4b-b010-0a137c557592 tempest-VolumesImageMetadata-1673542771 None] Marking volume b9a535f8-485e-4e23-9acd-cd84fdedf7dc as bootable. {{(pid=86136) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 18 21:36:50 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f6f9f41-7a7e-4e4b-b010-0a137c557592 tempest-VolumesImageMetadata-1673542771 None] Copying metadata from image a7adbe6d-c72a-4ef2-82c6-e788c5101a2c to b9a535f8-485e-4e23-9acd-cd84fdedf7dc. {{(pid=86136) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 18 21:36:50 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f6f9f41-7a7e-4e4b-b010-0a137c557592 tempest-VolumesImageMetadata-1673542771 None] Creating volume glance metadata for volume b9a535f8-485e-4e23-9acd-cd84fdedf7dc backed by image a7adbe6d-c72a-4ef2-82c6-e788c5101a2c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a7adbe6d-c72a-4ef2-82c6-e788c5101a2c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86136) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 18 21:36:50 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-5f6f9f41-7a7e-4e4b-b010-0a137c557592 tempest-VolumesImageMetadata-1673542771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c052a68c-2856-4179-9af5-31ba6874fbea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9a535f8-485e-4e23-9acd-cd84fdedf7dc', 'volume_size': 1, 'image_id': 'a7adbe6d-c72a-4ef2-82c6-e788c5101a2c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a7adbe6d-c72a-4ef2-82c6-e788c5101a2c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'eae9b2cfe4f146fb9d7ac38006d73cd9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a7adbe6d-c72a-4ef2-82c6-e788c5101a2c', 'created_at': datetime.datetime(2026, 9, 18, 19, 27, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 18, 19, 27, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a7adbe6d-c72a-4ef2-82c6-e788c5101a2c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:36:50 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-5f6f9f41-7a7e-4e4b-b010-0a137c557592 tempest-VolumesImageMetadata-1673542771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43b68d89-e4be-4eea-9a62-8bb6ebf662ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:36:50 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-5f6f9f41-7a7e-4e4b-b010-0a137c557592 tempest-VolumesImageMetadata-1673542771 None] Volume volume-b9a535f8-485e-4e23-9acd-cd84fdedf7dc (b9a535f8-485e-4e23-9acd-cd84fdedf7dc): created successfully Sep 18 21:36:50 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-5f6f9f41-7a7e-4e4b-b010-0a137c557592 tempest-VolumesImageMetadata-1673542771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43b68d89-e4be-4eea-9a62-8bb6ebf662ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:36:50 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-5f6f9f41-7a7e-4e4b-b010-0a137c557592 tempest-VolumesImageMetadata-1673542771 None] Flow 'volume_create_manager' (a197d63a-7bba-4d23-8aac-d9519f90d504) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:36:50 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-5f6f9f41-7a7e-4e4b-b010-0a137c557592 tempest-VolumesImageMetadata-1673542771 None] Created volume successfully. Sep 18 21:36:50 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-75a47fe4-a8a5-49c8-a32a-94ac6aa66f3b tempest-GroupSnapshotsV319Test-171014762 None] Group tempest-GroupSnapshotsV319Test-Group-213731600: creating Sep 18 21:36:50 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-75a47fe4-a8a5-49c8-a32a-94ac6aa66f3b tempest-GroupSnapshotsV319Test-171014762 None] Group tempest-GroupSnapshotsV319Test-Group-213731600: created successfully Sep 18 21:36:50 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-75a47fe4-a8a5-49c8-a32a-94ac6aa66f3b tempest-GroupSnapshotsV319Test-171014762 None] Create group completed successfully. Sep 18 21:36:51 devstack cinder-volume[86136]: INFO cinder.volume.manager [req-e3d977c9-e6b5-4da8-ab2c-1a6b80627c00 req-ac1bd521-6149-460d-b9a8-228320b6ef57 tempest-ServerActionsTestOtherA-232293627 None] Terminate volume connection completed successfully. Sep 18 21:36:51 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [req-e3d977c9-e6b5-4da8-ab2c-1a6b80627c00 req-ac1bd521-6149-460d-b9a8-228320b6ef57 tempest-ServerActionsTestOtherA-232293627 None] Deleting attachment 0956e845-e9ab-4cb6-9a28-835fa356fccd. {{(pid=86136) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 18 21:36:52 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f62a5df-0dd1-4f5e-8a34-1ba06f3a5d3a tempest-GroupSnapshotsV319Test-171014762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:36:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-7f62a5df-0dd1-4f5e-8a34-1ba06f3a5d3a tempest-GroupSnapshotsV319Test-171014762 None] Flow 'volume_create_manager' (0033a218-e963-418b-bc6a-4fd60023fdc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:36:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-7f62a5df-0dd1-4f5e-8a34-1ba06f3a5d3a tempest-GroupSnapshotsV319Test-171014762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c1b8d09-825d-4dee-aa4d-788007a5deba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:36:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-7f62a5df-0dd1-4f5e-8a34-1ba06f3a5d3a tempest-GroupSnapshotsV319Test-171014762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c1b8d09-825d-4dee-aa4d-788007a5deba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:36:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-490837254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f40d6b43-9ded-4019-b38e-06d35c4717ac,host='devstack@QuobyteHD#QuobyteHD',id=55223be7-cd41-4633-b6fc-75f3bd0ffd6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='036b3f95948141ea9b945dec2e619d40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:36:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:36:53Z,use_quota=True,user_id='7aea83f134cd417ea36f7aa2712b75b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373f9530-82d3-44c8-ba2b-a84fbb3150a8),volume_type_id=373f9530-82d3-44c8-ba2b-a84fbb3150a8)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:36:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-7f62a5df-0dd1-4f5e-8a34-1ba06f3a5d3a tempest-GroupSnapshotsV319Test-171014762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0c7f9fe-f06d-4662-8318-d103c4c51855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:36:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-7f62a5df-0dd1-4f5e-8a34-1ba06f3a5d3a tempest-GroupSnapshotsV319Test-171014762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0c7f9fe-f06d-4662-8318-d103c4c51855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:36:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-7f62a5df-0dd1-4f5e-8a34-1ba06f3a5d3a tempest-GroupSnapshotsV319Test-171014762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3038b710-ae61-437e-b5a8-ba3b9a7567f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:36:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-7f62a5df-0dd1-4f5e-8a34-1ba06f3a5d3a tempest-GroupSnapshotsV319Test-171014762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3038b710-ae61-437e-b5a8-ba3b9a7567f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55223be7-cd41-4633-b6fc-75f3bd0ffd6f', 'volume_name': 'volume-55223be7-cd41-4633-b6fc-75f3bd0ffd6f', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:36:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-7f62a5df-0dd1-4f5e-8a34-1ba06f3a5d3a tempest-GroupSnapshotsV319Test-171014762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f4782ea-7e00-4056-af9e-3302a7895b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:36:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-7f62a5df-0dd1-4f5e-8a34-1ba06f3a5d3a tempest-GroupSnapshotsV319Test-171014762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f4782ea-7e00-4056-af9e-3302a7895b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:36:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-7f62a5df-0dd1-4f5e-8a34-1ba06f3a5d3a tempest-GroupSnapshotsV319Test-171014762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (543cf57e-19f1-41c6-a81f-23e39b835429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:36:52 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-7f62a5df-0dd1-4f5e-8a34-1ba06f3a5d3a tempest-GroupSnapshotsV319Test-171014762 None] Volume 55223be7-cd41-4633-b6fc-75f3bd0ffd6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55223be7-cd41-4633-b6fc-75f3bd0ffd6f', 'volume_size': 1} Sep 18 21:36:52 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-7f62a5df-0dd1-4f5e-8a34-1ba06f3a5d3a tempest-GroupSnapshotsV319Test-171014762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:36:52 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-7f62a5df-0dd1-4f5e-8a34-1ba06f3a5d3a tempest-GroupSnapshotsV319Test-171014762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:36:52 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-7f62a5df-0dd1-4f5e-8a34-1ba06f3a5d3a tempest-GroupSnapshotsV319Test-171014762 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f40d6b43-9ded-4019-b38e-06d35c4717ac,created_at=2026-09-18T19:36:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-490837254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f40d6b43-9ded-4019-b38e-06d35c4717ac,host='devstack@QuobyteHD#QuobyteHD',id=55223be7-cd41-4633-b6fc-75f3bd0ffd6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='036b3f95948141ea9b945dec2e619d40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:36:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:36:53Z,use_quota=True,user_id='7aea83f134cd417ea36f7aa2712b75b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373f9530-82d3-44c8-ba2b-a84fbb3150a8),volume_type_id=373f9530-82d3-44c8-ba2b-a84fbb3150a8)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:36:52 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-7f62a5df-0dd1-4f5e-8a34-1ba06f3a5d3a tempest-GroupSnapshotsV319Test-171014762 None] Creating volume 55223be7-cd41-4633-b6fc-75f3bd0ffd6f {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:36:52 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-7f62a5df-0dd1-4f5e-8a34-1ba06f3a5d3a tempest-GroupSnapshotsV319Test-171014762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:36:52 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-7f62a5df-0dd1-4f5e-8a34-1ba06f3a5d3a tempest-GroupSnapshotsV319Test-171014762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:36:52 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-7f62a5df-0dd1-4f5e-8a34-1ba06f3a5d3a tempest-GroupSnapshotsV319Test-171014762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:36:52 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-7f62a5df-0dd1-4f5e-8a34-1ba06f3a5d3a tempest-GroupSnapshotsV319Test-171014762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:36:52 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-7f62a5df-0dd1-4f5e-8a34-1ba06f3a5d3a tempest-GroupSnapshotsV319Test-171014762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:36:52 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-7f62a5df-0dd1-4f5e-8a34-1ba06f3a5d3a tempest-GroupSnapshotsV319Test-171014762 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:36:52 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-7f62a5df-0dd1-4f5e-8a34-1ba06f3a5d3a tempest-GroupSnapshotsV319Test-171014762 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:36:52 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-7f62a5df-0dd1-4f5e-8a34-1ba06f3a5d3a tempest-GroupSnapshotsV319Test-171014762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-55223be7-cd41-4633-b6fc-75f3bd0ffd6f 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:36:52 devstack sudo[91841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-55223be7-cd41-4633-b6fc-75f3bd0ffd6f 1073741824 Sep 18 21:36:52 devstack sudo[91841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:36:53 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-12ac1edc-a6a9-438d-9358-6b2fd1dbf6ce tempest-VolumesImageMetadata-1673542771 None] Acquiring lock "cinder-b9a535f8-485e-4e23-9acd-cd84fdedf7dc-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:36:53 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-12ac1edc-a6a9-438d-9358-6b2fd1dbf6ce tempest-VolumesImageMetadata-1673542771 None] Lock "cinder-b9a535f8-485e-4e23-9acd-cd84fdedf7dc-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:36:53 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-12ac1edc-a6a9-438d-9358-6b2fd1dbf6ce tempest-VolumesImageMetadata-1673542771 None] Acquiring lock "cinder-quobyte-b9a535f8-485e-4e23-9acd-cd84fdedf7dc" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:36:53 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-12ac1edc-a6a9-438d-9358-6b2fd1dbf6ce tempest-VolumesImageMetadata-1673542771 None] Lock "cinder-quobyte-b9a535f8-485e-4e23-9acd-cd84fdedf7dc" acquired by "delete_volume" :: waited 0.040s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:36:53 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[c019a446-37df-4697-9da9-67bfc56334e0]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:36:53 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-12ac1edc-a6a9-438d-9358-6b2fd1dbf6ce tempest-VolumesImageMetadata-1673542771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b9a535f8-485e-4e23-9acd-cd84fdedf7dc {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:36:53 devstack sudo[91841]: pam_unix(sudo:session): session closed for user root Sep 18 21:36:53 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-7f62a5df-0dd1-4f5e-8a34-1ba06f3a5d3a tempest-GroupSnapshotsV319Test-171014762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-55223be7-cd41-4633-b6fc-75f3bd0ffd6f 1073741824" returned: 0 in 0.967s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:36:53 devstack sudo[91869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b9a535f8-485e-4e23-9acd-cd84fdedf7dc Sep 18 21:36:53 devstack sudo[91869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:36:53 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-7f62a5df-0dd1-4f5e-8a34-1ba06f3a5d3a tempest-GroupSnapshotsV319Test-171014762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-55223be7-cd41-4633-b6fc-75f3bd0ffd6f {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:36:53 devstack sudo[92208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-55223be7-cd41-4633-b6fc-75f3bd0ffd6f Sep 18 21:36:53 devstack sudo[92208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:36:54 devstack sudo[92208]: pam_unix(sudo:session): session closed for user root Sep 18 21:36:54 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-7f62a5df-0dd1-4f5e-8a34-1ba06f3a5d3a tempest-GroupSnapshotsV319Test-171014762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-55223be7-cd41-4633-b6fc-75f3bd0ffd6f" returned: 0 in 0.514s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:36:54 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-7f62a5df-0dd1-4f5e-8a34-1ba06f3a5d3a tempest-GroupSnapshotsV319Test-171014762 None] <== create_volume: return (1599ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:36:54 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-7f62a5df-0dd1-4f5e-8a34-1ba06f3a5d3a tempest-GroupSnapshotsV319Test-171014762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.605s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:36:54 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-7f62a5df-0dd1-4f5e-8a34-1ba06f3a5d3a tempest-GroupSnapshotsV319Test-171014762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (543cf57e-19f1-41c6-a81f-23e39b835429) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55223be7-cd41-4633-b6fc-75f3bd0ffd6f', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:36:54 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-7f62a5df-0dd1-4f5e-8a34-1ba06f3a5d3a tempest-GroupSnapshotsV319Test-171014762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e7d0841-3c2a-4301-bffd-efd3b43f5764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:36:54 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-7f62a5df-0dd1-4f5e-8a34-1ba06f3a5d3a tempest-GroupSnapshotsV319Test-171014762 None] Volume volume-55223be7-cd41-4633-b6fc-75f3bd0ffd6f (55223be7-cd41-4633-b6fc-75f3bd0ffd6f): created successfully Sep 18 21:36:54 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-7f62a5df-0dd1-4f5e-8a34-1ba06f3a5d3a tempest-GroupSnapshotsV319Test-171014762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e7d0841-3c2a-4301-bffd-efd3b43f5764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:36:54 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-7f62a5df-0dd1-4f5e-8a34-1ba06f3a5d3a tempest-GroupSnapshotsV319Test-171014762 None] Flow 'volume_create_manager' (0033a218-e963-418b-bc6a-4fd60023fdc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:36:54 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-7f62a5df-0dd1-4f5e-8a34-1ba06f3a5d3a tempest-GroupSnapshotsV319Test-171014762 None] Created volume successfully. Sep 18 21:36:54 devstack sudo[91869]: pam_unix(sudo:session): session closed for user root Sep 18 21:36:54 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-12ac1edc-a6a9-438d-9358-6b2fd1dbf6ce tempest-VolumesImageMetadata-1673542771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b9a535f8-485e-4e23-9acd-cd84fdedf7dc" returned: 0 in 1.059s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:36:54 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-12ac1edc-a6a9-438d-9358-6b2fd1dbf6ce tempest-VolumesImageMetadata-1673542771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b9a535f8-485e-4e23-9acd-cd84fdedf7dc {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:36:54 devstack sudo[92239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b9a535f8-485e-4e23-9acd-cd84fdedf7dc Sep 18 21:36:54 devstack sudo[92239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:36:55 devstack sudo[92239]: pam_unix(sudo:session): session closed for user root Sep 18 21:36:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-12ac1edc-a6a9-438d-9358-6b2fd1dbf6ce tempest-VolumesImageMetadata-1673542771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b9a535f8-485e-4e23-9acd-cd84fdedf7dc" returned: 0 in 0.389s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:36:55 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-12ac1edc-a6a9-438d-9358-6b2fd1dbf6ce tempest-VolumesImageMetadata-1673542771 None] Lock "cinder-quobyte-b9a535f8-485e-4e23-9acd-cd84fdedf7dc" released by "delete_volume" :: held 1.512s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:36:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-e3d977c9-e6b5-4da8-ab2c-1a6b80627c00 req-1677ee70-192d-4b97-80d2-911923618187 tempest-ServerActionsTestOtherA-232293627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:36:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-e3d977c9-e6b5-4da8-ab2c-1a6b80627c00 req-1677ee70-192d-4b97-80d2-911923618187 tempest-ServerActionsTestOtherA-232293627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:36:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-e3d977c9-e6b5-4da8-ab2c-1a6b80627c00 req-1677ee70-192d-4b97-80d2-911923618187 tempest-ServerActionsTestOtherA-232293627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:36:55 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-12ac1edc-a6a9-438d-9358-6b2fd1dbf6ce tempest-VolumesImageMetadata-1673542771 None] Created reservations ['85b081b2-2d05-467b-b7eb-686a63fa7d3c', '6f248696-a654-43de-a772-31ee7eb80595', '01405648-c354-4745-a6c4-80f3bc211b2a', '18507420-ea2c-40e1-8585-3c8ae2393b55'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:36:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [req-e3d977c9-e6b5-4da8-ab2c-1a6b80627c00 req-1677ee70-192d-4b97-80d2-911923618187 tempest-ServerActionsTestOtherA-232293627 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff', 'name': 'volume-4ab86e2d-fb18-4f12-bb73-cece1359268e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '100bba3b-5d68-4ef7-a199-32d3879f9cbf', 'enforce_multipath': True} {{(pid=86136) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 18 21:36:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-12ac1edc-a6a9-438d-9358-6b2fd1dbf6ce tempest-VolumesImageMetadata-1673542771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:36:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-12ac1edc-a6a9-438d-9358-6b2fd1dbf6ce tempest-VolumesImageMetadata-1673542771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:36:55 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-12ac1edc-a6a9-438d-9358-6b2fd1dbf6ce tempest-VolumesImageMetadata-1673542771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:36:55 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-12ac1edc-a6a9-438d-9358-6b2fd1dbf6ce tempest-VolumesImageMetadata-1673542771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:36:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-12ac1edc-a6a9-438d-9358-6b2fd1dbf6ce tempest-VolumesImageMetadata-1673542771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:36:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-12ac1edc-a6a9-438d-9358-6b2fd1dbf6ce tempest-VolumesImageMetadata-1673542771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:36:55 devstack cinder-volume[86136]: INFO cinder.volume.manager [req-e3d977c9-e6b5-4da8-ab2c-1a6b80627c00 req-1677ee70-192d-4b97-80d2-911923618187 tempest-ServerActionsTestOtherA-232293627 None] attachment_update completed successfully. Sep 18 21:36:55 devstack sudo[92253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:36:55 devstack sudo[92253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:36:55 devstack sudo[92253]: pam_unix(sudo:session): session closed for user root Sep 18 21:36:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-12ac1edc-a6a9-438d-9358-6b2fd1dbf6ce tempest-VolumesImageMetadata-1673542771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.408s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:36:55 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-12ac1edc-a6a9-438d-9358-6b2fd1dbf6ce tempest-VolumesImageMetadata-1673542771 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:36:55 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-12ac1edc-a6a9-438d-9358-6b2fd1dbf6ce tempest-VolumesImageMetadata-1673542771 None] Deleted volume successfully. Sep 18 21:36:55 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-12ac1edc-a6a9-438d-9358-6b2fd1dbf6ce tempest-VolumesImageMetadata-1673542771 None] Lock "cinder-b9a535f8-485e-4e23-9acd-cd84fdedf7dc-delete_volume" released by "delete_volume" :: held 2.355s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:36:56 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-4f107dfe-3ecc-41b6-9f13-7030afa44109 tempest-GroupSnapshotsV319Test-171014762 None] GroupSnapshot efac85ed-7fb3-4400-8b71-198a089d9fca: creating. Sep 18 21:36:56 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-4f107dfe-3ecc-41b6-9f13-7030afa44109 tempest-GroupSnapshotsV319Test-171014762 None] Group snapshot efac85ed-7fb3-4400-8b71-198a089d9fca: creating. {{(pid=86136) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 18 21:36:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-4f107dfe-3ecc-41b6-9f13-7030afa44109 tempest-GroupSnapshotsV319Test-171014762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:36:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-4f107dfe-3ecc-41b6-9f13-7030afa44109 tempest-GroupSnapshotsV319Test-171014762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:36:56 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-4f107dfe-3ecc-41b6-9f13-7030afa44109 tempest-GroupSnapshotsV319Test-171014762 None] Creating offline snapshot 274b12fd-3e16-4ff0-b119-69b5575bb387 of volume 55223be7-cd41-4633-b6fc-75f3bd0ffd6f {{(pid=86136) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 21:36:56 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[0abdacfc-406c-40e2-bf97-4958559e7ec4]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:36:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-4f107dfe-3ecc-41b6-9f13-7030afa44109 tempest-GroupSnapshotsV319Test-171014762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-55223be7-cd41-4633-b6fc-75f3bd0ffd6f {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:36:56 devstack sudo[92270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-55223be7-cd41-4633-b6fc-75f3bd0ffd6f Sep 18 21:36:56 devstack sudo[92270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:36:57 devstack sudo[92270]: pam_unix(sudo:session): session closed for user root Sep 18 21:36:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-4f107dfe-3ecc-41b6-9f13-7030afa44109 tempest-GroupSnapshotsV319Test-171014762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-55223be7-cd41-4633-b6fc-75f3bd0ffd6f" returned: 0 in 0.935s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:36:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-4f107dfe-3ecc-41b6-9f13-7030afa44109 tempest-GroupSnapshotsV319Test-171014762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-55223be7-cd41-4633-b6fc-75f3bd0ffd6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-55223be7-cd41-4633-b6fc-75f3bd0ffd6f.274b12fd-3e16-4ff0-b119-69b5575bb387 1G {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:36:57 devstack sudo[92302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-55223be7-cd41-4633-b6fc-75f3bd0ffd6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-55223be7-cd41-4633-b6fc-75f3bd0ffd6f.274b12fd-3e16-4ff0-b119-69b5575bb387 1G Sep 18 21:36:57 devstack sudo[92302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:36:57 devstack sudo[92302]: pam_unix(sudo:session): session closed for user root Sep 18 21:36:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-4f107dfe-3ecc-41b6-9f13-7030afa44109 tempest-GroupSnapshotsV319Test-171014762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-55223be7-cd41-4633-b6fc-75f3bd0ffd6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-55223be7-cd41-4633-b6fc-75f3bd0ffd6f.274b12fd-3e16-4ff0-b119-69b5575bb387 1G" returned: 0 in 0.714s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:36:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-4f107dfe-3ecc-41b6-9f13-7030afa44109 tempest-GroupSnapshotsV319Test-171014762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55223be7-cd41-4633-b6fc-75f3bd0ffd6f -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-55223be7-cd41-4633-b6fc-75f3bd0ffd6f.274b12fd-3e16-4ff0-b119-69b5575bb387 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:36:58 devstack sudo[92310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55223be7-cd41-4633-b6fc-75f3bd0ffd6f -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-55223be7-cd41-4633-b6fc-75f3bd0ffd6f.274b12fd-3e16-4ff0-b119-69b5575bb387 Sep 18 21:36:58 devstack sudo[92310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:36:58 devstack sudo[92310]: pam_unix(sudo:session): session closed for user root Sep 18 21:36:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-4f107dfe-3ecc-41b6-9f13-7030afa44109 tempest-GroupSnapshotsV319Test-171014762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55223be7-cd41-4633-b6fc-75f3bd0ffd6f -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-55223be7-cd41-4633-b6fc-75f3bd0ffd6f.274b12fd-3e16-4ff0-b119-69b5575bb387" returned: 0 in 0.459s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:36:58 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-4f107dfe-3ecc-41b6-9f13-7030afa44109 tempest-GroupSnapshotsV319Test-171014762 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-55223be7-cd41-4633-b6fc-75f3bd0ffd6f.274b12fd-3e16-4ff0-b119-69b5575bb387 is being set with open permissions: ugo+rw: NotImplementedError Sep 18 21:36:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-4f107dfe-3ecc-41b6-9f13-7030afa44109 tempest-GroupSnapshotsV319Test-171014762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-55223be7-cd41-4633-b6fc-75f3bd0ffd6f.274b12fd-3e16-4ff0-b119-69b5575bb387 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:36:58 devstack sudo[92317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-55223be7-cd41-4633-b6fc-75f3bd0ffd6f.274b12fd-3e16-4ff0-b119-69b5575bb387 Sep 18 21:36:58 devstack sudo[92317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:36:59 devstack sudo[92317]: pam_unix(sudo:session): session closed for user root Sep 18 21:36:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-4f107dfe-3ecc-41b6-9f13-7030afa44109 tempest-GroupSnapshotsV319Test-171014762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-55223be7-cd41-4633-b6fc-75f3bd0ffd6f.274b12fd-3e16-4ff0-b119-69b5575bb387" returned: 0 in 0.618s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:36:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-4f107dfe-3ecc-41b6-9f13-7030afa44109 tempest-GroupSnapshotsV319Test-171014762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-55223be7-cd41-4633-b6fc-75f3bd0ffd6f.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:36:59 devstack sudo[92320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-55223be7-cd41-4633-b6fc-75f3bd0ffd6f.info Sep 18 21:36:59 devstack sudo[92320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:36:59 devstack sudo[92320]: pam_unix(sudo:session): session closed for user root Sep 18 21:36:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-4f107dfe-3ecc-41b6-9f13-7030afa44109 tempest-GroupSnapshotsV319Test-171014762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-55223be7-cd41-4633-b6fc-75f3bd0ffd6f.info" returned: 0 in 0.389s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:36:59 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-4f107dfe-3ecc-41b6-9f13-7030afa44109 tempest-GroupSnapshotsV319Test-171014762 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-55223be7-cd41-4633-b6fc-75f3bd0ffd6f.info is being set with open permissions: ugo+rw: NotImplementedError Sep 18 21:36:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-4f107dfe-3ecc-41b6-9f13-7030afa44109 tempest-GroupSnapshotsV319Test-171014762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-55223be7-cd41-4633-b6fc-75f3bd0ffd6f.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:36:59 devstack sudo[92323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-55223be7-cd41-4633-b6fc-75f3bd0ffd6f.info Sep 18 21:36:59 devstack sudo[92323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:36:59 devstack sudo[92323]: pam_unix(sudo:session): session closed for user root Sep 18 21:36:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-4f107dfe-3ecc-41b6-9f13-7030afa44109 tempest-GroupSnapshotsV319Test-171014762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-55223be7-cd41-4633-b6fc-75f3bd0ffd6f.info" returned: 0 in 0.399s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-4f107dfe-3ecc-41b6-9f13-7030afa44109 tempest-GroupSnapshotsV319Test-171014762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.792s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:37:00 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-4f107dfe-3ecc-41b6-9f13-7030afa44109 tempest-GroupSnapshotsV319Test-171014762 None] group_snapshot efac85ed-7fb3-4400-8b71-198a089d9fca: created successfully Sep 18 21:37:01 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-66ea801c-a895-4c18-b21e-1175ed112241 tempest-GroupSnapshotsV319Test-171014762 None] group_snapshot efac85ed-7fb3-4400-8b71-198a089d9fca: deleting Sep 18 21:37:01 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-66ea801c-a895-4c18-b21e-1175ed112241 tempest-GroupSnapshotsV319Test-171014762 None] group_snapshot efac85ed-7fb3-4400-8b71-198a089d9fca: deleting {{(pid=86136) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 18 21:37:01 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-66ea801c-a895-4c18-b21e-1175ed112241 tempest-GroupSnapshotsV319Test-171014762 None] Acquiring lock "cinder-quobyte-55223be7-cd41-4633-b6fc-75f3bd0ffd6f" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:37:01 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-66ea801c-a895-4c18-b21e-1175ed112241 tempest-GroupSnapshotsV319Test-171014762 None] Lock "cinder-quobyte-55223be7-cd41-4633-b6fc-75f3bd0ffd6f" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:37:01 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-66ea801c-a895-4c18-b21e-1175ed112241 tempest-GroupSnapshotsV319Test-171014762 None] Acquiring lock "cinder-quobyte-274b12fd-3e16-4ff0-b119-69b5575bb387" by "_delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:37:01 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-66ea801c-a895-4c18-b21e-1175ed112241 tempest-GroupSnapshotsV319Test-171014762 None] Lock "cinder-quobyte-274b12fd-3e16-4ff0-b119-69b5575bb387" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:37:01 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-66ea801c-a895-4c18-b21e-1175ed112241 tempest-GroupSnapshotsV319Test-171014762 None] Deleting offline snapshot 274b12fd-3e16-4ff0-b119-69b5575bb387 of volume 55223be7-cd41-4633-b6fc-75f3bd0ffd6f {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 21:37:01 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-66ea801c-a895-4c18-b21e-1175ed112241 tempest-GroupSnapshotsV319Test-171014762 None] snapshot_file for this snap is: volume-55223be7-cd41-4633-b6fc-75f3bd0ffd6f.274b12fd-3e16-4ff0-b119-69b5575bb387 {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 21:37:01 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b0b50d-2a10-4609-af06-e97464a4a0e6]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:37:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-66ea801c-a895-4c18-b21e-1175ed112241 tempest-GroupSnapshotsV319Test-171014762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-55223be7-cd41-4633-b6fc-75f3bd0ffd6f.274b12fd-3e16-4ff0-b119-69b5575bb387 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:01 devstack sudo[92328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-55223be7-cd41-4633-b6fc-75f3bd0ffd6f.274b12fd-3e16-4ff0-b119-69b5575bb387 Sep 18 21:37:01 devstack sudo[92328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:02 devstack sudo[92328]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:02 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-66ea801c-a895-4c18-b21e-1175ed112241 tempest-GroupSnapshotsV319Test-171014762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-55223be7-cd41-4633-b6fc-75f3bd0ffd6f.274b12fd-3e16-4ff0-b119-69b5575bb387" returned: 0 in 0.877s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:02 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-66ea801c-a895-4c18-b21e-1175ed112241 tempest-GroupSnapshotsV319Test-171014762 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55223be7-cd41-4633-b6fc-75f3bd0ffd6f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86136) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 21:37:02 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb272f0c-0993-4d93-990a-31ad7c9a1db5]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:37:02 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-66ea801c-a895-4c18-b21e-1175ed112241 tempest-GroupSnapshotsV319Test-171014762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-55223be7-cd41-4633-b6fc-75f3bd0ffd6f {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:02 devstack sudo[92334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-55223be7-cd41-4633-b6fc-75f3bd0ffd6f Sep 18 21:37:02 devstack sudo[92334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:03 devstack sudo[92334]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-66ea801c-a895-4c18-b21e-1175ed112241 tempest-GroupSnapshotsV319Test-171014762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-55223be7-cd41-4633-b6fc-75f3bd0ffd6f" returned: 0 in 0.895s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-66ea801c-a895-4c18-b21e-1175ed112241 tempest-GroupSnapshotsV319Test-171014762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-55223be7-cd41-4633-b6fc-75f3bd0ffd6f.274b12fd-3e16-4ff0-b119-69b5575bb387 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:03 devstack sudo[92339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-55223be7-cd41-4633-b6fc-75f3bd0ffd6f.274b12fd-3e16-4ff0-b119-69b5575bb387 Sep 18 21:37:03 devstack sudo[92339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:04 devstack sudo[92339]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-66ea801c-a895-4c18-b21e-1175ed112241 tempest-GroupSnapshotsV319Test-171014762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-55223be7-cd41-4633-b6fc-75f3bd0ffd6f.274b12fd-3e16-4ff0-b119-69b5575bb387" returned: 0 in 1.013s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-66ea801c-a895-4c18-b21e-1175ed112241 tempest-GroupSnapshotsV319Test-171014762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-55223be7-cd41-4633-b6fc-75f3bd0ffd6f.274b12fd-3e16-4ff0-b119-69b5575bb387 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:04 devstack sudo[92344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-55223be7-cd41-4633-b6fc-75f3bd0ffd6f.274b12fd-3e16-4ff0-b119-69b5575bb387 Sep 18 21:37:04 devstack sudo[92344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:05 devstack cinder-volume[86136]: DEBUG oslo_service.periodic_task [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86136) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 21:37:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:37:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:37:05 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:37:05 devstack sudo[92344]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:05 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:37:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:37:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-66ea801c-a895-4c18-b21e-1175ed112241 tempest-GroupSnapshotsV319Test-171014762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-55223be7-cd41-4633-b6fc-75f3bd0ffd6f.274b12fd-3e16-4ff0-b119-69b5575bb387" returned: 0 in 0.543s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:05 devstack sudo[92348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:37:05 devstack sudo[92348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:05 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-66ea801c-a895-4c18-b21e-1175ed112241 tempest-GroupSnapshotsV319Test-171014762 None] Lock "cinder-quobyte-274b12fd-3e16-4ff0-b119-69b5575bb387" released by "_delete_snapshot" :: held 3.534s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:37:05 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-66ea801c-a895-4c18-b21e-1175ed112241 tempest-GroupSnapshotsV319Test-171014762 None] Lock "cinder-quobyte-55223be7-cd41-4633-b6fc-75f3bd0ffd6f" released by "delete_snapshot" :: held 3.579s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:37:05 devstack cinder-volume[86136]: WARNING cinder.quota [None req-66ea801c-a895-4c18-b21e-1175ed112241 tempest-GroupSnapshotsV319Test-171014762 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2029622680 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2029622680, it is now deprecated. Please use the default quota class for default quota. Sep 18 21:37:05 devstack cinder-volume[86136]: WARNING cinder.quota [None req-66ea801c-a895-4c18-b21e-1175ed112241 tempest-GroupSnapshotsV319Test-171014762 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-2029622680 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-2029622680, it is now deprecated. Please use the default quota class for default quota. Sep 18 21:37:05 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-66ea801c-a895-4c18-b21e-1175ed112241 tempest-GroupSnapshotsV319Test-171014762 None] Created reservations ['cd2ec3f2-cd01-4c48-a0dd-bc847bc48603', '3719e471-e537-4796-aea1-dfaa33d35c50', '148ad6c0-14dd-4180-b74b-880e846fa610', 'ed7234fb-9c71-4185-9fac-0d8136714479'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:37:05 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-66ea801c-a895-4c18-b21e-1175ed112241 tempest-GroupSnapshotsV319Test-171014762 None] group_snapshot efac85ed-7fb3-4400-8b71-198a089d9fca: deleted successfully Sep 18 21:37:05 devstack sudo[92348]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.596s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:05 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:37:05 devstack cinder-volume[86136]: DEBUG oslo_service.periodic_task [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Running periodic task VolumeManager._thread_info {{(pid=86136) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 21:37:05 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] thread count: 28 {{(pid=86136) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 18 21:37:05 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] thread info: [<_MainThread(MainThread, started 138548347871360)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86136) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 18 21:37:06 devstack cinder-volume[86136]: DEBUG dbcounter [-] [86136] Writing DB stats cinder:SELECT=87,cinder:INSERT=22,cinder:UPDATE=70,cinder:DELETE=4 {{(pid=86136) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 21:37:06 devstack cinder-volume[86136]: DEBUG dbcounter [-] [86136] Writing DB stats cinder:SELECT=79,cinder:INSERT=31,cinder:UPDATE=63,cinder:DELETE=6 {{(pid=86136) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 21:37:06 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-94d516db-495a-43ec-93fb-beed82d7ba3c tempest-GroupSnapshotsV319Test-171014762 None] Acquiring lock "cinder-quobyte-55223be7-cd41-4633-b6fc-75f3bd0ffd6f" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:37:06 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-94d516db-495a-43ec-93fb-beed82d7ba3c tempest-GroupSnapshotsV319Test-171014762 None] Lock "cinder-quobyte-55223be7-cd41-4633-b6fc-75f3bd0ffd6f" acquired by "delete_volume" :: waited 0.054s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:37:06 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac4e0ac-8a4f-4b47-81d9-58cbc4252ab8]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:37:06 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-94d516db-495a-43ec-93fb-beed82d7ba3c tempest-GroupSnapshotsV319Test-171014762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-55223be7-cd41-4633-b6fc-75f3bd0ffd6f {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:07 devstack sudo[92351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-55223be7-cd41-4633-b6fc-75f3bd0ffd6f Sep 18 21:37:07 devstack sudo[92351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:07 devstack sudo[92351]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:07 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-94d516db-495a-43ec-93fb-beed82d7ba3c tempest-GroupSnapshotsV319Test-171014762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-55223be7-cd41-4633-b6fc-75f3bd0ffd6f" returned: 0 in 0.521s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:07 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-94d516db-495a-43ec-93fb-beed82d7ba3c tempest-GroupSnapshotsV319Test-171014762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-55223be7-cd41-4633-b6fc-75f3bd0ffd6f {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:07 devstack sudo[92356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-55223be7-cd41-4633-b6fc-75f3bd0ffd6f Sep 18 21:37:07 devstack sudo[92356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:07 devstack sudo[92356]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:07 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-94d516db-495a-43ec-93fb-beed82d7ba3c tempest-GroupSnapshotsV319Test-171014762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-55223be7-cd41-4633-b6fc-75f3bd0ffd6f" returned: 0 in 0.273s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:07 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-94d516db-495a-43ec-93fb-beed82d7ba3c tempest-GroupSnapshotsV319Test-171014762 None] Lock "cinder-quobyte-55223be7-cd41-4633-b6fc-75f3bd0ffd6f" released by "delete_volume" :: held 0.917s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:37:07 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-94d516db-495a-43ec-93fb-beed82d7ba3c tempest-GroupSnapshotsV319Test-171014762 None] Created reservations ['7c2b7b77-02e9-4921-8f63-59a2d5c97e1a'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:37:07 devstack cinder-volume[86136]: WARNING cinder.quota [None req-94d516db-495a-43ec-93fb-beed82d7ba3c tempest-GroupSnapshotsV319Test-171014762 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-2029622680 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-2029622680, it is now deprecated. Please use the default quota class for default quota. Sep 18 21:37:07 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-94d516db-495a-43ec-93fb-beed82d7ba3c tempest-GroupSnapshotsV319Test-171014762 None] Created reservations ['cf4c2920-32ea-48df-9d55-85ce1e4c3a22', 'fd45fdaa-8c67-4262-a871-48cd0fc8f36a', '9112f235-30c7-4baa-b826-98611e473240', '5b19b080-9342-4246-98e7-52db27357480'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:37:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-94d516db-495a-43ec-93fb-beed82d7ba3c tempest-GroupSnapshotsV319Test-171014762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:37:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-94d516db-495a-43ec-93fb-beed82d7ba3c tempest-GroupSnapshotsV319Test-171014762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:37:08 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-94d516db-495a-43ec-93fb-beed82d7ba3c tempest-GroupSnapshotsV319Test-171014762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:37:08 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-94d516db-495a-43ec-93fb-beed82d7ba3c tempest-GroupSnapshotsV319Test-171014762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:37:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-94d516db-495a-43ec-93fb-beed82d7ba3c tempest-GroupSnapshotsV319Test-171014762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:37:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-94d516db-495a-43ec-93fb-beed82d7ba3c tempest-GroupSnapshotsV319Test-171014762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:08 devstack sudo[92359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:37:08 devstack sudo[92359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:08 devstack sudo[92359]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-94d516db-495a-43ec-93fb-beed82d7ba3c tempest-GroupSnapshotsV319Test-171014762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.449s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:08 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-94d516db-495a-43ec-93fb-beed82d7ba3c tempest-GroupSnapshotsV319Test-171014762 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:37:08 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-94d516db-495a-43ec-93fb-beed82d7ba3c tempest-GroupSnapshotsV319Test-171014762 None] Delete group completed successfully. Sep 18 21:37:08 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-2219b0ed-3f44-4db1-a1bc-917e17694a63 tempest-VolumesDeleteCascade-280764445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:37:08 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2219b0ed-3f44-4db1-a1bc-917e17694a63 tempest-VolumesDeleteCascade-280764445 None] Flow 'volume_create_manager' (9a46cff6-54cf-4b1a-80f5-266916b0fec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:37:08 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2219b0ed-3f44-4db1-a1bc-917e17694a63 tempest-VolumesDeleteCascade-280764445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (612b8ac2-03c6-467c-88a5-12fef2189e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:37:08 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2219b0ed-3f44-4db1-a1bc-917e17694a63 tempest-VolumesDeleteCascade-280764445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (612b8ac2-03c6-467c-88a5-12fef2189e9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:37:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-449776480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=189e02bf-d073-46fe-a741-7552e0282e78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e80ec8f3c143431a98eafe964c7179e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:37:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:37:09Z,use_quota=True,user_id='d5f58a07c7a64f8298455a27e6d28098',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:37:08 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2219b0ed-3f44-4db1-a1bc-917e17694a63 tempest-VolumesDeleteCascade-280764445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9ca077a-5850-4fa5-8ca2-392291054569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:37:08 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2219b0ed-3f44-4db1-a1bc-917e17694a63 tempest-VolumesDeleteCascade-280764445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9ca077a-5850-4fa5-8ca2-392291054569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:37:08 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2219b0ed-3f44-4db1-a1bc-917e17694a63 tempest-VolumesDeleteCascade-280764445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8533fa26-f873-47b2-a06c-2b1aa29032c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:37:08 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2219b0ed-3f44-4db1-a1bc-917e17694a63 tempest-VolumesDeleteCascade-280764445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8533fa26-f873-47b2-a06c-2b1aa29032c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '189e02bf-d073-46fe-a741-7552e0282e78', 'volume_name': 'volume-189e02bf-d073-46fe-a741-7552e0282e78', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:37:08 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2219b0ed-3f44-4db1-a1bc-917e17694a63 tempest-VolumesDeleteCascade-280764445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dc3fed7-a099-43a2-9fbf-b2f8b5691b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:37:08 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2219b0ed-3f44-4db1-a1bc-917e17694a63 tempest-VolumesDeleteCascade-280764445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dc3fed7-a099-43a2-9fbf-b2f8b5691b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:37:08 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2219b0ed-3f44-4db1-a1bc-917e17694a63 tempest-VolumesDeleteCascade-280764445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bda5507-89ac-4a1f-b22e-8b297b972bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:37:08 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-2219b0ed-3f44-4db1-a1bc-917e17694a63 tempest-VolumesDeleteCascade-280764445 None] Volume 189e02bf-d073-46fe-a741-7552e0282e78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-189e02bf-d073-46fe-a741-7552e0282e78', 'volume_size': 1} Sep 18 21:37:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-2219b0ed-3f44-4db1-a1bc-917e17694a63 tempest-VolumesDeleteCascade-280764445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:37:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-2219b0ed-3f44-4db1-a1bc-917e17694a63 tempest-VolumesDeleteCascade-280764445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:37:08 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-2219b0ed-3f44-4db1-a1bc-917e17694a63 tempest-VolumesDeleteCascade-280764445 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:37:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-449776480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=189e02bf-d073-46fe-a741-7552e0282e78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e80ec8f3c143431a98eafe964c7179e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:37:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:37:09Z,use_quota=True,user_id='d5f58a07c7a64f8298455a27e6d28098',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:37:08 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-2219b0ed-3f44-4db1-a1bc-917e17694a63 tempest-VolumesDeleteCascade-280764445 None] Creating volume 189e02bf-d073-46fe-a741-7552e0282e78 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:37:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-2219b0ed-3f44-4db1-a1bc-917e17694a63 tempest-VolumesDeleteCascade-280764445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:37:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-2219b0ed-3f44-4db1-a1bc-917e17694a63 tempest-VolumesDeleteCascade-280764445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:37:08 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-2219b0ed-3f44-4db1-a1bc-917e17694a63 tempest-VolumesDeleteCascade-280764445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:37:08 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-2219b0ed-3f44-4db1-a1bc-917e17694a63 tempest-VolumesDeleteCascade-280764445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:37:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-2219b0ed-3f44-4db1-a1bc-917e17694a63 tempest-VolumesDeleteCascade-280764445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:37:08 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-2219b0ed-3f44-4db1-a1bc-917e17694a63 tempest-VolumesDeleteCascade-280764445 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:37:08 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-2219b0ed-3f44-4db1-a1bc-917e17694a63 tempest-VolumesDeleteCascade-280764445 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:37:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-2219b0ed-3f44-4db1-a1bc-917e17694a63 tempest-VolumesDeleteCascade-280764445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-189e02bf-d073-46fe-a741-7552e0282e78 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:08 devstack sudo[92362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-189e02bf-d073-46fe-a741-7552e0282e78 1073741824 Sep 18 21:37:08 devstack sudo[92362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:09 devstack sudo[92362]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-2219b0ed-3f44-4db1-a1bc-917e17694a63 tempest-VolumesDeleteCascade-280764445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-189e02bf-d073-46fe-a741-7552e0282e78 1073741824" returned: 0 in 0.562s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-2219b0ed-3f44-4db1-a1bc-917e17694a63 tempest-VolumesDeleteCascade-280764445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-189e02bf-d073-46fe-a741-7552e0282e78 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:09 devstack sudo[92375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-189e02bf-d073-46fe-a741-7552e0282e78 Sep 18 21:37:09 devstack sudo[92375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:09 devstack sudo[92375]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-2219b0ed-3f44-4db1-a1bc-917e17694a63 tempest-VolumesDeleteCascade-280764445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-189e02bf-d073-46fe-a741-7552e0282e78" returned: 0 in 0.344s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:09 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-2219b0ed-3f44-4db1-a1bc-917e17694a63 tempest-VolumesDeleteCascade-280764445 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:37:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-2219b0ed-3f44-4db1-a1bc-917e17694a63 tempest-VolumesDeleteCascade-280764445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:37:09 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2219b0ed-3f44-4db1-a1bc-917e17694a63 tempest-VolumesDeleteCascade-280764445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bda5507-89ac-4a1f-b22e-8b297b972bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-189e02bf-d073-46fe-a741-7552e0282e78', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:37:09 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2219b0ed-3f44-4db1-a1bc-917e17694a63 tempest-VolumesDeleteCascade-280764445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e3b6cbd-3b2c-4c9b-a315-3750a324fbd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:37:09 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-2219b0ed-3f44-4db1-a1bc-917e17694a63 tempest-VolumesDeleteCascade-280764445 None] Volume volume-189e02bf-d073-46fe-a741-7552e0282e78 (189e02bf-d073-46fe-a741-7552e0282e78): created successfully Sep 18 21:37:09 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2219b0ed-3f44-4db1-a1bc-917e17694a63 tempest-VolumesDeleteCascade-280764445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e3b6cbd-3b2c-4c9b-a315-3750a324fbd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:37:09 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2219b0ed-3f44-4db1-a1bc-917e17694a63 tempest-VolumesDeleteCascade-280764445 None] Flow 'volume_create_manager' (9a46cff6-54cf-4b1a-80f5-266916b0fec3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:37:09 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-2219b0ed-3f44-4db1-a1bc-917e17694a63 tempest-VolumesDeleteCascade-280764445 None] Created volume successfully. Sep 18 21:37:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-666f90dd-d529-417a-9061-af40b4910656 tempest-VolumesDeleteCascade-280764445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:37:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-666f90dd-d529-417a-9061-af40b4910656 tempest-VolumesDeleteCascade-280764445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:37:11 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-666f90dd-d529-417a-9061-af40b4910656 tempest-VolumesDeleteCascade-280764445 None] Creating offline snapshot c8bbeaec-4674-47c0-a195-410d3370a04f of volume 189e02bf-d073-46fe-a741-7552e0282e78 {{(pid=86136) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 21:37:11 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d74dc4-18bf-4fc8-8f3c-f857c963a79d]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:37:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-666f90dd-d529-417a-9061-af40b4910656 tempest-VolumesDeleteCascade-280764445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-189e02bf-d073-46fe-a741-7552e0282e78 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:11 devstack sudo[92380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-189e02bf-d073-46fe-a741-7552e0282e78 Sep 18 21:37:11 devstack sudo[92380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:11 devstack sudo[92380]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-666f90dd-d529-417a-9061-af40b4910656 tempest-VolumesDeleteCascade-280764445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-189e02bf-d073-46fe-a741-7552e0282e78" returned: 0 in 0.430s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-666f90dd-d529-417a-9061-af40b4910656 tempest-VolumesDeleteCascade-280764445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-189e02bf-d073-46fe-a741-7552e0282e78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-189e02bf-d073-46fe-a741-7552e0282e78.c8bbeaec-4674-47c0-a195-410d3370a04f 1G {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:11 devstack sudo[92385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-189e02bf-d073-46fe-a741-7552e0282e78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-189e02bf-d073-46fe-a741-7552e0282e78.c8bbeaec-4674-47c0-a195-410d3370a04f 1G Sep 18 21:37:11 devstack sudo[92385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:12 devstack sudo[92385]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-666f90dd-d529-417a-9061-af40b4910656 tempest-VolumesDeleteCascade-280764445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-189e02bf-d073-46fe-a741-7552e0282e78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-189e02bf-d073-46fe-a741-7552e0282e78.c8bbeaec-4674-47c0-a195-410d3370a04f 1G" returned: 0 in 0.533s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-666f90dd-d529-417a-9061-af40b4910656 tempest-VolumesDeleteCascade-280764445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-189e02bf-d073-46fe-a741-7552e0282e78 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-189e02bf-d073-46fe-a741-7552e0282e78.c8bbeaec-4674-47c0-a195-410d3370a04f {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:12 devstack sudo[92415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-189e02bf-d073-46fe-a741-7552e0282e78 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-189e02bf-d073-46fe-a741-7552e0282e78.c8bbeaec-4674-47c0-a195-410d3370a04f Sep 18 21:37:12 devstack sudo[92415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:12 devstack sudo[92415]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-666f90dd-d529-417a-9061-af40b4910656 tempest-VolumesDeleteCascade-280764445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-189e02bf-d073-46fe-a741-7552e0282e78 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-189e02bf-d073-46fe-a741-7552e0282e78.c8bbeaec-4674-47c0-a195-410d3370a04f" returned: 0 in 0.318s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:12 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-666f90dd-d529-417a-9061-af40b4910656 tempest-VolumesDeleteCascade-280764445 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-189e02bf-d073-46fe-a741-7552e0282e78.c8bbeaec-4674-47c0-a195-410d3370a04f is being set with open permissions: ugo+rw Sep 18 21:37:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-666f90dd-d529-417a-9061-af40b4910656 tempest-VolumesDeleteCascade-280764445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-189e02bf-d073-46fe-a741-7552e0282e78.c8bbeaec-4674-47c0-a195-410d3370a04f {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:12 devstack sudo[92420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-189e02bf-d073-46fe-a741-7552e0282e78.c8bbeaec-4674-47c0-a195-410d3370a04f Sep 18 21:37:12 devstack sudo[92420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:12 devstack sudo[92420]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-666f90dd-d529-417a-9061-af40b4910656 tempest-VolumesDeleteCascade-280764445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-189e02bf-d073-46fe-a741-7552e0282e78.c8bbeaec-4674-47c0-a195-410d3370a04f" returned: 0 in 0.253s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-666f90dd-d529-417a-9061-af40b4910656 tempest-VolumesDeleteCascade-280764445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-189e02bf-d073-46fe-a741-7552e0282e78.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:12 devstack sudo[92423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-189e02bf-d073-46fe-a741-7552e0282e78.info Sep 18 21:37:12 devstack sudo[92423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:12 devstack sudo[92423]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-666f90dd-d529-417a-9061-af40b4910656 tempest-VolumesDeleteCascade-280764445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-189e02bf-d073-46fe-a741-7552e0282e78.info" returned: 0 in 0.281s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:13 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-666f90dd-d529-417a-9061-af40b4910656 tempest-VolumesDeleteCascade-280764445 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-189e02bf-d073-46fe-a741-7552e0282e78.info is being set with open permissions: ugo+rw Sep 18 21:37:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-666f90dd-d529-417a-9061-af40b4910656 tempest-VolumesDeleteCascade-280764445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-189e02bf-d073-46fe-a741-7552e0282e78.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:13 devstack sudo[92426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-189e02bf-d073-46fe-a741-7552e0282e78.info Sep 18 21:37:13 devstack sudo[92426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:13 devstack sudo[92426]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-666f90dd-d529-417a-9061-af40b4910656 tempest-VolumesDeleteCascade-280764445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-189e02bf-d073-46fe-a741-7552e0282e78.info" returned: 0 in 0.286s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-666f90dd-d529-417a-9061-af40b4910656 tempest-VolumesDeleteCascade-280764445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.232s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:37:13 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-666f90dd-d529-417a-9061-af40b4910656 tempest-VolumesDeleteCascade-280764445 None] Create snapshot completed successfully Sep 18 21:37:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-9ea8b01a-a84e-4342-aaa8-8dc616b61d18 tempest-VolumesDeleteCascade-280764445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:37:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-9ea8b01a-a84e-4342-aaa8-8dc616b61d18 tempest-VolumesDeleteCascade-280764445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:37:14 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-9ea8b01a-a84e-4342-aaa8-8dc616b61d18 tempest-VolumesDeleteCascade-280764445 None] Creating offline snapshot 3b146595-3169-4744-98de-d616ff025d0e of volume 189e02bf-d073-46fe-a741-7552e0282e78 {{(pid=86136) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 21:37:14 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[a918761a-fd6a-4e2c-9cd9-baf93478a2e6]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:37:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9ea8b01a-a84e-4342-aaa8-8dc616b61d18 tempest-VolumesDeleteCascade-280764445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-189e02bf-d073-46fe-a741-7552e0282e78.c8bbeaec-4674-47c0-a195-410d3370a04f {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:14 devstack sudo[92465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-189e02bf-d073-46fe-a741-7552e0282e78.c8bbeaec-4674-47c0-a195-410d3370a04f Sep 18 21:37:14 devstack sudo[92465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:14 devstack sudo[92465]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9ea8b01a-a84e-4342-aaa8-8dc616b61d18 tempest-VolumesDeleteCascade-280764445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-189e02bf-d073-46fe-a741-7552e0282e78.c8bbeaec-4674-47c0-a195-410d3370a04f" returned: 0 in 0.407s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:14 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-9ea8b01a-a84e-4342-aaa8-8dc616b61d18 tempest-VolumesDeleteCascade-280764445 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-189e02bf-d073-46fe-a741-7552e0282e78(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86136) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 21:37:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9ea8b01a-a84e-4342-aaa8-8dc616b61d18 tempest-VolumesDeleteCascade-280764445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-189e02bf-d073-46fe-a741-7552e0282e78.c8bbeaec-4674-47c0-a195-410d3370a04f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-189e02bf-d073-46fe-a741-7552e0282e78.3b146595-3169-4744-98de-d616ff025d0e 1G {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:14 devstack sudo[92470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-189e02bf-d073-46fe-a741-7552e0282e78.c8bbeaec-4674-47c0-a195-410d3370a04f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-189e02bf-d073-46fe-a741-7552e0282e78.3b146595-3169-4744-98de-d616ff025d0e 1G Sep 18 21:37:14 devstack sudo[92470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:15 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fd51be8-2872-49d0-a076-a33da822a46c tempest-SnapshotsActionsTest-1764320913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:37:15 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-3fd51be8-2872-49d0-a076-a33da822a46c tempest-SnapshotsActionsTest-1764320913 None] Flow 'volume_create_manager' (a4289c06-6285-4553-ad8c-0cec0fb431dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:37:15 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-3fd51be8-2872-49d0-a076-a33da822a46c tempest-SnapshotsActionsTest-1764320913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca371907-394a-4fa3-8676-ba06be934ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:37:15 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-3fd51be8-2872-49d0-a076-a33da822a46c tempest-SnapshotsActionsTest-1764320913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca371907-394a-4fa3-8676-ba06be934ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:37:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1870697559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fe786d8-f74b-478c-b68b-a5f952400424,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b04fde5cb6c84664bc81000f458bd8ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:37:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:37:15Z,use_quota=True,user_id='be182421853c4d16b8504d6ac598d7a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:37:15 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-3fd51be8-2872-49d0-a076-a33da822a46c tempest-SnapshotsActionsTest-1764320913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccdd1e05-5a23-4c2e-a2e5-dc69cc2090e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:37:15 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-3fd51be8-2872-49d0-a076-a33da822a46c tempest-SnapshotsActionsTest-1764320913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccdd1e05-5a23-4c2e-a2e5-dc69cc2090e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:37:15 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-3fd51be8-2872-49d0-a076-a33da822a46c tempest-SnapshotsActionsTest-1764320913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ec5bcd5-e08e-4628-9081-99ae8df28028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:37:15 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-3fd51be8-2872-49d0-a076-a33da822a46c tempest-SnapshotsActionsTest-1764320913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ec5bcd5-e08e-4628-9081-99ae8df28028) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fe786d8-f74b-478c-b68b-a5f952400424', 'volume_name': 'volume-2fe786d8-f74b-478c-b68b-a5f952400424', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:37:15 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-3fd51be8-2872-49d0-a076-a33da822a46c tempest-SnapshotsActionsTest-1764320913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fafce9fe-a404-4138-8608-e3b528e35eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:37:15 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-3fd51be8-2872-49d0-a076-a33da822a46c tempest-SnapshotsActionsTest-1764320913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fafce9fe-a404-4138-8608-e3b528e35eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:37:15 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-3fd51be8-2872-49d0-a076-a33da822a46c tempest-SnapshotsActionsTest-1764320913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (048430b9-789b-4003-9cea-dd0d1d4c50de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:37:15 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-3fd51be8-2872-49d0-a076-a33da822a46c tempest-SnapshotsActionsTest-1764320913 None] Volume 2fe786d8-f74b-478c-b68b-a5f952400424: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fe786d8-f74b-478c-b68b-a5f952400424', 'volume_size': 1} Sep 18 21:37:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-3fd51be8-2872-49d0-a076-a33da822a46c tempest-SnapshotsActionsTest-1764320913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:37:15 devstack sudo[92470]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9ea8b01a-a84e-4342-aaa8-8dc616b61d18 tempest-VolumesDeleteCascade-280764445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-189e02bf-d073-46fe-a741-7552e0282e78.c8bbeaec-4674-47c0-a195-410d3370a04f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-189e02bf-d073-46fe-a741-7552e0282e78.3b146595-3169-4744-98de-d616ff025d0e 1G" returned: 0 in 0.543s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9ea8b01a-a84e-4342-aaa8-8dc616b61d18 tempest-VolumesDeleteCascade-280764445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-189e02bf-d073-46fe-a741-7552e0282e78.c8bbeaec-4674-47c0-a195-410d3370a04f -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-189e02bf-d073-46fe-a741-7552e0282e78.3b146595-3169-4744-98de-d616ff025d0e {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:15 devstack sudo[92476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-189e02bf-d073-46fe-a741-7552e0282e78.c8bbeaec-4674-47c0-a195-410d3370a04f -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-189e02bf-d073-46fe-a741-7552e0282e78.3b146595-3169-4744-98de-d616ff025d0e Sep 18 21:37:15 devstack sudo[92476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:15 devstack sudo[92476]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9ea8b01a-a84e-4342-aaa8-8dc616b61d18 tempest-VolumesDeleteCascade-280764445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-189e02bf-d073-46fe-a741-7552e0282e78.c8bbeaec-4674-47c0-a195-410d3370a04f -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-189e02bf-d073-46fe-a741-7552e0282e78.3b146595-3169-4744-98de-d616ff025d0e" returned: 0 in 0.302s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:15 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-9ea8b01a-a84e-4342-aaa8-8dc616b61d18 tempest-VolumesDeleteCascade-280764445 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-189e02bf-d073-46fe-a741-7552e0282e78.3b146595-3169-4744-98de-d616ff025d0e is being set with open permissions: ugo+rw Sep 18 21:37:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9ea8b01a-a84e-4342-aaa8-8dc616b61d18 tempest-VolumesDeleteCascade-280764445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-189e02bf-d073-46fe-a741-7552e0282e78.3b146595-3169-4744-98de-d616ff025d0e {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:15 devstack sudo[92482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-189e02bf-d073-46fe-a741-7552e0282e78.3b146595-3169-4744-98de-d616ff025d0e Sep 18 21:37:15 devstack sudo[92482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:16 devstack sudo[92482]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9ea8b01a-a84e-4342-aaa8-8dc616b61d18 tempest-VolumesDeleteCascade-280764445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-189e02bf-d073-46fe-a741-7552e0282e78.3b146595-3169-4744-98de-d616ff025d0e" returned: 0 in 0.291s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-9ea8b01a-a84e-4342-aaa8-8dc616b61d18 tempest-VolumesDeleteCascade-280764445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.729s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:37:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-3fd51be8-2872-49d0-a076-a33da822a46c tempest-SnapshotsActionsTest-1764320913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.753s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:37:16 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-3fd51be8-2872-49d0-a076-a33da822a46c tempest-SnapshotsActionsTest-1764320913 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:37:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1870697559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fe786d8-f74b-478c-b68b-a5f952400424,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b04fde5cb6c84664bc81000f458bd8ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:37:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:37:15Z,use_quota=True,user_id='be182421853c4d16b8504d6ac598d7a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:37:16 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-3fd51be8-2872-49d0-a076-a33da822a46c tempest-SnapshotsActionsTest-1764320913 None] Creating volume 2fe786d8-f74b-478c-b68b-a5f952400424 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:37:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-3fd51be8-2872-49d0-a076-a33da822a46c tempest-SnapshotsActionsTest-1764320913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:37:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-3fd51be8-2872-49d0-a076-a33da822a46c tempest-SnapshotsActionsTest-1764320913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:37:16 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-3fd51be8-2872-49d0-a076-a33da822a46c tempest-SnapshotsActionsTest-1764320913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:37:16 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-3fd51be8-2872-49d0-a076-a33da822a46c tempest-SnapshotsActionsTest-1764320913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:37:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-3fd51be8-2872-49d0-a076-a33da822a46c tempest-SnapshotsActionsTest-1764320913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:37:16 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-3fd51be8-2872-49d0-a076-a33da822a46c tempest-SnapshotsActionsTest-1764320913 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:37:16 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-3fd51be8-2872-49d0-a076-a33da822a46c tempest-SnapshotsActionsTest-1764320913 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:37:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3fd51be8-2872-49d0-a076-a33da822a46c tempest-SnapshotsActionsTest-1764320913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:16 devstack sudo[92485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424 1073741824 Sep 18 21:37:16 devstack sudo[92485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:16 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-9ea8b01a-a84e-4342-aaa8-8dc616b61d18 tempest-VolumesDeleteCascade-280764445 None] Create snapshot completed successfully Sep 18 21:37:16 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-909ceaaa-0865-4b9d-9ff8-57e7e47066fa tempest-VolumesDeleteCascade-280764445 None] Acquiring lock "cinder-189e02bf-d073-46fe-a741-7552e0282e78-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:37:16 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-909ceaaa-0865-4b9d-9ff8-57e7e47066fa tempest-VolumesDeleteCascade-280764445 None] Lock "cinder-189e02bf-d073-46fe-a741-7552e0282e78-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:37:16 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-909ceaaa-0865-4b9d-9ff8-57e7e47066fa tempest-VolumesDeleteCascade-280764445 None] Performing cascade delete. {{(pid=86136) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 18 21:37:16 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-909ceaaa-0865-4b9d-9ff8-57e7e47066fa tempest-VolumesDeleteCascade-280764445 None] Acquiring lock "cinder-3b146595-3169-4744-98de-d616ff025d0e-delete_snapshot" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:37:16 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-909ceaaa-0865-4b9d-9ff8-57e7e47066fa tempest-VolumesDeleteCascade-280764445 None] Lock "cinder-3b146595-3169-4744-98de-d616ff025d0e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:37:16 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-909ceaaa-0865-4b9d-9ff8-57e7e47066fa tempest-VolumesDeleteCascade-280764445 None] Acquiring lock "cinder-quobyte-189e02bf-d073-46fe-a741-7552e0282e78" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:37:16 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-909ceaaa-0865-4b9d-9ff8-57e7e47066fa tempest-VolumesDeleteCascade-280764445 None] Lock "cinder-quobyte-189e02bf-d073-46fe-a741-7552e0282e78" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:37:16 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-909ceaaa-0865-4b9d-9ff8-57e7e47066fa tempest-VolumesDeleteCascade-280764445 None] Acquiring lock "cinder-quobyte-3b146595-3169-4744-98de-d616ff025d0e" by "_delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:37:16 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-909ceaaa-0865-4b9d-9ff8-57e7e47066fa tempest-VolumesDeleteCascade-280764445 None] Lock "cinder-quobyte-3b146595-3169-4744-98de-d616ff025d0e" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:37:16 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-909ceaaa-0865-4b9d-9ff8-57e7e47066fa tempest-VolumesDeleteCascade-280764445 None] Deleting offline snapshot 3b146595-3169-4744-98de-d616ff025d0e of volume 189e02bf-d073-46fe-a741-7552e0282e78 {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 21:37:16 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-909ceaaa-0865-4b9d-9ff8-57e7e47066fa tempest-VolumesDeleteCascade-280764445 None] snapshot_file for this snap is: volume-189e02bf-d073-46fe-a741-7552e0282e78.3b146595-3169-4744-98de-d616ff025d0e {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 21:37:16 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7eacc6-b759-4ca1-b182-e8a32d3da1e3]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:37:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-909ceaaa-0865-4b9d-9ff8-57e7e47066fa tempest-VolumesDeleteCascade-280764445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-189e02bf-d073-46fe-a741-7552e0282e78.3b146595-3169-4744-98de-d616ff025d0e {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:16 devstack sudo[92485]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3fd51be8-2872-49d0-a076-a33da822a46c tempest-SnapshotsActionsTest-1764320913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424 1073741824" returned: 0 in 0.737s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3fd51be8-2872-49d0-a076-a33da822a46c tempest-SnapshotsActionsTest-1764320913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:16 devstack sudo[92492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424 Sep 18 21:37:17 devstack sudo[92492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:17 devstack sudo[92491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-189e02bf-d073-46fe-a741-7552e0282e78.3b146595-3169-4744-98de-d616ff025d0e Sep 18 21:37:17 devstack sudo[92491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:17 devstack sudo[92492]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3fd51be8-2872-49d0-a076-a33da822a46c tempest-SnapshotsActionsTest-1764320913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424" returned: 0 in 0.394s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:17 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-3fd51be8-2872-49d0-a076-a33da822a46c tempest-SnapshotsActionsTest-1764320913 None] <== create_volume: return (1200ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:37:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-3fd51be8-2872-49d0-a076-a33da822a46c tempest-SnapshotsActionsTest-1764320913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.203s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:37:17 devstack sudo[92491]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:17 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-3fd51be8-2872-49d0-a076-a33da822a46c tempest-SnapshotsActionsTest-1764320913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (048430b9-789b-4003-9cea-dd0d1d4c50de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fe786d8-f74b-478c-b68b-a5f952400424', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:37:17 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-3fd51be8-2872-49d0-a076-a33da822a46c tempest-SnapshotsActionsTest-1764320913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00616426-eaa3-4c21-ad6b-da03da6ed453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:37:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-909ceaaa-0865-4b9d-9ff8-57e7e47066fa tempest-VolumesDeleteCascade-280764445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-189e02bf-d073-46fe-a741-7552e0282e78.3b146595-3169-4744-98de-d616ff025d0e" returned: 0 in 0.511s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:17 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-909ceaaa-0865-4b9d-9ff8-57e7e47066fa tempest-VolumesDeleteCascade-280764445 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-189e02bf-d073-46fe-a741-7552e0282e78(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86136) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 21:37:17 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-3fd51be8-2872-49d0-a076-a33da822a46c tempest-SnapshotsActionsTest-1764320913 None] Volume volume-2fe786d8-f74b-478c-b68b-a5f952400424 (2fe786d8-f74b-478c-b68b-a5f952400424): created successfully Sep 18 21:37:17 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-3fd51be8-2872-49d0-a076-a33da822a46c tempest-SnapshotsActionsTest-1764320913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00616426-eaa3-4c21-ad6b-da03da6ed453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:37:17 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-3fd51be8-2872-49d0-a076-a33da822a46c tempest-SnapshotsActionsTest-1764320913 None] Flow 'volume_create_manager' (a4289c06-6285-4553-ad8c-0cec0fb431dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:37:17 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8204c83-f7f1-4636-b84e-31ca460a05da]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:37:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-909ceaaa-0865-4b9d-9ff8-57e7e47066fa tempest-VolumesDeleteCascade-280764445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-189e02bf-d073-46fe-a741-7552e0282e78.c8bbeaec-4674-47c0-a195-410d3370a04f {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:17 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-3fd51be8-2872-49d0-a076-a33da822a46c tempest-SnapshotsActionsTest-1764320913 None] Created volume successfully. Sep 18 21:37:17 devstack sudo[92501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-189e02bf-d073-46fe-a741-7552e0282e78.c8bbeaec-4674-47c0-a195-410d3370a04f Sep 18 21:37:17 devstack sudo[92501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:17 devstack sudo[92501]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-909ceaaa-0865-4b9d-9ff8-57e7e47066fa tempest-VolumesDeleteCascade-280764445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-189e02bf-d073-46fe-a741-7552e0282e78.c8bbeaec-4674-47c0-a195-410d3370a04f" returned: 0 in 0.426s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:17 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-909ceaaa-0865-4b9d-9ff8-57e7e47066fa tempest-VolumesDeleteCascade-280764445 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-189e02bf-d073-46fe-a741-7552e0282e78(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86136) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 21:37:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-909ceaaa-0865-4b9d-9ff8-57e7e47066fa tempest-VolumesDeleteCascade-280764445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-189e02bf-d073-46fe-a741-7552e0282e78.3b146595-3169-4744-98de-d616ff025d0e {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:17 devstack sudo[92511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-189e02bf-d073-46fe-a741-7552e0282e78.3b146595-3169-4744-98de-d616ff025d0e Sep 18 21:37:17 devstack sudo[92511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:18 devstack sudo[92511]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-909ceaaa-0865-4b9d-9ff8-57e7e47066fa tempest-VolumesDeleteCascade-280764445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-189e02bf-d073-46fe-a741-7552e0282e78.3b146595-3169-4744-98de-d616ff025d0e" returned: 0 in 0.393s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-909ceaaa-0865-4b9d-9ff8-57e7e47066fa tempest-VolumesDeleteCascade-280764445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-189e02bf-d073-46fe-a741-7552e0282e78.3b146595-3169-4744-98de-d616ff025d0e {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:18 devstack sudo[92517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-189e02bf-d073-46fe-a741-7552e0282e78.3b146595-3169-4744-98de-d616ff025d0e Sep 18 21:37:18 devstack sudo[92517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:18 devstack sudo[92517]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-909ceaaa-0865-4b9d-9ff8-57e7e47066fa tempest-VolumesDeleteCascade-280764445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-189e02bf-d073-46fe-a741-7552e0282e78.3b146595-3169-4744-98de-d616ff025d0e" returned: 0 in 0.243s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:18 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-909ceaaa-0865-4b9d-9ff8-57e7e47066fa tempest-VolumesDeleteCascade-280764445 None] Lock "cinder-quobyte-3b146595-3169-4744-98de-d616ff025d0e" released by "_delete_snapshot" :: held 1.740s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:37:18 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-909ceaaa-0865-4b9d-9ff8-57e7e47066fa tempest-VolumesDeleteCascade-280764445 None] Lock "cinder-quobyte-189e02bf-d073-46fe-a741-7552e0282e78" released by "delete_snapshot" :: held 1.767s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:37:18 devstack cinder-volume[86136]: WARNING cinder.quota [None req-909ceaaa-0865-4b9d-9ff8-57e7e47066fa tempest-VolumesDeleteCascade-280764445 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 18 21:37:18 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-909ceaaa-0865-4b9d-9ff8-57e7e47066fa tempest-VolumesDeleteCascade-280764445 None] Created reservations ['263301fe-1644-4e10-974f-453354c8805b', '82293047-4b92-4289-a7b2-ed6daac62888', 'cb985a45-2fec-43d6-a141-d32c98ec78b1', '4dc6daad-facb-402f-a8e3-91447ec16087'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:37:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-b2777b06-2dd8-4076-ab44-1a414aa7e2e4 tempest-SnapshotsActionsTest-1764320913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:37:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-b2777b06-2dd8-4076-ab44-1a414aa7e2e4 tempest-SnapshotsActionsTest-1764320913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:37:18 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-909ceaaa-0865-4b9d-9ff8-57e7e47066fa tempest-VolumesDeleteCascade-280764445 None] Delete snapshot completed successfully. Sep 18 21:37:18 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-b2777b06-2dd8-4076-ab44-1a414aa7e2e4 tempest-SnapshotsActionsTest-1764320913 None] Creating offline snapshot 9e3ea175-4872-4a3f-8afe-c8e6c5880cda of volume 2fe786d8-f74b-478c-b68b-a5f952400424 {{(pid=86136) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 21:37:18 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-909ceaaa-0865-4b9d-9ff8-57e7e47066fa tempest-VolumesDeleteCascade-280764445 None] Lock "cinder-3b146595-3169-4744-98de-d616ff025d0e-delete_snapshot" released by "delete_snapshot" :: held 1.982s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:37:18 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-909ceaaa-0865-4b9d-9ff8-57e7e47066fa tempest-VolumesDeleteCascade-280764445 None] Acquiring lock "cinder-c8bbeaec-4674-47c0-a195-410d3370a04f-delete_snapshot" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:37:18 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf88d457-db51-4443-a9fc-484fb8169ddd]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:37:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-b2777b06-2dd8-4076-ab44-1a414aa7e2e4 tempest-SnapshotsActionsTest-1764320913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:18 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-909ceaaa-0865-4b9d-9ff8-57e7e47066fa tempest-VolumesDeleteCascade-280764445 None] Lock "cinder-c8bbeaec-4674-47c0-a195-410d3370a04f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:37:18 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-909ceaaa-0865-4b9d-9ff8-57e7e47066fa tempest-VolumesDeleteCascade-280764445 None] Acquiring lock "cinder-quobyte-189e02bf-d073-46fe-a741-7552e0282e78" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:37:18 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-909ceaaa-0865-4b9d-9ff8-57e7e47066fa tempest-VolumesDeleteCascade-280764445 None] Lock "cinder-quobyte-189e02bf-d073-46fe-a741-7552e0282e78" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:37:18 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-909ceaaa-0865-4b9d-9ff8-57e7e47066fa tempest-VolumesDeleteCascade-280764445 None] Acquiring lock "cinder-quobyte-c8bbeaec-4674-47c0-a195-410d3370a04f" by "_delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:37:18 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-909ceaaa-0865-4b9d-9ff8-57e7e47066fa tempest-VolumesDeleteCascade-280764445 None] Lock "cinder-quobyte-c8bbeaec-4674-47c0-a195-410d3370a04f" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:37:18 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-909ceaaa-0865-4b9d-9ff8-57e7e47066fa tempest-VolumesDeleteCascade-280764445 None] Deleting offline snapshot c8bbeaec-4674-47c0-a195-410d3370a04f of volume 189e02bf-d073-46fe-a741-7552e0282e78 {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 21:37:18 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-909ceaaa-0865-4b9d-9ff8-57e7e47066fa tempest-VolumesDeleteCascade-280764445 None] snapshot_file for this snap is: volume-189e02bf-d073-46fe-a741-7552e0282e78.c8bbeaec-4674-47c0-a195-410d3370a04f {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 21:37:18 devstack sudo[92522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424 Sep 18 21:37:18 devstack sudo[92522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:18 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[009c7b18-986e-4c66-9d05-937c508aa45a]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:37:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-909ceaaa-0865-4b9d-9ff8-57e7e47066fa tempest-VolumesDeleteCascade-280764445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-189e02bf-d073-46fe-a741-7552e0282e78.c8bbeaec-4674-47c0-a195-410d3370a04f {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:18 devstack sudo[92524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-189e02bf-d073-46fe-a741-7552e0282e78.c8bbeaec-4674-47c0-a195-410d3370a04f Sep 18 21:37:18 devstack sudo[92524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:19 devstack sudo[92522]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:19 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-b2777b06-2dd8-4076-ab44-1a414aa7e2e4 tempest-SnapshotsActionsTest-1764320913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424" returned: 0 in 0.426s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:19 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-b2777b06-2dd8-4076-ab44-1a414aa7e2e4 tempest-SnapshotsActionsTest-1764320913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.9e3ea175-4872-4a3f-8afe-c8e6c5880cda 1G {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:19 devstack sudo[92530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.9e3ea175-4872-4a3f-8afe-c8e6c5880cda 1G Sep 18 21:37:19 devstack sudo[92530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:19 devstack sudo[92524]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:19 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-909ceaaa-0865-4b9d-9ff8-57e7e47066fa tempest-VolumesDeleteCascade-280764445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-189e02bf-d073-46fe-a741-7552e0282e78.c8bbeaec-4674-47c0-a195-410d3370a04f" returned: 0 in 0.420s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:19 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-909ceaaa-0865-4b9d-9ff8-57e7e47066fa tempest-VolumesDeleteCascade-280764445 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-189e02bf-d073-46fe-a741-7552e0282e78(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86136) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 21:37:19 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[e274b03c-a7aa-44a3-8161-af9713ef3b48]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:37:19 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-909ceaaa-0865-4b9d-9ff8-57e7e47066fa tempest-VolumesDeleteCascade-280764445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-189e02bf-d073-46fe-a741-7552e0282e78 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:19 devstack sudo[92535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-189e02bf-d073-46fe-a741-7552e0282e78 Sep 18 21:37:19 devstack sudo[92535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:19 devstack cinder-volume[86136]: INFO cinder.volume.manager [req-c8fae65a-ac24-4318-aa41-c2c134234292 req-e1fac7a0-4e46-41e9-9149-fd4be25beaba tempest-AttachVolumeTestJSON-1287281091 None] Terminate volume connection completed successfully. Sep 18 21:37:19 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [req-c8fae65a-ac24-4318-aa41-c2c134234292 req-e1fac7a0-4e46-41e9-9149-fd4be25beaba tempest-AttachVolumeTestJSON-1287281091 None] Deleting attachment 50e0eec0-13e1-4eb9-94e9-67c145f9cb6e. {{(pid=86136) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 18 21:37:19 devstack sudo[92530]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:19 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-b2777b06-2dd8-4076-ab44-1a414aa7e2e4 tempest-SnapshotsActionsTest-1764320913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.9e3ea175-4872-4a3f-8afe-c8e6c5880cda 1G" returned: 0 in 0.468s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:19 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-b2777b06-2dd8-4076-ab44-1a414aa7e2e4 tempest-SnapshotsActionsTest-1764320913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fe786d8-f74b-478c-b68b-a5f952400424 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.9e3ea175-4872-4a3f-8afe-c8e6c5880cda {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:19 devstack sudo[92544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fe786d8-f74b-478c-b68b-a5f952400424 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.9e3ea175-4872-4a3f-8afe-c8e6c5880cda Sep 18 21:37:19 devstack sudo[92544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:19 devstack sudo[92535]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:19 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-909ceaaa-0865-4b9d-9ff8-57e7e47066fa tempest-VolumesDeleteCascade-280764445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-189e02bf-d073-46fe-a741-7552e0282e78" returned: 0 in 0.431s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:19 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-909ceaaa-0865-4b9d-9ff8-57e7e47066fa tempest-VolumesDeleteCascade-280764445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-189e02bf-d073-46fe-a741-7552e0282e78.c8bbeaec-4674-47c0-a195-410d3370a04f {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:19 devstack sudo[92549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-189e02bf-d073-46fe-a741-7552e0282e78.c8bbeaec-4674-47c0-a195-410d3370a04f Sep 18 21:37:19 devstack sudo[92549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:19 devstack sudo[92544]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:19 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-b2777b06-2dd8-4076-ab44-1a414aa7e2e4 tempest-SnapshotsActionsTest-1764320913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fe786d8-f74b-478c-b68b-a5f952400424 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.9e3ea175-4872-4a3f-8afe-c8e6c5880cda" returned: 0 in 0.343s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:19 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-b2777b06-2dd8-4076-ab44-1a414aa7e2e4 tempest-SnapshotsActionsTest-1764320913 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.9e3ea175-4872-4a3f-8afe-c8e6c5880cda is being set with open permissions: ugo+rw Sep 18 21:37:19 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-b2777b06-2dd8-4076-ab44-1a414aa7e2e4 tempest-SnapshotsActionsTest-1764320913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.9e3ea175-4872-4a3f-8afe-c8e6c5880cda {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:20 devstack sudo[92554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.9e3ea175-4872-4a3f-8afe-c8e6c5880cda Sep 18 21:37:20 devstack sudo[92554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:20 devstack sudo[92549]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:20 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-909ceaaa-0865-4b9d-9ff8-57e7e47066fa tempest-VolumesDeleteCascade-280764445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-189e02bf-d073-46fe-a741-7552e0282e78.c8bbeaec-4674-47c0-a195-410d3370a04f" returned: 0 in 0.363s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:20 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-909ceaaa-0865-4b9d-9ff8-57e7e47066fa tempest-VolumesDeleteCascade-280764445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-189e02bf-d073-46fe-a741-7552e0282e78.c8bbeaec-4674-47c0-a195-410d3370a04f {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:20 devstack sudo[92559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-189e02bf-d073-46fe-a741-7552e0282e78.c8bbeaec-4674-47c0-a195-410d3370a04f Sep 18 21:37:20 devstack sudo[92559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:20 devstack sudo[92554]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:20 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-b2777b06-2dd8-4076-ab44-1a414aa7e2e4 tempest-SnapshotsActionsTest-1764320913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.9e3ea175-4872-4a3f-8afe-c8e6c5880cda" returned: 0 in 0.267s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:20 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-b2777b06-2dd8-4076-ab44-1a414aa7e2e4 tempest-SnapshotsActionsTest-1764320913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:20 devstack sudo[92562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.info Sep 18 21:37:20 devstack sudo[92562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:20 devstack sudo[92559]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:20 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-909ceaaa-0865-4b9d-9ff8-57e7e47066fa tempest-VolumesDeleteCascade-280764445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-189e02bf-d073-46fe-a741-7552e0282e78.c8bbeaec-4674-47c0-a195-410d3370a04f" returned: 0 in 0.279s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:20 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-909ceaaa-0865-4b9d-9ff8-57e7e47066fa tempest-VolumesDeleteCascade-280764445 None] Lock "cinder-quobyte-c8bbeaec-4674-47c0-a195-410d3370a04f" released by "_delete_snapshot" :: held 1.654s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:37:20 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-909ceaaa-0865-4b9d-9ff8-57e7e47066fa tempest-VolumesDeleteCascade-280764445 None] Lock "cinder-quobyte-189e02bf-d073-46fe-a741-7552e0282e78" released by "delete_snapshot" :: held 1.685s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:37:20 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-909ceaaa-0865-4b9d-9ff8-57e7e47066fa tempest-VolumesDeleteCascade-280764445 None] Created reservations ['893c31ec-9921-4871-82ef-11bfd3a07e5e', 'b284a3dc-e52f-44f3-aa21-3dcd5197e4f2', '1d2958fb-a782-4230-a1e3-0f5af6de4b9e', '841dc7d8-0353-4833-ab10-3a91a3cede1c'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:37:20 devstack sudo[92562]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:20 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-b2777b06-2dd8-4076-ab44-1a414aa7e2e4 tempest-SnapshotsActionsTest-1764320913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.info" returned: 0 in 0.317s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:20 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-b2777b06-2dd8-4076-ab44-1a414aa7e2e4 tempest-SnapshotsActionsTest-1764320913 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.info is being set with open permissions: ugo+rw Sep 18 21:37:20 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-b2777b06-2dd8-4076-ab44-1a414aa7e2e4 tempest-SnapshotsActionsTest-1764320913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:20 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-909ceaaa-0865-4b9d-9ff8-57e7e47066fa tempest-VolumesDeleteCascade-280764445 None] Delete snapshot completed successfully. Sep 18 21:37:20 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-909ceaaa-0865-4b9d-9ff8-57e7e47066fa tempest-VolumesDeleteCascade-280764445 None] Lock "cinder-c8bbeaec-4674-47c0-a195-410d3370a04f-delete_snapshot" released by "delete_snapshot" :: held 1.869s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:37:20 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-909ceaaa-0865-4b9d-9ff8-57e7e47066fa tempest-VolumesDeleteCascade-280764445 None] Snapshots deleted, issuing volume delete {{(pid=86136) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 18 21:37:20 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-909ceaaa-0865-4b9d-9ff8-57e7e47066fa tempest-VolumesDeleteCascade-280764445 None] Acquiring lock "cinder-quobyte-189e02bf-d073-46fe-a741-7552e0282e78" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:37:20 devstack sudo[92569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.info Sep 18 21:37:20 devstack sudo[92569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:20 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-909ceaaa-0865-4b9d-9ff8-57e7e47066fa tempest-VolumesDeleteCascade-280764445 None] Lock "cinder-quobyte-189e02bf-d073-46fe-a741-7552e0282e78" acquired by "delete_volume" :: waited 0.016s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:37:20 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[1747ad31-3d5d-4101-9200-a07aea59dbe1]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:37:20 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-909ceaaa-0865-4b9d-9ff8-57e7e47066fa tempest-VolumesDeleteCascade-280764445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-189e02bf-d073-46fe-a741-7552e0282e78 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:20 devstack sudo[92571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-189e02bf-d073-46fe-a741-7552e0282e78 Sep 18 21:37:20 devstack sudo[92571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:20 devstack sudo[92569]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:20 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-b2777b06-2dd8-4076-ab44-1a414aa7e2e4 tempest-SnapshotsActionsTest-1764320913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.info" returned: 0 in 0.321s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:20 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-b2777b06-2dd8-4076-ab44-1a414aa7e2e4 tempest-SnapshotsActionsTest-1764320913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.243s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:37:20 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-b2777b06-2dd8-4076-ab44-1a414aa7e2e4 tempest-SnapshotsActionsTest-1764320913 None] Create snapshot completed successfully Sep 18 21:37:21 devstack sudo[92571]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-909ceaaa-0865-4b9d-9ff8-57e7e47066fa tempest-VolumesDeleteCascade-280764445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-189e02bf-d073-46fe-a741-7552e0282e78" returned: 0 in 0.441s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-909ceaaa-0865-4b9d-9ff8-57e7e47066fa tempest-VolumesDeleteCascade-280764445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-189e02bf-d073-46fe-a741-7552e0282e78 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:21 devstack sudo[92581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-189e02bf-d073-46fe-a741-7552e0282e78 Sep 18 21:37:21 devstack sudo[92581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:21 devstack sudo[92581]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-909ceaaa-0865-4b9d-9ff8-57e7e47066fa tempest-VolumesDeleteCascade-280764445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-189e02bf-d073-46fe-a741-7552e0282e78" returned: 0 in 0.257s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:21 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-909ceaaa-0865-4b9d-9ff8-57e7e47066fa tempest-VolumesDeleteCascade-280764445 None] Lock "cinder-quobyte-189e02bf-d073-46fe-a741-7552e0282e78" released by "delete_volume" :: held 0.773s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:37:21 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-909ceaaa-0865-4b9d-9ff8-57e7e47066fa tempest-VolumesDeleteCascade-280764445 None] Created reservations ['dbe4d3de-a123-424f-8c52-93d8d044c1bb', 'e2664be5-d306-488c-a214-dfdbef4a1dc6', '85ebfc15-6208-4132-8419-fca083d10d00', 'e7dcebde-4de8-4faa-9b48-76c385c0c305'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:37:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-909ceaaa-0865-4b9d-9ff8-57e7e47066fa tempest-VolumesDeleteCascade-280764445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:37:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-909ceaaa-0865-4b9d-9ff8-57e7e47066fa tempest-VolumesDeleteCascade-280764445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:37:21 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-909ceaaa-0865-4b9d-9ff8-57e7e47066fa tempest-VolumesDeleteCascade-280764445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:37:21 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-909ceaaa-0865-4b9d-9ff8-57e7e47066fa tempest-VolumesDeleteCascade-280764445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:37:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-909ceaaa-0865-4b9d-9ff8-57e7e47066fa tempest-VolumesDeleteCascade-280764445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:37:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-909ceaaa-0865-4b9d-9ff8-57e7e47066fa tempest-VolumesDeleteCascade-280764445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:21 devstack sudo[92584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:37:21 devstack sudo[92584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:21 devstack sudo[92584]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-909ceaaa-0865-4b9d-9ff8-57e7e47066fa tempest-VolumesDeleteCascade-280764445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.234s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:21 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-909ceaaa-0865-4b9d-9ff8-57e7e47066fa tempest-VolumesDeleteCascade-280764445 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:37:21 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-909ceaaa-0865-4b9d-9ff8-57e7e47066fa tempest-VolumesDeleteCascade-280764445 None] Deleted volume successfully. Sep 18 21:37:21 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-909ceaaa-0865-4b9d-9ff8-57e7e47066fa tempest-VolumesDeleteCascade-280764445 None] Lock "cinder-189e02bf-d073-46fe-a741-7552e0282e78-delete_volume" released by "delete_volume" :: held 5.155s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:37:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-1a921926-0874-48eb-bf5c-f6b36a2cb3f5 tempest-SnapshotsActionsTest-1764320913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:37:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-1a921926-0874-48eb-bf5c-f6b36a2cb3f5 tempest-SnapshotsActionsTest-1764320913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:37:22 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-1a921926-0874-48eb-bf5c-f6b36a2cb3f5 tempest-SnapshotsActionsTest-1764320913 None] Creating offline snapshot 788a9239-2d3f-4f33-9c43-27edfd3fdaa4 of volume 2fe786d8-f74b-478c-b68b-a5f952400424 {{(pid=86136) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 21:37:22 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec8bbe46-9100-4dfa-93cb-9864f3620803]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:37:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1a921926-0874-48eb-bf5c-f6b36a2cb3f5 tempest-SnapshotsActionsTest-1764320913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.9e3ea175-4872-4a3f-8afe-c8e6c5880cda {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:22 devstack sudo[92588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.9e3ea175-4872-4a3f-8afe-c8e6c5880cda Sep 18 21:37:22 devstack sudo[92588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:22 devstack sudo[92588]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1a921926-0874-48eb-bf5c-f6b36a2cb3f5 tempest-SnapshotsActionsTest-1764320913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.9e3ea175-4872-4a3f-8afe-c8e6c5880cda" returned: 0 in 0.471s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:23 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-1a921926-0874-48eb-bf5c-f6b36a2cb3f5 tempest-SnapshotsActionsTest-1764320913 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2fe786d8-f74b-478c-b68b-a5f952400424(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86136) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 21:37:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1a921926-0874-48eb-bf5c-f6b36a2cb3f5 tempest-SnapshotsActionsTest-1764320913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.9e3ea175-4872-4a3f-8afe-c8e6c5880cda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.788a9239-2d3f-4f33-9c43-27edfd3fdaa4 1G {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:23 devstack sudo[92593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.9e3ea175-4872-4a3f-8afe-c8e6c5880cda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.788a9239-2d3f-4f33-9c43-27edfd3fdaa4 1G Sep 18 21:37:23 devstack sudo[92593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:23 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-b027145e-b854-4a89-b9df-adeedf36f669 tempest-VolumesDeleteCascade-280764445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:37:23 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b027145e-b854-4a89-b9df-adeedf36f669 tempest-VolumesDeleteCascade-280764445 None] Flow 'volume_create_manager' (b69cfc0a-c52a-4ed5-ac44-1341050f2a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:37:23 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b027145e-b854-4a89-b9df-adeedf36f669 tempest-VolumesDeleteCascade-280764445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (081ae410-7a67-4509-928e-9fa3764916fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:37:23 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b027145e-b854-4a89-b9df-adeedf36f669 tempest-VolumesDeleteCascade-280764445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (081ae410-7a67-4509-928e-9fa3764916fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:37:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1533183941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27275b58-b9e7-4308-8cd2-ca2f3517fcef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e80ec8f3c143431a98eafe964c7179e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:37:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:37:23Z,use_quota=True,user_id='d5f58a07c7a64f8298455a27e6d28098',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:37:23 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b027145e-b854-4a89-b9df-adeedf36f669 tempest-VolumesDeleteCascade-280764445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (664097b8-0f16-47ed-be9a-3e1dea1dbafb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:37:23 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b027145e-b854-4a89-b9df-adeedf36f669 tempest-VolumesDeleteCascade-280764445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (664097b8-0f16-47ed-be9a-3e1dea1dbafb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:37:23 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b027145e-b854-4a89-b9df-adeedf36f669 tempest-VolumesDeleteCascade-280764445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e21a8fb5-eae3-4bc9-bf76-85c645c2edff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:37:23 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b027145e-b854-4a89-b9df-adeedf36f669 tempest-VolumesDeleteCascade-280764445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e21a8fb5-eae3-4bc9-bf76-85c645c2edff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27275b58-b9e7-4308-8cd2-ca2f3517fcef', 'volume_name': 'volume-27275b58-b9e7-4308-8cd2-ca2f3517fcef', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:37:23 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b027145e-b854-4a89-b9df-adeedf36f669 tempest-VolumesDeleteCascade-280764445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef46574f-4d4a-448d-a29b-87dffa87eb60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:37:23 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b027145e-b854-4a89-b9df-adeedf36f669 tempest-VolumesDeleteCascade-280764445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef46574f-4d4a-448d-a29b-87dffa87eb60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:37:23 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b027145e-b854-4a89-b9df-adeedf36f669 tempest-VolumesDeleteCascade-280764445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cc028e6-37f7-4c32-862f-0ddd8683b09c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:37:23 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-b027145e-b854-4a89-b9df-adeedf36f669 tempest-VolumesDeleteCascade-280764445 None] Volume 27275b58-b9e7-4308-8cd2-ca2f3517fcef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27275b58-b9e7-4308-8cd2-ca2f3517fcef', 'volume_size': 1} Sep 18 21:37:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-b027145e-b854-4a89-b9df-adeedf36f669 tempest-VolumesDeleteCascade-280764445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:37:23 devstack sudo[92593]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1a921926-0874-48eb-bf5c-f6b36a2cb3f5 tempest-SnapshotsActionsTest-1764320913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.9e3ea175-4872-4a3f-8afe-c8e6c5880cda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.788a9239-2d3f-4f33-9c43-27edfd3fdaa4 1G" returned: 0 in 0.654s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1a921926-0874-48eb-bf5c-f6b36a2cb3f5 tempest-SnapshotsActionsTest-1764320913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fe786d8-f74b-478c-b68b-a5f952400424.9e3ea175-4872-4a3f-8afe-c8e6c5880cda -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.788a9239-2d3f-4f33-9c43-27edfd3fdaa4 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:23 devstack sudo[92616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fe786d8-f74b-478c-b68b-a5f952400424.9e3ea175-4872-4a3f-8afe-c8e6c5880cda -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.788a9239-2d3f-4f33-9c43-27edfd3fdaa4 Sep 18 21:37:23 devstack sudo[92616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:24 devstack sudo[92616]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1a921926-0874-48eb-bf5c-f6b36a2cb3f5 tempest-SnapshotsActionsTest-1764320913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fe786d8-f74b-478c-b68b-a5f952400424.9e3ea175-4872-4a3f-8afe-c8e6c5880cda -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.788a9239-2d3f-4f33-9c43-27edfd3fdaa4" returned: 0 in 0.446s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:24 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-1a921926-0874-48eb-bf5c-f6b36a2cb3f5 tempest-SnapshotsActionsTest-1764320913 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.788a9239-2d3f-4f33-9c43-27edfd3fdaa4 is being set with open permissions: ugo+rw Sep 18 21:37:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1a921926-0874-48eb-bf5c-f6b36a2cb3f5 tempest-SnapshotsActionsTest-1764320913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.788a9239-2d3f-4f33-9c43-27edfd3fdaa4 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:24 devstack sudo[92628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.788a9239-2d3f-4f33-9c43-27edfd3fdaa4 Sep 18 21:37:24 devstack sudo[92628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:24 devstack sudo[92628]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1a921926-0874-48eb-bf5c-f6b36a2cb3f5 tempest-SnapshotsActionsTest-1764320913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.788a9239-2d3f-4f33-9c43-27edfd3fdaa4" returned: 0 in 0.273s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-1a921926-0874-48eb-bf5c-f6b36a2cb3f5 tempest-SnapshotsActionsTest-1764320913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.993s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:37:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-b027145e-b854-4a89-b9df-adeedf36f669 tempest-VolumesDeleteCascade-280764445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.262s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:37:24 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-b027145e-b854-4a89-b9df-adeedf36f669 tempest-VolumesDeleteCascade-280764445 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:37:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1533183941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27275b58-b9e7-4308-8cd2-ca2f3517fcef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e80ec8f3c143431a98eafe964c7179e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:37:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:37:23Z,use_quota=True,user_id='d5f58a07c7a64f8298455a27e6d28098',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:37:24 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-b027145e-b854-4a89-b9df-adeedf36f669 tempest-VolumesDeleteCascade-280764445 None] Creating volume 27275b58-b9e7-4308-8cd2-ca2f3517fcef {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:37:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-b027145e-b854-4a89-b9df-adeedf36f669 tempest-VolumesDeleteCascade-280764445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:37:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-b027145e-b854-4a89-b9df-adeedf36f669 tempest-VolumesDeleteCascade-280764445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:37:24 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-b027145e-b854-4a89-b9df-adeedf36f669 tempest-VolumesDeleteCascade-280764445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:37:24 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-b027145e-b854-4a89-b9df-adeedf36f669 tempest-VolumesDeleteCascade-280764445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:37:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-b027145e-b854-4a89-b9df-adeedf36f669 tempest-VolumesDeleteCascade-280764445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:37:24 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-b027145e-b854-4a89-b9df-adeedf36f669 tempest-VolumesDeleteCascade-280764445 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:37:24 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-b027145e-b854-4a89-b9df-adeedf36f669 tempest-VolumesDeleteCascade-280764445 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:37:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-b027145e-b854-4a89-b9df-adeedf36f669 tempest-VolumesDeleteCascade-280764445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-27275b58-b9e7-4308-8cd2-ca2f3517fcef 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:24 devstack sudo[92637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-27275b58-b9e7-4308-8cd2-ca2f3517fcef 1073741824 Sep 18 21:37:24 devstack sudo[92637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:24 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-1a921926-0874-48eb-bf5c-f6b36a2cb3f5 tempest-SnapshotsActionsTest-1764320913 None] Create snapshot completed successfully Sep 18 21:37:24 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-4cabdc70-9619-40da-930b-765642c1ba64 tempest-SnapshotsActionsTest-1376928580 None] Acquiring lock "cinder-788a9239-2d3f-4f33-9c43-27edfd3fdaa4-delete_snapshot" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:37:24 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-4cabdc70-9619-40da-930b-765642c1ba64 tempest-SnapshotsActionsTest-1376928580 None] Lock "cinder-788a9239-2d3f-4f33-9c43-27edfd3fdaa4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:37:24 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-4cabdc70-9619-40da-930b-765642c1ba64 tempest-SnapshotsActionsTest-1376928580 None] Acquiring lock "cinder-quobyte-2fe786d8-f74b-478c-b68b-a5f952400424" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:37:24 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-4cabdc70-9619-40da-930b-765642c1ba64 tempest-SnapshotsActionsTest-1376928580 None] Lock "cinder-quobyte-2fe786d8-f74b-478c-b68b-a5f952400424" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:37:24 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-4cabdc70-9619-40da-930b-765642c1ba64 tempest-SnapshotsActionsTest-1376928580 None] Acquiring lock "cinder-quobyte-788a9239-2d3f-4f33-9c43-27edfd3fdaa4" by "_delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:37:25 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-4cabdc70-9619-40da-930b-765642c1ba64 tempest-SnapshotsActionsTest-1376928580 None] Lock "cinder-quobyte-788a9239-2d3f-4f33-9c43-27edfd3fdaa4" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:37:25 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-4cabdc70-9619-40da-930b-765642c1ba64 tempest-SnapshotsActionsTest-1376928580 None] Deleting offline snapshot 788a9239-2d3f-4f33-9c43-27edfd3fdaa4 of volume 2fe786d8-f74b-478c-b68b-a5f952400424 {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 21:37:25 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-4cabdc70-9619-40da-930b-765642c1ba64 tempest-SnapshotsActionsTest-1376928580 None] snapshot_file for this snap is: volume-2fe786d8-f74b-478c-b68b-a5f952400424.788a9239-2d3f-4f33-9c43-27edfd3fdaa4 {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 21:37:25 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b6d73f9-ba99-4ffb-a3c9-38cb63e14675]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:37:25 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-4cabdc70-9619-40da-930b-765642c1ba64 tempest-SnapshotsActionsTest-1376928580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.788a9239-2d3f-4f33-9c43-27edfd3fdaa4 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:25 devstack sudo[92690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.788a9239-2d3f-4f33-9c43-27edfd3fdaa4 Sep 18 21:37:25 devstack sudo[92690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:25 devstack sudo[92637]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:25 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-b027145e-b854-4a89-b9df-adeedf36f669 tempest-VolumesDeleteCascade-280764445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-27275b58-b9e7-4308-8cd2-ca2f3517fcef 1073741824" returned: 0 in 1.004s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:25 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-b027145e-b854-4a89-b9df-adeedf36f669 tempest-VolumesDeleteCascade-280764445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-27275b58-b9e7-4308-8cd2-ca2f3517fcef {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:25 devstack sudo[92701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-27275b58-b9e7-4308-8cd2-ca2f3517fcef Sep 18 21:37:25 devstack sudo[92701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:25 devstack sudo[92690]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:25 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-4cabdc70-9619-40da-930b-765642c1ba64 tempest-SnapshotsActionsTest-1376928580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.788a9239-2d3f-4f33-9c43-27edfd3fdaa4" returned: 0 in 0.859s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:25 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-4cabdc70-9619-40da-930b-765642c1ba64 tempest-SnapshotsActionsTest-1376928580 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2fe786d8-f74b-478c-b68b-a5f952400424(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86136) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 21:37:26 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b5d42f-8cd9-494b-8b28-685c117b5771]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:37:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-4cabdc70-9619-40da-930b-765642c1ba64 tempest-SnapshotsActionsTest-1376928580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.9e3ea175-4872-4a3f-8afe-c8e6c5880cda {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:26 devstack sudo[92701]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-b027145e-b854-4a89-b9df-adeedf36f669 tempest-VolumesDeleteCascade-280764445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-27275b58-b9e7-4308-8cd2-ca2f3517fcef" returned: 0 in 0.586s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:26 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-b027145e-b854-4a89-b9df-adeedf36f669 tempest-VolumesDeleteCascade-280764445 None] <== create_volume: return (1655ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:37:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-b027145e-b854-4a89-b9df-adeedf36f669 tempest-VolumesDeleteCascade-280764445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.658s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:37:26 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b027145e-b854-4a89-b9df-adeedf36f669 tempest-VolumesDeleteCascade-280764445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cc028e6-37f7-4c32-862f-0ddd8683b09c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27275b58-b9e7-4308-8cd2-ca2f3517fcef', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:37:26 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b027145e-b854-4a89-b9df-adeedf36f669 tempest-VolumesDeleteCascade-280764445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05da6a55-0b4e-4095-8021-af0138bb3fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:37:26 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-b027145e-b854-4a89-b9df-adeedf36f669 tempest-VolumesDeleteCascade-280764445 None] Volume volume-27275b58-b9e7-4308-8cd2-ca2f3517fcef (27275b58-b9e7-4308-8cd2-ca2f3517fcef): created successfully Sep 18 21:37:26 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b027145e-b854-4a89-b9df-adeedf36f669 tempest-VolumesDeleteCascade-280764445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05da6a55-0b4e-4095-8021-af0138bb3fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:37:26 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b027145e-b854-4a89-b9df-adeedf36f669 tempest-VolumesDeleteCascade-280764445 None] Flow 'volume_create_manager' (b69cfc0a-c52a-4ed5-ac44-1341050f2a1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:37:26 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-b027145e-b854-4a89-b9df-adeedf36f669 tempest-VolumesDeleteCascade-280764445 None] Created volume successfully. Sep 18 21:37:26 devstack sudo[92720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.9e3ea175-4872-4a3f-8afe-c8e6c5880cda Sep 18 21:37:26 devstack sudo[92720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-1025f705-754c-4d28-b0eb-b793266d319a tempest-VolumesDeleteCascade-280764445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:37:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-1025f705-754c-4d28-b0eb-b793266d319a tempest-VolumesDeleteCascade-280764445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:37:26 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-1025f705-754c-4d28-b0eb-b793266d319a tempest-VolumesDeleteCascade-280764445 None] Creating offline snapshot c8c47efb-6ae4-4e19-82fc-9b10eca05718 of volume 27275b58-b9e7-4308-8cd2-ca2f3517fcef {{(pid=86136) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 21:37:26 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[854f6d80-d77c-41e9-a4a7-67e8ce9ba67c]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:37:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1025f705-754c-4d28-b0eb-b793266d319a tempest-VolumesDeleteCascade-280764445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-27275b58-b9e7-4308-8cd2-ca2f3517fcef {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:26 devstack sudo[92720]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-4cabdc70-9619-40da-930b-765642c1ba64 tempest-SnapshotsActionsTest-1376928580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.9e3ea175-4872-4a3f-8afe-c8e6c5880cda" returned: 0 in 0.679s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:26 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-4cabdc70-9619-40da-930b-765642c1ba64 tempest-SnapshotsActionsTest-1376928580 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2fe786d8-f74b-478c-b68b-a5f952400424(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86136) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 21:37:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-4cabdc70-9619-40da-930b-765642c1ba64 tempest-SnapshotsActionsTest-1376928580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.788a9239-2d3f-4f33-9c43-27edfd3fdaa4 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:26 devstack sudo[92729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.788a9239-2d3f-4f33-9c43-27edfd3fdaa4 Sep 18 21:37:26 devstack sudo[92729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:26 devstack sudo[92728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-27275b58-b9e7-4308-8cd2-ca2f3517fcef Sep 18 21:37:26 devstack sudo[92728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:27 devstack sudo[92728]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:27 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1025f705-754c-4d28-b0eb-b793266d319a tempest-VolumesDeleteCascade-280764445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-27275b58-b9e7-4308-8cd2-ca2f3517fcef" returned: 0 in 0.494s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:27 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1025f705-754c-4d28-b0eb-b793266d319a tempest-VolumesDeleteCascade-280764445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-27275b58-b9e7-4308-8cd2-ca2f3517fcef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-27275b58-b9e7-4308-8cd2-ca2f3517fcef.c8c47efb-6ae4-4e19-82fc-9b10eca05718 1G {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:27 devstack sudo[92751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-27275b58-b9e7-4308-8cd2-ca2f3517fcef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-27275b58-b9e7-4308-8cd2-ca2f3517fcef.c8c47efb-6ae4-4e19-82fc-9b10eca05718 1G Sep 18 21:37:27 devstack sudo[92751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:27 devstack sudo[92729]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:27 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-4cabdc70-9619-40da-930b-765642c1ba64 tempest-SnapshotsActionsTest-1376928580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.788a9239-2d3f-4f33-9c43-27edfd3fdaa4" returned: 0 in 0.581s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:27 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-4cabdc70-9619-40da-930b-765642c1ba64 tempest-SnapshotsActionsTest-1376928580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.788a9239-2d3f-4f33-9c43-27edfd3fdaa4 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:27 devstack sudo[92753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.788a9239-2d3f-4f33-9c43-27edfd3fdaa4 Sep 18 21:37:27 devstack sudo[92753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:27 devstack sudo[92753]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:27 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-4cabdc70-9619-40da-930b-765642c1ba64 tempest-SnapshotsActionsTest-1376928580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.788a9239-2d3f-4f33-9c43-27edfd3fdaa4" returned: 0 in 0.335s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:27 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-4cabdc70-9619-40da-930b-765642c1ba64 tempest-SnapshotsActionsTest-1376928580 None] Lock "cinder-quobyte-788a9239-2d3f-4f33-9c43-27edfd3fdaa4" released by "_delete_snapshot" :: held 2.677s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:37:27 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-4cabdc70-9619-40da-930b-765642c1ba64 tempest-SnapshotsActionsTest-1376928580 None] Lock "cinder-quobyte-2fe786d8-f74b-478c-b68b-a5f952400424" released by "delete_snapshot" :: held 2.717s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:37:27 devstack sudo[92751]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:27 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1025f705-754c-4d28-b0eb-b793266d319a tempest-VolumesDeleteCascade-280764445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-27275b58-b9e7-4308-8cd2-ca2f3517fcef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-27275b58-b9e7-4308-8cd2-ca2f3517fcef.c8c47efb-6ae4-4e19-82fc-9b10eca05718 1G" returned: 0 in 0.581s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:27 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1025f705-754c-4d28-b0eb-b793266d319a tempest-VolumesDeleteCascade-280764445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27275b58-b9e7-4308-8cd2-ca2f3517fcef -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-27275b58-b9e7-4308-8cd2-ca2f3517fcef.c8c47efb-6ae4-4e19-82fc-9b10eca05718 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:27 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-4cabdc70-9619-40da-930b-765642c1ba64 tempest-SnapshotsActionsTest-1376928580 None] Created reservations ['cd483321-c516-4eba-b058-debdf3d134ef', '6ce0a6e2-95e0-4d5f-a4c5-05df98fc25e7', '1c8a7f94-c8ae-4c04-925d-6b0894b0f3fd', 'd7d6b102-b793-40e9-8f49-b9659a0c8652'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:37:27 devstack sudo[92762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27275b58-b9e7-4308-8cd2-ca2f3517fcef -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-27275b58-b9e7-4308-8cd2-ca2f3517fcef.c8c47efb-6ae4-4e19-82fc-9b10eca05718 Sep 18 21:37:27 devstack sudo[92762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:27 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-4cabdc70-9619-40da-930b-765642c1ba64 tempest-SnapshotsActionsTest-1376928580 None] Delete snapshot completed successfully. Sep 18 21:37:27 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-4cabdc70-9619-40da-930b-765642c1ba64 tempest-SnapshotsActionsTest-1376928580 None] Lock "cinder-788a9239-2d3f-4f33-9c43-27edfd3fdaa4-delete_snapshot" released by "delete_snapshot" :: held 2.981s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:37:28 devstack sudo[92762]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1025f705-754c-4d28-b0eb-b793266d319a tempest-VolumesDeleteCascade-280764445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27275b58-b9e7-4308-8cd2-ca2f3517fcef -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-27275b58-b9e7-4308-8cd2-ca2f3517fcef.c8c47efb-6ae4-4e19-82fc-9b10eca05718" returned: 0 in 0.473s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:28 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-1025f705-754c-4d28-b0eb-b793266d319a tempest-VolumesDeleteCascade-280764445 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-27275b58-b9e7-4308-8cd2-ca2f3517fcef.c8c47efb-6ae4-4e19-82fc-9b10eca05718 is being set with open permissions: ugo+rw Sep 18 21:37:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1025f705-754c-4d28-b0eb-b793266d319a tempest-VolumesDeleteCascade-280764445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-27275b58-b9e7-4308-8cd2-ca2f3517fcef.c8c47efb-6ae4-4e19-82fc-9b10eca05718 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:28 devstack sudo[92767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-27275b58-b9e7-4308-8cd2-ca2f3517fcef.c8c47efb-6ae4-4e19-82fc-9b10eca05718 Sep 18 21:37:28 devstack sudo[92767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:28 devstack sudo[92767]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1025f705-754c-4d28-b0eb-b793266d319a tempest-VolumesDeleteCascade-280764445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-27275b58-b9e7-4308-8cd2-ca2f3517fcef.c8c47efb-6ae4-4e19-82fc-9b10eca05718" returned: 0 in 0.448s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1025f705-754c-4d28-b0eb-b793266d319a tempest-VolumesDeleteCascade-280764445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-27275b58-b9e7-4308-8cd2-ca2f3517fcef.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-eeea3b48-00cb-401b-97ff-321e9b0a4a7b tempest-SnapshotsActionsTest-1764320913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:37:28 devstack sudo[92774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-27275b58-b9e7-4308-8cd2-ca2f3517fcef.info Sep 18 21:37:28 devstack sudo[92774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:29 devstack sudo[92774]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1025f705-754c-4d28-b0eb-b793266d319a tempest-VolumesDeleteCascade-280764445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-27275b58-b9e7-4308-8cd2-ca2f3517fcef.info" returned: 0 in 0.487s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:29 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-1025f705-754c-4d28-b0eb-b793266d319a tempest-VolumesDeleteCascade-280764445 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-27275b58-b9e7-4308-8cd2-ca2f3517fcef.info is being set with open permissions: ugo+rw Sep 18 21:37:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1025f705-754c-4d28-b0eb-b793266d319a tempest-VolumesDeleteCascade-280764445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-27275b58-b9e7-4308-8cd2-ca2f3517fcef.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:29 devstack sudo[92792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-27275b58-b9e7-4308-8cd2-ca2f3517fcef.info Sep 18 21:37:29 devstack sudo[92792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:29 devstack sudo[92792]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1025f705-754c-4d28-b0eb-b793266d319a tempest-VolumesDeleteCascade-280764445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-27275b58-b9e7-4308-8cd2-ca2f3517fcef.info" returned: 0 in 0.322s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-1025f705-754c-4d28-b0eb-b793266d319a tempest-VolumesDeleteCascade-280764445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.021s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:37:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-eeea3b48-00cb-401b-97ff-321e9b0a4a7b tempest-SnapshotsActionsTest-1764320913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.808s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:37:29 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-eeea3b48-00cb-401b-97ff-321e9b0a4a7b tempest-SnapshotsActionsTest-1764320913 None] Creating offline snapshot 936546c5-3a38-4521-a52a-41c4176af6c5 of volume 2fe786d8-f74b-478c-b68b-a5f952400424 {{(pid=86136) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 21:37:29 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-1025f705-754c-4d28-b0eb-b793266d319a tempest-VolumesDeleteCascade-280764445 None] Create snapshot completed successfully Sep 18 21:37:29 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[f35eb8df-25f7-4b06-a429-fd1a67078c16]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:37:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-eeea3b48-00cb-401b-97ff-321e9b0a4a7b tempest-SnapshotsActionsTest-1764320913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.9e3ea175-4872-4a3f-8afe-c8e6c5880cda {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:29 devstack sudo[92803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.9e3ea175-4872-4a3f-8afe-c8e6c5880cda Sep 18 21:37:29 devstack sudo[92803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:30 devstack sudo[92803]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:30 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-eeea3b48-00cb-401b-97ff-321e9b0a4a7b tempest-SnapshotsActionsTest-1764320913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.9e3ea175-4872-4a3f-8afe-c8e6c5880cda" returned: 0 in 0.576s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:30 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-eeea3b48-00cb-401b-97ff-321e9b0a4a7b tempest-SnapshotsActionsTest-1764320913 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2fe786d8-f74b-478c-b68b-a5f952400424(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86136) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 21:37:30 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-eeea3b48-00cb-401b-97ff-321e9b0a4a7b tempest-SnapshotsActionsTest-1764320913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.9e3ea175-4872-4a3f-8afe-c8e6c5880cda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.936546c5-3a38-4521-a52a-41c4176af6c5 1G {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:30 devstack sudo[92810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.9e3ea175-4872-4a3f-8afe-c8e6c5880cda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.936546c5-3a38-4521-a52a-41c4176af6c5 1G Sep 18 21:37:30 devstack sudo[92810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:30 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-2aeafb2a-61b6-4d16-8ff3-6ddec5fcd149 tempest-VolumesDeleteCascade-280764445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:37:30 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2aeafb2a-61b6-4d16-8ff3-6ddec5fcd149 tempest-VolumesDeleteCascade-280764445 None] Flow 'volume_create_manager' (65379e77-a0f5-46d5-9383-6bfb92b4e646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:37:30 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2aeafb2a-61b6-4d16-8ff3-6ddec5fcd149 tempest-VolumesDeleteCascade-280764445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (621827b6-b87c-4a0d-bba1-7008d331e8ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:37:30 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2aeafb2a-61b6-4d16-8ff3-6ddec5fcd149 tempest-VolumesDeleteCascade-280764445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (621827b6-b87c-4a0d-bba1-7008d331e8ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:37:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2051166962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca3e22a5-7f24-492d-9a29-8f9e8f17d494,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e80ec8f3c143431a98eafe964c7179e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:37:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c8c47efb-6ae4-4e19-82fc-9b10eca05718,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:37:31Z,use_quota=True,user_id='d5f58a07c7a64f8298455a27e6d28098',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:37:30 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2aeafb2a-61b6-4d16-8ff3-6ddec5fcd149 tempest-VolumesDeleteCascade-280764445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35ddbbac-e4f9-40bd-9104-107499f99625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:37:30 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2aeafb2a-61b6-4d16-8ff3-6ddec5fcd149 tempest-VolumesDeleteCascade-280764445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35ddbbac-e4f9-40bd-9104-107499f99625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:37:30 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2aeafb2a-61b6-4d16-8ff3-6ddec5fcd149 tempest-VolumesDeleteCascade-280764445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2315db89-b40a-47b2-8175-4a3888587f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:37:30 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2aeafb2a-61b6-4d16-8ff3-6ddec5fcd149 tempest-VolumesDeleteCascade-280764445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2315db89-b40a-47b2-8175-4a3888587f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ca3e22a5-7f24-492d-9a29-8f9e8f17d494', 'volume_name': 'volume-ca3e22a5-7f24-492d-9a29-8f9e8f17d494', 'volume_size': 1, 'snapshot_id': 'c8c47efb-6ae4-4e19-82fc-9b10eca05718'}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:37:30 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2aeafb2a-61b6-4d16-8ff3-6ddec5fcd149 tempest-VolumesDeleteCascade-280764445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3fbd440-25a2-4789-8882-7dec3ee539de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:37:30 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2aeafb2a-61b6-4d16-8ff3-6ddec5fcd149 tempest-VolumesDeleteCascade-280764445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3fbd440-25a2-4789-8882-7dec3ee539de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:37:30 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2aeafb2a-61b6-4d16-8ff3-6ddec5fcd149 tempest-VolumesDeleteCascade-280764445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (829f8071-788b-48e5-9ce1-27c319097ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:37:30 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-2aeafb2a-61b6-4d16-8ff3-6ddec5fcd149 tempest-VolumesDeleteCascade-280764445 None] Volume ca3e22a5-7f24-492d-9a29-8f9e8f17d494: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ca3e22a5-7f24-492d-9a29-8f9e8f17d494', 'volume_size': 1, 'snapshot_id': 'c8c47efb-6ae4-4e19-82fc-9b10eca05718'} Sep 18 21:37:30 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-2aeafb2a-61b6-4d16-8ff3-6ddec5fcd149 tempest-VolumesDeleteCascade-280764445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:37:31 devstack sudo[92810]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-eeea3b48-00cb-401b-97ff-321e9b0a4a7b tempest-SnapshotsActionsTest-1764320913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.9e3ea175-4872-4a3f-8afe-c8e6c5880cda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.936546c5-3a38-4521-a52a-41c4176af6c5 1G" returned: 0 in 0.725s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-eeea3b48-00cb-401b-97ff-321e9b0a4a7b tempest-SnapshotsActionsTest-1764320913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fe786d8-f74b-478c-b68b-a5f952400424.9e3ea175-4872-4a3f-8afe-c8e6c5880cda -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.936546c5-3a38-4521-a52a-41c4176af6c5 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:31 devstack sudo[92818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fe786d8-f74b-478c-b68b-a5f952400424.9e3ea175-4872-4a3f-8afe-c8e6c5880cda -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.936546c5-3a38-4521-a52a-41c4176af6c5 Sep 18 21:37:31 devstack sudo[92818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:31 devstack cinder-volume[86136]: INFO cinder.volume.manager [req-b056e3ba-34bb-4dcb-bb26-4a875e3eb3a9 req-df04cc23-7fcf-4af0-92f3-cc974734e62c tempest-ServerActionsTestOtherA-232293627 None] Terminate volume connection completed successfully. Sep 18 21:37:31 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [req-b056e3ba-34bb-4dcb-bb26-4a875e3eb3a9 req-df04cc23-7fcf-4af0-92f3-cc974734e62c tempest-ServerActionsTestOtherA-232293627 None] Deleting attachment 100bba3b-5d68-4ef7-a199-32d3879f9cbf. {{(pid=86136) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 18 21:37:31 devstack cinder-volume[86136]: DEBUG cinder.coordination [req-b056e3ba-34bb-4dcb-bb26-4a875e3eb3a9 req-1939d33e-40c4-4842-a68c-6c634454c0d9 tempest-ServerActionsTestOtherA-232293627 None] Acquiring lock "cinder-4ab86e2d-fb18-4f12-bb73-cece1359268e-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:37:31 devstack cinder-volume[86136]: DEBUG cinder.coordination [req-b056e3ba-34bb-4dcb-bb26-4a875e3eb3a9 req-1939d33e-40c4-4842-a68c-6c634454c0d9 tempest-ServerActionsTestOtherA-232293627 None] Lock "cinder-4ab86e2d-fb18-4f12-bb73-cece1359268e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:37:31 devstack sudo[92818]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:31 devstack cinder-volume[86136]: DEBUG cinder.coordination [req-b056e3ba-34bb-4dcb-bb26-4a875e3eb3a9 req-1939d33e-40c4-4842-a68c-6c634454c0d9 tempest-ServerActionsTestOtherA-232293627 None] Acquiring lock "cinder-quobyte-4ab86e2d-fb18-4f12-bb73-cece1359268e" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:37:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-eeea3b48-00cb-401b-97ff-321e9b0a4a7b tempest-SnapshotsActionsTest-1764320913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fe786d8-f74b-478c-b68b-a5f952400424.9e3ea175-4872-4a3f-8afe-c8e6c5880cda -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.936546c5-3a38-4521-a52a-41c4176af6c5" returned: 0 in 0.361s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:31 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-eeea3b48-00cb-401b-97ff-321e9b0a4a7b tempest-SnapshotsActionsTest-1764320913 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.936546c5-3a38-4521-a52a-41c4176af6c5 is being set with open permissions: ugo+rw Sep 18 21:37:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-eeea3b48-00cb-401b-97ff-321e9b0a4a7b tempest-SnapshotsActionsTest-1764320913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.936546c5-3a38-4521-a52a-41c4176af6c5 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:31 devstack cinder-volume[86136]: DEBUG cinder.coordination [req-b056e3ba-34bb-4dcb-bb26-4a875e3eb3a9 req-1939d33e-40c4-4842-a68c-6c634454c0d9 tempest-ServerActionsTestOtherA-232293627 None] Lock "cinder-quobyte-4ab86e2d-fb18-4f12-bb73-cece1359268e" acquired by "delete_volume" :: waited 0.035s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:37:31 devstack sudo[92823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.936546c5-3a38-4521-a52a-41c4176af6c5 Sep 18 21:37:31 devstack sudo[92823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:31 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[0998bbc7-d80c-4009-bd27-5a5238dd220a]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:37:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [req-b056e3ba-34bb-4dcb-bb26-4a875e3eb3a9 req-1939d33e-40c4-4842-a68c-6c634454c0d9 tempest-ServerActionsTestOtherA-232293627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4ab86e2d-fb18-4f12-bb73-cece1359268e {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:31 devstack sudo[92825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4ab86e2d-fb18-4f12-bb73-cece1359268e Sep 18 21:37:31 devstack sudo[92825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:31 devstack sudo[92823]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-eeea3b48-00cb-401b-97ff-321e9b0a4a7b tempest-SnapshotsActionsTest-1764320913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.936546c5-3a38-4521-a52a-41c4176af6c5" returned: 0 in 0.388s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-eeea3b48-00cb-401b-97ff-321e9b0a4a7b tempest-SnapshotsActionsTest-1764320913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.223s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:37:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-2aeafb2a-61b6-4d16-8ff3-6ddec5fcd149 tempest-VolumesDeleteCascade-280764445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.947s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:37:31 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-2aeafb2a-61b6-4d16-8ff3-6ddec5fcd149 tempest-VolumesDeleteCascade-280764445 None] Acquiring lock "cinder-quobyte-c8c47efb-6ae4-4e19-82fc-9b10eca05718-ca3e22a5-7f24-492d-9a29-8f9e8f17d494" by "_create_volume_from_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:37:31 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-2aeafb2a-61b6-4d16-8ff3-6ddec5fcd149 tempest-VolumesDeleteCascade-280764445 None] Lock "cinder-quobyte-c8c47efb-6ae4-4e19-82fc-9b10eca05718-ca3e22a5-7f24-492d-9a29-8f9e8f17d494" acquired by "_create_volume_from_snapshot" :: waited 0.039s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:37:31 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-2aeafb2a-61b6-4d16-8ff3-6ddec5fcd149 tempest-VolumesDeleteCascade-280764445 None] Creating volume ca3e22a5-7f24-492d-9a29-8f9e8f17d494 from snapshot c8c47efb-6ae4-4e19-82fc-9b10eca05718 {{(pid=86136) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 18 21:37:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-2aeafb2a-61b6-4d16-8ff3-6ddec5fcd149 tempest-VolumesDeleteCascade-280764445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:37:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-2aeafb2a-61b6-4d16-8ff3-6ddec5fcd149 tempest-VolumesDeleteCascade-280764445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:37:31 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-2aeafb2a-61b6-4d16-8ff3-6ddec5fcd149 tempest-VolumesDeleteCascade-280764445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:37:31 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-2aeafb2a-61b6-4d16-8ff3-6ddec5fcd149 tempest-VolumesDeleteCascade-280764445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:37:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-2aeafb2a-61b6-4d16-8ff3-6ddec5fcd149 tempest-VolumesDeleteCascade-280764445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:37:31 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-2aeafb2a-61b6-4d16-8ff3-6ddec5fcd149 tempest-VolumesDeleteCascade-280764445 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:37:31 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-2aeafb2a-61b6-4d16-8ff3-6ddec5fcd149 tempest-VolumesDeleteCascade-280764445 None] Acquiring lock "cinder-quobyte-ca3e22a5-7f24-492d-9a29-8f9e8f17d494" by "_copy_volume_from_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:37:31 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-eeea3b48-00cb-401b-97ff-321e9b0a4a7b tempest-SnapshotsActionsTest-1764320913 None] Create snapshot completed successfully Sep 18 21:37:31 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-2aeafb2a-61b6-4d16-8ff3-6ddec5fcd149 tempest-VolumesDeleteCascade-280764445 None] Lock "cinder-quobyte-ca3e22a5-7f24-492d-9a29-8f9e8f17d494" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:37:31 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-2aeafb2a-61b6-4d16-8ff3-6ddec5fcd149 tempest-VolumesDeleteCascade-280764445 None] snapshot: c8c47efb-6ae4-4e19-82fc-9b10eca05718, volume: ca3e22a5-7f24-492d-9a29-8f9e8f17d494, {{(pid=86136) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 18 21:37:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-2aeafb2a-61b6-4d16-8ff3-6ddec5fcd149 tempest-VolumesDeleteCascade-280764445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:37:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-2aeafb2a-61b6-4d16-8ff3-6ddec5fcd149 tempest-VolumesDeleteCascade-280764445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:37:32 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-2aeafb2a-61b6-4d16-8ff3-6ddec5fcd149 tempest-VolumesDeleteCascade-280764445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:37:32 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-2aeafb2a-61b6-4d16-8ff3-6ddec5fcd149 tempest-VolumesDeleteCascade-280764445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:37:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-2aeafb2a-61b6-4d16-8ff3-6ddec5fcd149 tempest-VolumesDeleteCascade-280764445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:37:32 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c0e514c-8d56-4506-a6a0-3e714133a6be]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:37:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-2aeafb2a-61b6-4d16-8ff3-6ddec5fcd149 tempest-VolumesDeleteCascade-280764445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-27275b58-b9e7-4308-8cd2-ca2f3517fcef.c8c47efb-6ae4-4e19-82fc-9b10eca05718 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:32 devstack sudo[92825]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [req-b056e3ba-34bb-4dcb-bb26-4a875e3eb3a9 req-1939d33e-40c4-4842-a68c-6c634454c0d9 tempest-ServerActionsTestOtherA-232293627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4ab86e2d-fb18-4f12-bb73-cece1359268e" returned: 0 in 0.523s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [req-b056e3ba-34bb-4dcb-bb26-4a875e3eb3a9 req-1939d33e-40c4-4842-a68c-6c634454c0d9 tempest-ServerActionsTestOtherA-232293627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4ab86e2d-fb18-4f12-bb73-cece1359268e {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:32 devstack sudo[92832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4ab86e2d-fb18-4f12-bb73-cece1359268e Sep 18 21:37:32 devstack sudo[92832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:32 devstack sudo[92831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-27275b58-b9e7-4308-8cd2-ca2f3517fcef.c8c47efb-6ae4-4e19-82fc-9b10eca05718 Sep 18 21:37:32 devstack sudo[92831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:32 devstack sudo[92832]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [req-b056e3ba-34bb-4dcb-bb26-4a875e3eb3a9 req-1939d33e-40c4-4842-a68c-6c634454c0d9 tempest-ServerActionsTestOtherA-232293627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4ab86e2d-fb18-4f12-bb73-cece1359268e" returned: 0 in 0.294s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:32 devstack cinder-volume[86136]: DEBUG cinder.coordination [req-b056e3ba-34bb-4dcb-bb26-4a875e3eb3a9 req-1939d33e-40c4-4842-a68c-6c634454c0d9 tempest-ServerActionsTestOtherA-232293627 None] Lock "cinder-quobyte-4ab86e2d-fb18-4f12-bb73-cece1359268e" released by "delete_volume" :: held 0.894s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:37:32 devstack cinder-volume[86136]: DEBUG cinder.quota [req-b056e3ba-34bb-4dcb-bb26-4a875e3eb3a9 req-1939d33e-40c4-4842-a68c-6c634454c0d9 tempest-ServerActionsTestOtherA-232293627 None] Created reservations ['00b8cc78-5146-4376-ae6c-f8968e19fc7b', 'd897c510-8203-482a-ac00-43f487f6d408', '9e016912-74be-47a8-aea0-097558fbdaa2', 'fc1fa754-f11f-4ee7-9944-4b00b57d6833'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:37:32 devstack sudo[92831]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-2aeafb2a-61b6-4d16-8ff3-6ddec5fcd149 tempest-VolumesDeleteCascade-280764445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-27275b58-b9e7-4308-8cd2-ca2f3517fcef.c8c47efb-6ae4-4e19-82fc-9b10eca05718" returned: 0 in 0.425s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:32 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-2aeafb2a-61b6-4d16-8ff3-6ddec5fcd149 tempest-VolumesDeleteCascade-280764445 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27275b58-b9e7-4308-8cd2-ca2f3517fcef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86136) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 21:37:32 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[e418f771-a63b-4659-a0c7-96adce8653aa]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:37:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-2aeafb2a-61b6-4d16-8ff3-6ddec5fcd149 tempest-VolumesDeleteCascade-280764445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-27275b58-b9e7-4308-8cd2-ca2f3517fcef {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-b056e3ba-34bb-4dcb-bb26-4a875e3eb3a9 req-1939d33e-40c4-4842-a68c-6c634454c0d9 tempest-ServerActionsTestOtherA-232293627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:37:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-b056e3ba-34bb-4dcb-bb26-4a875e3eb3a9 req-1939d33e-40c4-4842-a68c-6c634454c0d9 tempest-ServerActionsTestOtherA-232293627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:37:32 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [req-b056e3ba-34bb-4dcb-bb26-4a875e3eb3a9 req-1939d33e-40c4-4842-a68c-6c634454c0d9 tempest-ServerActionsTestOtherA-232293627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:37:32 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [req-b056e3ba-34bb-4dcb-bb26-4a875e3eb3a9 req-1939d33e-40c4-4842-a68c-6c634454c0d9 tempest-ServerActionsTestOtherA-232293627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:37:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-b056e3ba-34bb-4dcb-bb26-4a875e3eb3a9 req-1939d33e-40c4-4842-a68c-6c634454c0d9 tempest-ServerActionsTestOtherA-232293627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:37:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [req-b056e3ba-34bb-4dcb-bb26-4a875e3eb3a9 req-1939d33e-40c4-4842-a68c-6c634454c0d9 tempest-ServerActionsTestOtherA-232293627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:32 devstack sudo[92840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:37:32 devstack sudo[92840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:32 devstack sudo[92839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-27275b58-b9e7-4308-8cd2-ca2f3517fcef Sep 18 21:37:32 devstack sudo[92839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:32 devstack sudo[92840]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [req-b056e3ba-34bb-4dcb-bb26-4a875e3eb3a9 req-1939d33e-40c4-4842-a68c-6c634454c0d9 tempest-ServerActionsTestOtherA-232293627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.310s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:32 devstack cinder-volume[86136]: DEBUG cinder.manager [req-b056e3ba-34bb-4dcb-bb26-4a875e3eb3a9 req-1939d33e-40c4-4842-a68c-6c634454c0d9 tempest-ServerActionsTestOtherA-232293627 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:37:32 devstack cinder-volume[86136]: INFO cinder.volume.manager [req-b056e3ba-34bb-4dcb-bb26-4a875e3eb3a9 req-1939d33e-40c4-4842-a68c-6c634454c0d9 tempest-ServerActionsTestOtherA-232293627 None] Deleted volume successfully. Sep 18 21:37:32 devstack cinder-volume[86136]: DEBUG cinder.coordination [req-b056e3ba-34bb-4dcb-bb26-4a875e3eb3a9 req-1939d33e-40c4-4842-a68c-6c634454c0d9 tempest-ServerActionsTestOtherA-232293627 None] Lock "cinder-4ab86e2d-fb18-4f12-bb73-cece1359268e-delete_volume" released by "delete_volume" :: held 1.495s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:37:32 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-f1e3745f-b6e3-473e-8054-b38c00534e4d tempest-ServerActionsTestOtherA-232293627 None] Acquiring lock "cinder-90d0d3b3-a480-45e5-9f6c-f7e2019cfdff-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:37:33 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-f1e3745f-b6e3-473e-8054-b38c00534e4d tempest-ServerActionsTestOtherA-232293627 None] Lock "cinder-90d0d3b3-a480-45e5-9f6c-f7e2019cfdff-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:37:33 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-f1e3745f-b6e3-473e-8054-b38c00534e4d tempest-ServerActionsTestOtherA-232293627 None] Acquiring lock "cinder-quobyte-90d0d3b3-a480-45e5-9f6c-f7e2019cfdff" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:37:33 devstack sudo[92839]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:33 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-2aeafb2a-61b6-4d16-8ff3-6ddec5fcd149 tempest-VolumesDeleteCascade-280764445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-27275b58-b9e7-4308-8cd2-ca2f3517fcef" returned: 0 in 0.619s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:33 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-2aeafb2a-61b6-4d16-8ff3-6ddec5fcd149 tempest-VolumesDeleteCascade-280764445 None] will copy from snapshot at /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-27275b58-b9e7-4308-8cd2-ca2f3517fcef {{(pid=86136) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 18 21:37:33 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-2aeafb2a-61b6-4d16-8ff3-6ddec5fcd149 tempest-VolumesDeleteCascade-280764445 None] Creating direct copy from snapshot {{(pid=86136) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 18 21:37:33 devstack cinder-volume[86136]: DEBUG cinder.utils [None req-2aeafb2a-61b6-4d16-8ff3-6ddec5fcd149 tempest-VolumesDeleteCascade-280764445 None] Path /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ca3e22a5-7f24-492d-9a29-8f9e8f17d494 not found in is_blk_device check {{(pid=86136) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 18 21:37:33 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-2aeafb2a-61b6-4d16-8ff3-6ddec5fcd149 tempest-VolumesDeleteCascade-280764445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-27275b58-b9e7-4308-8cd2-ca2f3517fcef /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ca3e22a5-7f24-492d-9a29-8f9e8f17d494 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:33 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-f1e3745f-b6e3-473e-8054-b38c00534e4d tempest-ServerActionsTestOtherA-232293627 None] Lock "cinder-quobyte-90d0d3b3-a480-45e5-9f6c-f7e2019cfdff" acquired by "delete_volume" :: waited 0.130s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:37:33 devstack sudo[92847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-27275b58-b9e7-4308-8cd2-ca2f3517fcef /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ca3e22a5-7f24-492d-9a29-8f9e8f17d494 Sep 18 21:37:33 devstack sudo[92847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:33 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eedf9f5-8737-4621-92fd-9bebc7b4eaac]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:37:33 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f1e3745f-b6e3-473e-8054-b38c00534e4d tempest-ServerActionsTestOtherA-232293627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-90d0d3b3-a480-45e5-9f6c-f7e2019cfdff {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:33 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-53ee1921-81f1-491e-ab98-f20b231751a6 tempest-SnapshotsActionsTest-1376928580 None] Acquiring lock "cinder-936546c5-3a38-4521-a52a-41c4176af6c5-delete_snapshot" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:37:33 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-53ee1921-81f1-491e-ab98-f20b231751a6 tempest-SnapshotsActionsTest-1376928580 None] Lock "cinder-936546c5-3a38-4521-a52a-41c4176af6c5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:37:33 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-53ee1921-81f1-491e-ab98-f20b231751a6 tempest-SnapshotsActionsTest-1376928580 None] Acquiring lock "cinder-quobyte-2fe786d8-f74b-478c-b68b-a5f952400424" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:37:33 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-53ee1921-81f1-491e-ab98-f20b231751a6 tempest-SnapshotsActionsTest-1376928580 None] Lock "cinder-quobyte-2fe786d8-f74b-478c-b68b-a5f952400424" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:37:33 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-53ee1921-81f1-491e-ab98-f20b231751a6 tempest-SnapshotsActionsTest-1376928580 None] Acquiring lock "cinder-quobyte-936546c5-3a38-4521-a52a-41c4176af6c5" by "_delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:37:33 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-53ee1921-81f1-491e-ab98-f20b231751a6 tempest-SnapshotsActionsTest-1376928580 None] Lock "cinder-quobyte-936546c5-3a38-4521-a52a-41c4176af6c5" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:37:33 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-53ee1921-81f1-491e-ab98-f20b231751a6 tempest-SnapshotsActionsTest-1376928580 None] Deleting offline snapshot 936546c5-3a38-4521-a52a-41c4176af6c5 of volume 2fe786d8-f74b-478c-b68b-a5f952400424 {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 21:37:33 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-53ee1921-81f1-491e-ab98-f20b231751a6 tempest-SnapshotsActionsTest-1376928580 None] snapshot_file for this snap is: volume-2fe786d8-f74b-478c-b68b-a5f952400424.936546c5-3a38-4521-a52a-41c4176af6c5 {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 21:37:33 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[a26b93da-219f-4e64-84b2-a71c0b3276ea]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:37:33 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-53ee1921-81f1-491e-ab98-f20b231751a6 tempest-SnapshotsActionsTest-1376928580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.936546c5-3a38-4521-a52a-41c4176af6c5 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:33 devstack sudo[92849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-90d0d3b3-a480-45e5-9f6c-f7e2019cfdff Sep 18 21:37:33 devstack sudo[92849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:33 devstack sudo[92851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.936546c5-3a38-4521-a52a-41c4176af6c5 Sep 18 21:37:33 devstack sudo[92851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:33 devstack sudo[92849]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:33 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f1e3745f-b6e3-473e-8054-b38c00534e4d tempest-ServerActionsTestOtherA-232293627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-90d0d3b3-a480-45e5-9f6c-f7e2019cfdff" returned: 0 in 0.518s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:33 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f1e3745f-b6e3-473e-8054-b38c00534e4d tempest-ServerActionsTestOtherA-232293627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-90d0d3b3-a480-45e5-9f6c-f7e2019cfdff {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:33 devstack sudo[92867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-90d0d3b3-a480-45e5-9f6c-f7e2019cfdff Sep 18 21:37:33 devstack sudo[92867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:34 devstack sudo[92851]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:34 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-53ee1921-81f1-491e-ab98-f20b231751a6 tempest-SnapshotsActionsTest-1376928580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.936546c5-3a38-4521-a52a-41c4176af6c5" returned: 0 in 0.665s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:34 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-53ee1921-81f1-491e-ab98-f20b231751a6 tempest-SnapshotsActionsTest-1376928580 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2fe786d8-f74b-478c-b68b-a5f952400424(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86136) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 21:37:34 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e4c85a-1ebd-4689-a8c8-68c6228c9567]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:37:34 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-53ee1921-81f1-491e-ab98-f20b231751a6 tempest-SnapshotsActionsTest-1376928580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.9e3ea175-4872-4a3f-8afe-c8e6c5880cda {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:34 devstack sudo[92867]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:34 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f1e3745f-b6e3-473e-8054-b38c00534e4d tempest-ServerActionsTestOtherA-232293627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-90d0d3b3-a480-45e5-9f6c-f7e2019cfdff" returned: 0 in 0.672s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:34 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-f1e3745f-b6e3-473e-8054-b38c00534e4d tempest-ServerActionsTestOtherA-232293627 None] Lock "cinder-quobyte-90d0d3b3-a480-45e5-9f6c-f7e2019cfdff" released by "delete_volume" :: held 1.253s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:37:34 devstack sudo[92871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.9e3ea175-4872-4a3f-8afe-c8e6c5880cda Sep 18 21:37:34 devstack sudo[92871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:34 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-f1e3745f-b6e3-473e-8054-b38c00534e4d tempest-ServerActionsTestOtherA-232293627 None] Created reservations ['db39c98d-b04e-4b6d-aa52-2d95ebcec398', 'a2cdbe16-4846-4898-98b9-9ad44685f1a9', '4837defb-706b-4796-a792-31da41ff0afa', 'd9b39606-8cd2-47b2-9ee8-716ad7dc43af'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:37:34 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-f1e3745f-b6e3-473e-8054-b38c00534e4d tempest-ServerActionsTestOtherA-232293627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:37:34 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-f1e3745f-b6e3-473e-8054-b38c00534e4d tempest-ServerActionsTestOtherA-232293627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:37:34 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-f1e3745f-b6e3-473e-8054-b38c00534e4d tempest-ServerActionsTestOtherA-232293627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:37:34 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-f1e3745f-b6e3-473e-8054-b38c00534e4d tempest-ServerActionsTestOtherA-232293627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:37:34 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-f1e3745f-b6e3-473e-8054-b38c00534e4d tempest-ServerActionsTestOtherA-232293627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:37:34 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f1e3745f-b6e3-473e-8054-b38c00534e4d tempest-ServerActionsTestOtherA-232293627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:34 devstack sudo[92875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:37:34 devstack sudo[92875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:35 devstack sudo[92871]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:35 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-53ee1921-81f1-491e-ab98-f20b231751a6 tempest-SnapshotsActionsTest-1376928580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.9e3ea175-4872-4a3f-8afe-c8e6c5880cda" returned: 0 in 0.964s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:35 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-53ee1921-81f1-491e-ab98-f20b231751a6 tempest-SnapshotsActionsTest-1376928580 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2fe786d8-f74b-478c-b68b-a5f952400424(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86136) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 21:37:35 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-53ee1921-81f1-491e-ab98-f20b231751a6 tempest-SnapshotsActionsTest-1376928580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.936546c5-3a38-4521-a52a-41c4176af6c5 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:35 devstack sudo[92875]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:35 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f1e3745f-b6e3-473e-8054-b38c00534e4d tempest-ServerActionsTestOtherA-232293627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.470s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:35 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-f1e3745f-b6e3-473e-8054-b38c00534e4d tempest-ServerActionsTestOtherA-232293627 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:37:35 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-f1e3745f-b6e3-473e-8054-b38c00534e4d tempest-ServerActionsTestOtherA-232293627 None] Deleted volume successfully. Sep 18 21:37:35 devstack sudo[92882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.936546c5-3a38-4521-a52a-41c4176af6c5 Sep 18 21:37:35 devstack sudo[92882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:35 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-f1e3745f-b6e3-473e-8054-b38c00534e4d tempest-ServerActionsTestOtherA-232293627 None] Lock "cinder-90d0d3b3-a480-45e5-9f6c-f7e2019cfdff-delete_volume" released by "delete_volume" :: held 2.273s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:37:36 devstack sudo[92882]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:36 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-53ee1921-81f1-491e-ab98-f20b231751a6 tempest-SnapshotsActionsTest-1376928580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.936546c5-3a38-4521-a52a-41c4176af6c5" returned: 0 in 1.160s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:36 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-53ee1921-81f1-491e-ab98-f20b231751a6 tempest-SnapshotsActionsTest-1376928580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.936546c5-3a38-4521-a52a-41c4176af6c5 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:36 devstack sudo[92888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.936546c5-3a38-4521-a52a-41c4176af6c5 Sep 18 21:37:36 devstack sudo[92888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:37 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-53ee1921-81f1-491e-ab98-f20b231751a6 tempest-SnapshotsActionsTest-1376928580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.936546c5-3a38-4521-a52a-41c4176af6c5" returned: 0 in 0.753s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:37 devstack sudo[92888]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:37 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-53ee1921-81f1-491e-ab98-f20b231751a6 tempest-SnapshotsActionsTest-1376928580 None] Lock "cinder-quobyte-936546c5-3a38-4521-a52a-41c4176af6c5" released by "_delete_snapshot" :: held 3.829s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:37:37 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-53ee1921-81f1-491e-ab98-f20b231751a6 tempest-SnapshotsActionsTest-1376928580 None] Lock "cinder-quobyte-2fe786d8-f74b-478c-b68b-a5f952400424" released by "delete_snapshot" :: held 3.897s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:37:37 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-53ee1921-81f1-491e-ab98-f20b231751a6 tempest-SnapshotsActionsTest-1376928580 None] Created reservations ['f336b48b-f1d2-4e6a-a2a9-8eb0d531d5e5', 'e6ef75c3-8307-4406-a593-a941792417c5', '47ac31f6-b822-47e4-8efd-363f46a5d63a', '62b6cfdd-6390-4dd9-8b44-c57dbe185f13'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:37:37 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-53ee1921-81f1-491e-ab98-f20b231751a6 tempest-SnapshotsActionsTest-1376928580 None] Delete snapshot completed successfully. Sep 18 21:37:37 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-53ee1921-81f1-491e-ab98-f20b231751a6 tempest-SnapshotsActionsTest-1376928580 None] Lock "cinder-936546c5-3a38-4521-a52a-41c4176af6c5-delete_snapshot" released by "delete_snapshot" :: held 4.312s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:37:38 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-73ef89b7-fda1-412e-9a3e-44a20bfb614e tempest-SnapshotsActionsTest-1764320913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:37:42 devstack sudo[92847]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:42 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-2aeafb2a-61b6-4d16-8ff3-6ddec5fcd149 tempest-VolumesDeleteCascade-280764445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-27275b58-b9e7-4308-8cd2-ca2f3517fcef /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ca3e22a5-7f24-492d-9a29-8f9e8f17d494" returned: 0 in 9.519s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:42 devstack cinder-volume[86136]: DEBUG cinder.image.image_utils [None req-2aeafb2a-61b6-4d16-8ff3-6ddec5fcd149 tempest-VolumesDeleteCascade-280764445 None] Image conversion details: src /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-27275b58-b9e7-4308-8cd2-ca2f3517fcef, size 1024.00 MB, duration 9.52 sec, destination /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ca3e22a5-7f24-492d-9a29-8f9e8f17d494 {{(pid=86136) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 18 21:37:42 devstack cinder-volume[86136]: INFO cinder.image.image_utils [None req-2aeafb2a-61b6-4d16-8ff3-6ddec5fcd149 tempest-VolumesDeleteCascade-280764445 None] Converted 1024.00 MB image at 107.56 MB/s Sep 18 21:37:42 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-2aeafb2a-61b6-4d16-8ff3-6ddec5fcd149 tempest-VolumesDeleteCascade-280764445 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ca3e22a5-7f24-492d-9a29-8f9e8f17d494 is being set with open permissions: ugo+rw Sep 18 21:37:42 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-2aeafb2a-61b6-4d16-8ff3-6ddec5fcd149 tempest-VolumesDeleteCascade-280764445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ca3e22a5-7f24-492d-9a29-8f9e8f17d494 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:42 devstack sudo[92917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ca3e22a5-7f24-492d-9a29-8f9e8f17d494 Sep 18 21:37:42 devstack sudo[92917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:42 devstack sudo[92917]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:42 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-2aeafb2a-61b6-4d16-8ff3-6ddec5fcd149 tempest-VolumesDeleteCascade-280764445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ca3e22a5-7f24-492d-9a29-8f9e8f17d494" returned: 0 in 0.255s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:42 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-2aeafb2a-61b6-4d16-8ff3-6ddec5fcd149 tempest-VolumesDeleteCascade-280764445 None] Lock "cinder-quobyte-ca3e22a5-7f24-492d-9a29-8f9e8f17d494" released by "_copy_volume_from_snapshot" :: held 10.960s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:37:42 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-2aeafb2a-61b6-4d16-8ff3-6ddec5fcd149 tempest-VolumesDeleteCascade-280764445 None] Lock "cinder-quobyte-c8c47efb-6ae4-4e19-82fc-9b10eca05718-ca3e22a5-7f24-492d-9a29-8f9e8f17d494" released by "_create_volume_from_snapshot" :: held 11.039s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:37:42 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-2aeafb2a-61b6-4d16-8ff3-6ddec5fcd149 tempest-VolumesDeleteCascade-280764445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.080s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:37:42 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-73ef89b7-fda1-412e-9a3e-44a20bfb614e tempest-SnapshotsActionsTest-1764320913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.401s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:37:42 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-73ef89b7-fda1-412e-9a3e-44a20bfb614e tempest-SnapshotsActionsTest-1764320913 None] Creating offline snapshot 6353c448-a98a-421c-90b4-3b11f1ec58e4 of volume 2fe786d8-f74b-478c-b68b-a5f952400424 {{(pid=86136) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 21:37:43 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2aeafb2a-61b6-4d16-8ff3-6ddec5fcd149 tempest-VolumesDeleteCascade-280764445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (829f8071-788b-48e5-9ce1-27c319097ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca3e22a5-7f24-492d-9a29-8f9e8f17d494', 'volume_size': 1, 'snapshot_id': 'c8c47efb-6ae4-4e19-82fc-9b10eca05718'}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:37:43 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2aeafb2a-61b6-4d16-8ff3-6ddec5fcd149 tempest-VolumesDeleteCascade-280764445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8987b5e-3e2b-4d7f-a3bb-648f03fc8124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:37:43 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a1de31-d51d-45f2-98d6-ba0d4f5a284e]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:37:43 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-73ef89b7-fda1-412e-9a3e-44a20bfb614e tempest-SnapshotsActionsTest-1764320913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.9e3ea175-4872-4a3f-8afe-c8e6c5880cda {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:43 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-2aeafb2a-61b6-4d16-8ff3-6ddec5fcd149 tempest-VolumesDeleteCascade-280764445 None] Volume volume-ca3e22a5-7f24-492d-9a29-8f9e8f17d494 (ca3e22a5-7f24-492d-9a29-8f9e8f17d494): created successfully Sep 18 21:37:43 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2aeafb2a-61b6-4d16-8ff3-6ddec5fcd149 tempest-VolumesDeleteCascade-280764445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8987b5e-3e2b-4d7f-a3bb-648f03fc8124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:37:43 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2aeafb2a-61b6-4d16-8ff3-6ddec5fcd149 tempest-VolumesDeleteCascade-280764445 None] Flow 'volume_create_manager' (65379e77-a0f5-46d5-9383-6bfb92b4e646) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:37:43 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-2aeafb2a-61b6-4d16-8ff3-6ddec5fcd149 tempest-VolumesDeleteCascade-280764445 None] Created volume successfully. Sep 18 21:37:43 devstack sudo[92920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.9e3ea175-4872-4a3f-8afe-c8e6c5880cda Sep 18 21:37:43 devstack sudo[92920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:43 devstack sudo[92920]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:43 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-73ef89b7-fda1-412e-9a3e-44a20bfb614e tempest-SnapshotsActionsTest-1764320913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.9e3ea175-4872-4a3f-8afe-c8e6c5880cda" returned: 0 in 0.428s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:43 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-73ef89b7-fda1-412e-9a3e-44a20bfb614e tempest-SnapshotsActionsTest-1764320913 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2fe786d8-f74b-478c-b68b-a5f952400424(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86136) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 21:37:43 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-73ef89b7-fda1-412e-9a3e-44a20bfb614e tempest-SnapshotsActionsTest-1764320913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.9e3ea175-4872-4a3f-8afe-c8e6c5880cda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.6353c448-a98a-421c-90b4-3b11f1ec58e4 1G {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:43 devstack sudo[92925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.9e3ea175-4872-4a3f-8afe-c8e6c5880cda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.6353c448-a98a-421c-90b4-3b11f1ec58e4 1G Sep 18 21:37:43 devstack sudo[92925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:43 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-3a9fc15e-bed0-44ba-b183-617133568d5a tempest-VolumesDeleteCascade-280764445 None] Acquiring lock "cinder-27275b58-b9e7-4308-8cd2-ca2f3517fcef-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:37:43 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-3a9fc15e-bed0-44ba-b183-617133568d5a tempest-VolumesDeleteCascade-280764445 None] Lock "cinder-27275b58-b9e7-4308-8cd2-ca2f3517fcef-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:37:43 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-3a9fc15e-bed0-44ba-b183-617133568d5a tempest-VolumesDeleteCascade-280764445 None] Performing cascade delete. {{(pid=86136) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 18 21:37:43 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-3a9fc15e-bed0-44ba-b183-617133568d5a tempest-VolumesDeleteCascade-280764445 None] Acquiring lock "cinder-c8c47efb-6ae4-4e19-82fc-9b10eca05718-delete_snapshot" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:37:43 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-3a9fc15e-bed0-44ba-b183-617133568d5a tempest-VolumesDeleteCascade-280764445 None] Lock "cinder-c8c47efb-6ae4-4e19-82fc-9b10eca05718-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:37:43 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-3a9fc15e-bed0-44ba-b183-617133568d5a tempest-VolumesDeleteCascade-280764445 None] Acquiring lock "cinder-quobyte-27275b58-b9e7-4308-8cd2-ca2f3517fcef" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:37:43 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-3a9fc15e-bed0-44ba-b183-617133568d5a tempest-VolumesDeleteCascade-280764445 None] Lock "cinder-quobyte-27275b58-b9e7-4308-8cd2-ca2f3517fcef" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:37:43 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-3a9fc15e-bed0-44ba-b183-617133568d5a tempest-VolumesDeleteCascade-280764445 None] Acquiring lock "cinder-quobyte-c8c47efb-6ae4-4e19-82fc-9b10eca05718" by "_delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:37:43 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-3a9fc15e-bed0-44ba-b183-617133568d5a tempest-VolumesDeleteCascade-280764445 None] Lock "cinder-quobyte-c8c47efb-6ae4-4e19-82fc-9b10eca05718" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:37:43 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-3a9fc15e-bed0-44ba-b183-617133568d5a tempest-VolumesDeleteCascade-280764445 None] Deleting offline snapshot c8c47efb-6ae4-4e19-82fc-9b10eca05718 of volume 27275b58-b9e7-4308-8cd2-ca2f3517fcef {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 21:37:43 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-3a9fc15e-bed0-44ba-b183-617133568d5a tempest-VolumesDeleteCascade-280764445 None] snapshot_file for this snap is: volume-27275b58-b9e7-4308-8cd2-ca2f3517fcef.c8c47efb-6ae4-4e19-82fc-9b10eca05718 {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 21:37:43 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ec6975-9165-4c81-b011-2f9d012f31df]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:37:43 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3a9fc15e-bed0-44ba-b183-617133568d5a tempest-VolumesDeleteCascade-280764445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-27275b58-b9e7-4308-8cd2-ca2f3517fcef.c8c47efb-6ae4-4e19-82fc-9b10eca05718 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:43 devstack sudo[92930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-27275b58-b9e7-4308-8cd2-ca2f3517fcef.c8c47efb-6ae4-4e19-82fc-9b10eca05718 Sep 18 21:37:43 devstack sudo[92930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:44 devstack sudo[92925]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:44 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-73ef89b7-fda1-412e-9a3e-44a20bfb614e tempest-SnapshotsActionsTest-1764320913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.9e3ea175-4872-4a3f-8afe-c8e6c5880cda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.6353c448-a98a-421c-90b4-3b11f1ec58e4 1G" returned: 0 in 0.542s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:44 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-73ef89b7-fda1-412e-9a3e-44a20bfb614e tempest-SnapshotsActionsTest-1764320913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fe786d8-f74b-478c-b68b-a5f952400424.9e3ea175-4872-4a3f-8afe-c8e6c5880cda -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.6353c448-a98a-421c-90b4-3b11f1ec58e4 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:44 devstack sudo[92933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fe786d8-f74b-478c-b68b-a5f952400424.9e3ea175-4872-4a3f-8afe-c8e6c5880cda -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.6353c448-a98a-421c-90b4-3b11f1ec58e4 Sep 18 21:37:44 devstack sudo[92933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:44 devstack sudo[92930]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:44 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3a9fc15e-bed0-44ba-b183-617133568d5a tempest-VolumesDeleteCascade-280764445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-27275b58-b9e7-4308-8cd2-ca2f3517fcef.c8c47efb-6ae4-4e19-82fc-9b10eca05718" returned: 0 in 0.459s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:44 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-3a9fc15e-bed0-44ba-b183-617133568d5a tempest-VolumesDeleteCascade-280764445 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27275b58-b9e7-4308-8cd2-ca2f3517fcef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86136) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 21:37:44 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[eecf7662-4014-4ca6-8b82-6f346064b117]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:37:44 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3a9fc15e-bed0-44ba-b183-617133568d5a tempest-VolumesDeleteCascade-280764445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-27275b58-b9e7-4308-8cd2-ca2f3517fcef {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:44 devstack sudo[92933]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:44 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-73ef89b7-fda1-412e-9a3e-44a20bfb614e tempest-SnapshotsActionsTest-1764320913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fe786d8-f74b-478c-b68b-a5f952400424.9e3ea175-4872-4a3f-8afe-c8e6c5880cda -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.6353c448-a98a-421c-90b4-3b11f1ec58e4" returned: 0 in 0.354s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:44 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-73ef89b7-fda1-412e-9a3e-44a20bfb614e tempest-SnapshotsActionsTest-1764320913 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.6353c448-a98a-421c-90b4-3b11f1ec58e4 is being set with open permissions: ugo+rw Sep 18 21:37:44 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-73ef89b7-fda1-412e-9a3e-44a20bfb614e tempest-SnapshotsActionsTest-1764320913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.6353c448-a98a-421c-90b4-3b11f1ec58e4 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:44 devstack sudo[92941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-27275b58-b9e7-4308-8cd2-ca2f3517fcef Sep 18 21:37:44 devstack sudo[92941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:44 devstack sudo[92944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.6353c448-a98a-421c-90b4-3b11f1ec58e4 Sep 18 21:37:44 devstack sudo[92944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:44 devstack sudo[92944]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:44 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-73ef89b7-fda1-412e-9a3e-44a20bfb614e tempest-SnapshotsActionsTest-1764320913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.6353c448-a98a-421c-90b4-3b11f1ec58e4" returned: 0 in 0.250s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:44 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-73ef89b7-fda1-412e-9a3e-44a20bfb614e tempest-SnapshotsActionsTest-1764320913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.711s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:37:44 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-73ef89b7-fda1-412e-9a3e-44a20bfb614e tempest-SnapshotsActionsTest-1764320913 None] Create snapshot completed successfully Sep 18 21:37:44 devstack sudo[92941]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:44 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3a9fc15e-bed0-44ba-b183-617133568d5a tempest-VolumesDeleteCascade-280764445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-27275b58-b9e7-4308-8cd2-ca2f3517fcef" returned: 0 in 0.574s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:44 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3a9fc15e-bed0-44ba-b183-617133568d5a tempest-VolumesDeleteCascade-280764445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-27275b58-b9e7-4308-8cd2-ca2f3517fcef.c8c47efb-6ae4-4e19-82fc-9b10eca05718 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:44 devstack sudo[92951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-27275b58-b9e7-4308-8cd2-ca2f3517fcef.c8c47efb-6ae4-4e19-82fc-9b10eca05718 Sep 18 21:37:44 devstack sudo[92951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:45 devstack sudo[92951]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:45 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3a9fc15e-bed0-44ba-b183-617133568d5a tempest-VolumesDeleteCascade-280764445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-27275b58-b9e7-4308-8cd2-ca2f3517fcef.c8c47efb-6ae4-4e19-82fc-9b10eca05718" returned: 0 in 0.424s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:45 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3a9fc15e-bed0-44ba-b183-617133568d5a tempest-VolumesDeleteCascade-280764445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-27275b58-b9e7-4308-8cd2-ca2f3517fcef.c8c47efb-6ae4-4e19-82fc-9b10eca05718 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:45 devstack sudo[92957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-27275b58-b9e7-4308-8cd2-ca2f3517fcef.c8c47efb-6ae4-4e19-82fc-9b10eca05718 Sep 18 21:37:45 devstack sudo[92957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:45 devstack sudo[92957]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:45 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3a9fc15e-bed0-44ba-b183-617133568d5a tempest-VolumesDeleteCascade-280764445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-27275b58-b9e7-4308-8cd2-ca2f3517fcef.c8c47efb-6ae4-4e19-82fc-9b10eca05718" returned: 0 in 0.285s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:45 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-3a9fc15e-bed0-44ba-b183-617133568d5a tempest-VolumesDeleteCascade-280764445 None] Lock "cinder-quobyte-c8c47efb-6ae4-4e19-82fc-9b10eca05718" released by "_delete_snapshot" :: held 1.859s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:37:45 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-3a9fc15e-bed0-44ba-b183-617133568d5a tempest-VolumesDeleteCascade-280764445 None] Lock "cinder-quobyte-27275b58-b9e7-4308-8cd2-ca2f3517fcef" released by "delete_snapshot" :: held 1.880s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:37:45 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-3a9fc15e-bed0-44ba-b183-617133568d5a tempest-VolumesDeleteCascade-280764445 None] Created reservations ['aa953d69-5af8-419c-8904-f4d362e38007', 'f3fd9ccc-1733-4592-ade7-f21411988336', '1d9bb961-aa94-4306-8d16-49f09007a065', 'd7ec48d1-e675-47b8-90d0-617ea7e6bc8a'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:37:45 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-3a9fc15e-bed0-44ba-b183-617133568d5a tempest-VolumesDeleteCascade-280764445 None] Delete snapshot completed successfully. Sep 18 21:37:45 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-3a9fc15e-bed0-44ba-b183-617133568d5a tempest-VolumesDeleteCascade-280764445 None] Lock "cinder-c8c47efb-6ae4-4e19-82fc-9b10eca05718-delete_snapshot" released by "delete_snapshot" :: held 2.059s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:37:45 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-3a9fc15e-bed0-44ba-b183-617133568d5a tempest-VolumesDeleteCascade-280764445 None] Snapshots deleted, issuing volume delete {{(pid=86136) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 18 21:37:45 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-3a9fc15e-bed0-44ba-b183-617133568d5a tempest-VolumesDeleteCascade-280764445 None] Acquiring lock "cinder-quobyte-27275b58-b9e7-4308-8cd2-ca2f3517fcef" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:37:45 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-3a9fc15e-bed0-44ba-b183-617133568d5a tempest-VolumesDeleteCascade-280764445 None] Lock "cinder-quobyte-27275b58-b9e7-4308-8cd2-ca2f3517fcef" acquired by "delete_volume" :: waited 0.020s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:37:45 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[7faaa8b9-f413-4cc7-9051-f61b39882bd9]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:37:45 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3a9fc15e-bed0-44ba-b183-617133568d5a tempest-VolumesDeleteCascade-280764445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-27275b58-b9e7-4308-8cd2-ca2f3517fcef {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:45 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-9fddd16f-fdf3-45ab-a7d5-351344265ab9 tempest-SnapshotsActionsTest-1376928580 None] Acquiring lock "cinder-6353c448-a98a-421c-90b4-3b11f1ec58e4-delete_snapshot" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:37:46 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-9fddd16f-fdf3-45ab-a7d5-351344265ab9 tempest-SnapshotsActionsTest-1376928580 None] Lock "cinder-6353c448-a98a-421c-90b4-3b11f1ec58e4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:37:46 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-9fddd16f-fdf3-45ab-a7d5-351344265ab9 tempest-SnapshotsActionsTest-1376928580 None] Acquiring lock "cinder-quobyte-2fe786d8-f74b-478c-b68b-a5f952400424" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:37:46 devstack sudo[92960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-27275b58-b9e7-4308-8cd2-ca2f3517fcef Sep 18 21:37:46 devstack sudo[92960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:46 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-9fddd16f-fdf3-45ab-a7d5-351344265ab9 tempest-SnapshotsActionsTest-1376928580 None] Lock "cinder-quobyte-2fe786d8-f74b-478c-b68b-a5f952400424" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:37:46 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-9fddd16f-fdf3-45ab-a7d5-351344265ab9 tempest-SnapshotsActionsTest-1376928580 None] Acquiring lock "cinder-quobyte-6353c448-a98a-421c-90b4-3b11f1ec58e4" by "_delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:37:46 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-9fddd16f-fdf3-45ab-a7d5-351344265ab9 tempest-SnapshotsActionsTest-1376928580 None] Lock "cinder-quobyte-6353c448-a98a-421c-90b4-3b11f1ec58e4" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:37:46 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-9fddd16f-fdf3-45ab-a7d5-351344265ab9 tempest-SnapshotsActionsTest-1376928580 None] Deleting offline snapshot 6353c448-a98a-421c-90b4-3b11f1ec58e4 of volume 2fe786d8-f74b-478c-b68b-a5f952400424 {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 21:37:46 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-9fddd16f-fdf3-45ab-a7d5-351344265ab9 tempest-SnapshotsActionsTest-1376928580 None] snapshot_file for this snap is: volume-2fe786d8-f74b-478c-b68b-a5f952400424.6353c448-a98a-421c-90b4-3b11f1ec58e4 {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 21:37:46 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8489ff1-e753-42d2-86d0-4a2367b73d3f]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:37:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9fddd16f-fdf3-45ab-a7d5-351344265ab9 tempest-SnapshotsActionsTest-1376928580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.6353c448-a98a-421c-90b4-3b11f1ec58e4 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:46 devstack sudo[92962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.6353c448-a98a-421c-90b4-3b11f1ec58e4 Sep 18 21:37:46 devstack sudo[92962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:46 devstack sudo[92960]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3a9fc15e-bed0-44ba-b183-617133568d5a tempest-VolumesDeleteCascade-280764445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-27275b58-b9e7-4308-8cd2-ca2f3517fcef" returned: 0 in 0.563s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3a9fc15e-bed0-44ba-b183-617133568d5a tempest-VolumesDeleteCascade-280764445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-27275b58-b9e7-4308-8cd2-ca2f3517fcef {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:46 devstack sudo[92967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-27275b58-b9e7-4308-8cd2-ca2f3517fcef Sep 18 21:37:46 devstack sudo[92967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:46 devstack sudo[92962]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9fddd16f-fdf3-45ab-a7d5-351344265ab9 tempest-SnapshotsActionsTest-1376928580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.6353c448-a98a-421c-90b4-3b11f1ec58e4" returned: 0 in 0.511s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:46 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-9fddd16f-fdf3-45ab-a7d5-351344265ab9 tempest-SnapshotsActionsTest-1376928580 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2fe786d8-f74b-478c-b68b-a5f952400424(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86136) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 21:37:46 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[db463f70-1213-4a3b-a435-599d94c13768]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:37:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9fddd16f-fdf3-45ab-a7d5-351344265ab9 tempest-SnapshotsActionsTest-1376928580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.9e3ea175-4872-4a3f-8afe-c8e6c5880cda {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:46 devstack sudo[92967]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3a9fc15e-bed0-44ba-b183-617133568d5a tempest-VolumesDeleteCascade-280764445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-27275b58-b9e7-4308-8cd2-ca2f3517fcef" returned: 0 in 0.292s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:46 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-3a9fc15e-bed0-44ba-b183-617133568d5a tempest-VolumesDeleteCascade-280764445 None] Lock "cinder-quobyte-27275b58-b9e7-4308-8cd2-ca2f3517fcef" released by "delete_volume" :: held 0.971s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:37:46 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-3a9fc15e-bed0-44ba-b183-617133568d5a tempest-VolumesDeleteCascade-280764445 None] Created reservations ['798c4b64-4b44-4cd6-bca1-9d77c72ec8c7', '2680f602-e85f-485a-b3c4-546cf1c235d3', '40618bd4-673f-4d08-9069-8e164d15e816', '98b2dc23-c511-4ae1-96fd-776deb07af93'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:37:46 devstack sudo[92973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.9e3ea175-4872-4a3f-8afe-c8e6c5880cda Sep 18 21:37:46 devstack sudo[92973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-3a9fc15e-bed0-44ba-b183-617133568d5a tempest-VolumesDeleteCascade-280764445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:37:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-3a9fc15e-bed0-44ba-b183-617133568d5a tempest-VolumesDeleteCascade-280764445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:37:46 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-3a9fc15e-bed0-44ba-b183-617133568d5a tempest-VolumesDeleteCascade-280764445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:37:46 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-3a9fc15e-bed0-44ba-b183-617133568d5a tempest-VolumesDeleteCascade-280764445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:37:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-3a9fc15e-bed0-44ba-b183-617133568d5a tempest-VolumesDeleteCascade-280764445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:37:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3a9fc15e-bed0-44ba-b183-617133568d5a tempest-VolumesDeleteCascade-280764445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:46 devstack sudo[92978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:37:46 devstack sudo[92978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:47 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-c79063be-51c7-4466-9fb5-6b488991a182 tempest-VolumesDeleteCascade-280764445 None] Acquiring lock "cinder-ca3e22a5-7f24-492d-9a29-8f9e8f17d494-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:37:47 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-c79063be-51c7-4466-9fb5-6b488991a182 tempest-VolumesDeleteCascade-280764445 None] Lock "cinder-ca3e22a5-7f24-492d-9a29-8f9e8f17d494-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:37:47 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-c79063be-51c7-4466-9fb5-6b488991a182 tempest-VolumesDeleteCascade-280764445 None] Acquiring lock "cinder-quobyte-ca3e22a5-7f24-492d-9a29-8f9e8f17d494" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:37:47 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-c79063be-51c7-4466-9fb5-6b488991a182 tempest-VolumesDeleteCascade-280764445 None] Lock "cinder-quobyte-ca3e22a5-7f24-492d-9a29-8f9e8f17d494" acquired by "delete_volume" :: waited 0.032s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:37:47 devstack sudo[92973]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:47 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9fddd16f-fdf3-45ab-a7d5-351344265ab9 tempest-SnapshotsActionsTest-1376928580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.9e3ea175-4872-4a3f-8afe-c8e6c5880cda" returned: 0 in 0.634s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:47 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-9fddd16f-fdf3-45ab-a7d5-351344265ab9 tempest-SnapshotsActionsTest-1376928580 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2fe786d8-f74b-478c-b68b-a5f952400424(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86136) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 21:37:47 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9fddd16f-fdf3-45ab-a7d5-351344265ab9 tempest-SnapshotsActionsTest-1376928580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.6353c448-a98a-421c-90b4-3b11f1ec58e4 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:47 devstack sudo[92978]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:47 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3a9fc15e-bed0-44ba-b183-617133568d5a tempest-VolumesDeleteCascade-280764445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.441s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:47 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-3a9fc15e-bed0-44ba-b183-617133568d5a tempest-VolumesDeleteCascade-280764445 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:37:47 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-3a9fc15e-bed0-44ba-b183-617133568d5a tempest-VolumesDeleteCascade-280764445 None] Deleted volume successfully. Sep 18 21:37:47 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[70dd5539-49c8-44d6-9ef0-2830b2f11ada]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:37:47 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c79063be-51c7-4466-9fb5-6b488991a182 tempest-VolumesDeleteCascade-280764445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ca3e22a5-7f24-492d-9a29-8f9e8f17d494 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:47 devstack sudo[92984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.6353c448-a98a-421c-90b4-3b11f1ec58e4 Sep 18 21:37:47 devstack sudo[92984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:47 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-3a9fc15e-bed0-44ba-b183-617133568d5a tempest-VolumesDeleteCascade-280764445 None] Lock "cinder-27275b58-b9e7-4308-8cd2-ca2f3517fcef-delete_volume" released by "delete_volume" :: held 3.818s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:37:47 devstack sudo[92986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ca3e22a5-7f24-492d-9a29-8f9e8f17d494 Sep 18 21:37:47 devstack sudo[92986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:47 devstack sudo[92986]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:47 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c79063be-51c7-4466-9fb5-6b488991a182 tempest-VolumesDeleteCascade-280764445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ca3e22a5-7f24-492d-9a29-8f9e8f17d494" returned: 0 in 0.599s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:47 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c79063be-51c7-4466-9fb5-6b488991a182 tempest-VolumesDeleteCascade-280764445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ca3e22a5-7f24-492d-9a29-8f9e8f17d494 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:47 devstack sudo[92984]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:47 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9fddd16f-fdf3-45ab-a7d5-351344265ab9 tempest-SnapshotsActionsTest-1376928580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.6353c448-a98a-421c-90b4-3b11f1ec58e4" returned: 0 in 0.666s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:47 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9fddd16f-fdf3-45ab-a7d5-351344265ab9 tempest-SnapshotsActionsTest-1376928580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.6353c448-a98a-421c-90b4-3b11f1ec58e4 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:48 devstack sudo[93002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ca3e22a5-7f24-492d-9a29-8f9e8f17d494 Sep 18 21:37:48 devstack sudo[93002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:48 devstack sudo[93004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.6353c448-a98a-421c-90b4-3b11f1ec58e4 Sep 18 21:37:48 devstack sudo[93004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:48 devstack sudo[93004]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:48 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9fddd16f-fdf3-45ab-a7d5-351344265ab9 tempest-SnapshotsActionsTest-1376928580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.6353c448-a98a-421c-90b4-3b11f1ec58e4" returned: 0 in 0.494s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:48 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c79063be-51c7-4466-9fb5-6b488991a182 tempest-VolumesDeleteCascade-280764445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ca3e22a5-7f24-492d-9a29-8f9e8f17d494" returned: 0 in 0.581s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:48 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-9fddd16f-fdf3-45ab-a7d5-351344265ab9 tempest-SnapshotsActionsTest-1376928580 None] Lock "cinder-quobyte-6353c448-a98a-421c-90b4-3b11f1ec58e4" released by "_delete_snapshot" :: held 2.484s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:37:48 devstack sudo[93002]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:48 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-c79063be-51c7-4466-9fb5-6b488991a182 tempest-VolumesDeleteCascade-280764445 None] Lock "cinder-quobyte-ca3e22a5-7f24-492d-9a29-8f9e8f17d494" released by "delete_volume" :: held 1.271s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:37:48 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-9fddd16f-fdf3-45ab-a7d5-351344265ab9 tempest-SnapshotsActionsTest-1376928580 None] Lock "cinder-quobyte-2fe786d8-f74b-478c-b68b-a5f952400424" released by "delete_snapshot" :: held 2.531s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:37:48 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-c79063be-51c7-4466-9fb5-6b488991a182 tempest-VolumesDeleteCascade-280764445 None] Created reservations ['a66bdcf0-5000-4245-8af5-d0c930a76732', 'd655135e-77b9-4e43-93e9-e6857a869370', 'd7144058-5076-4fdf-8be7-ed15a23b4129', 'e00ddc62-d628-4825-9c5b-fb9701c82aa0'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:37:48 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-9fddd16f-fdf3-45ab-a7d5-351344265ab9 tempest-SnapshotsActionsTest-1376928580 None] Created reservations ['499f7e68-a851-47a0-843e-6f6010903280', '2468c965-d88f-4ca1-a3e9-44e4b7391b89', '65484b6f-6cc5-48ca-b5c1-5e1dc22d1918', '724daa55-90b5-40d4-8c9e-dfa3a8e13dbf'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:37:48 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-9fddd16f-fdf3-45ab-a7d5-351344265ab9 tempest-SnapshotsActionsTest-1376928580 None] Delete snapshot completed successfully. Sep 18 21:37:48 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-9fddd16f-fdf3-45ab-a7d5-351344265ab9 tempest-SnapshotsActionsTest-1376928580 None] Lock "cinder-6353c448-a98a-421c-90b4-3b11f1ec58e4-delete_snapshot" released by "delete_snapshot" :: held 2.779s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:37:48 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c79063be-51c7-4466-9fb5-6b488991a182 tempest-VolumesDeleteCascade-280764445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:37:48 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c79063be-51c7-4466-9fb5-6b488991a182 tempest-VolumesDeleteCascade-280764445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:37:48 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-c79063be-51c7-4466-9fb5-6b488991a182 tempest-VolumesDeleteCascade-280764445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:37:48 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-c79063be-51c7-4466-9fb5-6b488991a182 tempest-VolumesDeleteCascade-280764445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:37:48 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c79063be-51c7-4466-9fb5-6b488991a182 tempest-VolumesDeleteCascade-280764445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:37:48 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c79063be-51c7-4466-9fb5-6b488991a182 tempest-VolumesDeleteCascade-280764445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:48 devstack sudo[93027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:37:48 devstack sudo[93027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:49 devstack sudo[93027]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:49 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c79063be-51c7-4466-9fb5-6b488991a182 tempest-VolumesDeleteCascade-280764445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.308s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:49 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-c79063be-51c7-4466-9fb5-6b488991a182 tempest-VolumesDeleteCascade-280764445 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:37:49 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-c79063be-51c7-4466-9fb5-6b488991a182 tempest-VolumesDeleteCascade-280764445 None] Deleted volume successfully. Sep 18 21:37:49 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-c79063be-51c7-4466-9fb5-6b488991a182 tempest-VolumesDeleteCascade-280764445 None] Lock "cinder-ca3e22a5-7f24-492d-9a29-8f9e8f17d494-delete_volume" released by "delete_volume" :: held 1.992s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:37:49 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6abae21b-7ff5-4556-9ee9-796c0d7575e0 tempest-SnapshotsActionsTest-1764320913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:37:49 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6abae21b-7ff5-4556-9ee9-796c0d7575e0 tempest-SnapshotsActionsTest-1764320913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:37:49 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-6abae21b-7ff5-4556-9ee9-796c0d7575e0 tempest-SnapshotsActionsTest-1764320913 None] Creating offline snapshot d16c661d-5258-4265-af24-4321da750ae5 of volume 2fe786d8-f74b-478c-b68b-a5f952400424 {{(pid=86136) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 21:37:49 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[54156b20-8106-4095-adca-2b6c7d90ce48]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:37:49 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6abae21b-7ff5-4556-9ee9-796c0d7575e0 tempest-SnapshotsActionsTest-1764320913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.9e3ea175-4872-4a3f-8afe-c8e6c5880cda {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:50 devstack sudo[93035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.9e3ea175-4872-4a3f-8afe-c8e6c5880cda Sep 18 21:37:50 devstack sudo[93035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:50 devstack sudo[93035]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:50 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6abae21b-7ff5-4556-9ee9-796c0d7575e0 tempest-SnapshotsActionsTest-1764320913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.9e3ea175-4872-4a3f-8afe-c8e6c5880cda" returned: 0 in 0.476s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:50 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-6abae21b-7ff5-4556-9ee9-796c0d7575e0 tempest-SnapshotsActionsTest-1764320913 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2fe786d8-f74b-478c-b68b-a5f952400424(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86136) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 21:37:50 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6abae21b-7ff5-4556-9ee9-796c0d7575e0 tempest-SnapshotsActionsTest-1764320913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.9e3ea175-4872-4a3f-8afe-c8e6c5880cda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.d16c661d-5258-4265-af24-4321da750ae5 1G {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:50 devstack sudo[93042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.9e3ea175-4872-4a3f-8afe-c8e6c5880cda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.d16c661d-5258-4265-af24-4321da750ae5 1G Sep 18 21:37:50 devstack sudo[93042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:50 devstack sudo[93042]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:50 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6abae21b-7ff5-4556-9ee9-796c0d7575e0 tempest-SnapshotsActionsTest-1764320913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.9e3ea175-4872-4a3f-8afe-c8e6c5880cda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.d16c661d-5258-4265-af24-4321da750ae5 1G" returned: 0 in 0.571s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:50 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6abae21b-7ff5-4556-9ee9-796c0d7575e0 tempest-SnapshotsActionsTest-1764320913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fe786d8-f74b-478c-b68b-a5f952400424.9e3ea175-4872-4a3f-8afe-c8e6c5880cda -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.d16c661d-5258-4265-af24-4321da750ae5 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:51 devstack sudo[93048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fe786d8-f74b-478c-b68b-a5f952400424.9e3ea175-4872-4a3f-8afe-c8e6c5880cda -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.d16c661d-5258-4265-af24-4321da750ae5 Sep 18 21:37:51 devstack sudo[93048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:51 devstack sudo[93048]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:51 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6abae21b-7ff5-4556-9ee9-796c0d7575e0 tempest-SnapshotsActionsTest-1764320913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fe786d8-f74b-478c-b68b-a5f952400424.9e3ea175-4872-4a3f-8afe-c8e6c5880cda -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.d16c661d-5258-4265-af24-4321da750ae5" returned: 0 in 0.402s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:51 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-6abae21b-7ff5-4556-9ee9-796c0d7575e0 tempest-SnapshotsActionsTest-1764320913 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.d16c661d-5258-4265-af24-4321da750ae5 is being set with open permissions: ugo+rw Sep 18 21:37:51 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6abae21b-7ff5-4556-9ee9-796c0d7575e0 tempest-SnapshotsActionsTest-1764320913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.d16c661d-5258-4265-af24-4321da750ae5 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:51 devstack sudo[93053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.d16c661d-5258-4265-af24-4321da750ae5 Sep 18 21:37:51 devstack sudo[93053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:51 devstack sudo[93053]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:51 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6abae21b-7ff5-4556-9ee9-796c0d7575e0 tempest-SnapshotsActionsTest-1764320913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.d16c661d-5258-4265-af24-4321da750ae5" returned: 0 in 0.274s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:51 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6abae21b-7ff5-4556-9ee9-796c0d7575e0 tempest-SnapshotsActionsTest-1764320913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.928s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:37:51 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-6abae21b-7ff5-4556-9ee9-796c0d7575e0 tempest-SnapshotsActionsTest-1764320913 None] Create snapshot completed successfully Sep 18 21:37:52 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-70eb7b8d-5c18-482a-9ace-05f15d16e436 tempest-SnapshotsActionsTest-1376928580 None] Acquiring lock "cinder-d16c661d-5258-4265-af24-4321da750ae5-delete_snapshot" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:37:52 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-70eb7b8d-5c18-482a-9ace-05f15d16e436 tempest-SnapshotsActionsTest-1376928580 None] Lock "cinder-d16c661d-5258-4265-af24-4321da750ae5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:37:52 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-70eb7b8d-5c18-482a-9ace-05f15d16e436 tempest-SnapshotsActionsTest-1376928580 None] Acquiring lock "cinder-quobyte-2fe786d8-f74b-478c-b68b-a5f952400424" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:37:52 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-70eb7b8d-5c18-482a-9ace-05f15d16e436 tempest-SnapshotsActionsTest-1376928580 None] Lock "cinder-quobyte-2fe786d8-f74b-478c-b68b-a5f952400424" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:37:52 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-70eb7b8d-5c18-482a-9ace-05f15d16e436 tempest-SnapshotsActionsTest-1376928580 None] Acquiring lock "cinder-quobyte-d16c661d-5258-4265-af24-4321da750ae5" by "_delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:37:52 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-70eb7b8d-5c18-482a-9ace-05f15d16e436 tempest-SnapshotsActionsTest-1376928580 None] Lock "cinder-quobyte-d16c661d-5258-4265-af24-4321da750ae5" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:37:52 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-70eb7b8d-5c18-482a-9ace-05f15d16e436 tempest-SnapshotsActionsTest-1376928580 None] Deleting offline snapshot d16c661d-5258-4265-af24-4321da750ae5 of volume 2fe786d8-f74b-478c-b68b-a5f952400424 {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 21:37:52 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-70eb7b8d-5c18-482a-9ace-05f15d16e436 tempest-SnapshotsActionsTest-1376928580 None] snapshot_file for this snap is: volume-2fe786d8-f74b-478c-b68b-a5f952400424.d16c661d-5258-4265-af24-4321da750ae5 {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 21:37:52 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee7f1781-267c-4862-8f8e-9d3e05d72193]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:37:52 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-70eb7b8d-5c18-482a-9ace-05f15d16e436 tempest-SnapshotsActionsTest-1376928580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.d16c661d-5258-4265-af24-4321da750ae5 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:52 devstack sudo[93056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.d16c661d-5258-4265-af24-4321da750ae5 Sep 18 21:37:52 devstack sudo[93056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:52 devstack sudo[93056]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:52 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-70eb7b8d-5c18-482a-9ace-05f15d16e436 tempest-SnapshotsActionsTest-1376928580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.d16c661d-5258-4265-af24-4321da750ae5" returned: 0 in 0.588s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:52 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-70eb7b8d-5c18-482a-9ace-05f15d16e436 tempest-SnapshotsActionsTest-1376928580 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2fe786d8-f74b-478c-b68b-a5f952400424(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86136) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 21:37:52 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[de56e655-0595-49b5-972f-0dca64b7b114]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:37:52 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-70eb7b8d-5c18-482a-9ace-05f15d16e436 tempest-SnapshotsActionsTest-1376928580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.9e3ea175-4872-4a3f-8afe-c8e6c5880cda {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:53 devstack sudo[93063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.9e3ea175-4872-4a3f-8afe-c8e6c5880cda Sep 18 21:37:53 devstack sudo[93063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:53 devstack sudo[93063]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:53 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-70eb7b8d-5c18-482a-9ace-05f15d16e436 tempest-SnapshotsActionsTest-1376928580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.9e3ea175-4872-4a3f-8afe-c8e6c5880cda" returned: 0 in 0.543s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:53 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-70eb7b8d-5c18-482a-9ace-05f15d16e436 tempest-SnapshotsActionsTest-1376928580 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2fe786d8-f74b-478c-b68b-a5f952400424(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86136) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 21:37:53 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-70eb7b8d-5c18-482a-9ace-05f15d16e436 tempest-SnapshotsActionsTest-1376928580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.d16c661d-5258-4265-af24-4321da750ae5 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:53 devstack sudo[93068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.d16c661d-5258-4265-af24-4321da750ae5 Sep 18 21:37:53 devstack sudo[93068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:53 devstack sudo[93068]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:53 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-70eb7b8d-5c18-482a-9ace-05f15d16e436 tempest-SnapshotsActionsTest-1376928580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.d16c661d-5258-4265-af24-4321da750ae5" returned: 0 in 0.520s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:53 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-70eb7b8d-5c18-482a-9ace-05f15d16e436 tempest-SnapshotsActionsTest-1376928580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.d16c661d-5258-4265-af24-4321da750ae5 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:53 devstack sudo[93073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.d16c661d-5258-4265-af24-4321da750ae5 Sep 18 21:37:53 devstack sudo[93073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:54 devstack sudo[93073]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:54 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-70eb7b8d-5c18-482a-9ace-05f15d16e436 tempest-SnapshotsActionsTest-1376928580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.d16c661d-5258-4265-af24-4321da750ae5" returned: 0 in 0.321s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:54 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-70eb7b8d-5c18-482a-9ace-05f15d16e436 tempest-SnapshotsActionsTest-1376928580 None] Lock "cinder-quobyte-d16c661d-5258-4265-af24-4321da750ae5" released by "_delete_snapshot" :: held 2.139s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:37:54 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-70eb7b8d-5c18-482a-9ace-05f15d16e436 tempest-SnapshotsActionsTest-1376928580 None] Lock "cinder-quobyte-2fe786d8-f74b-478c-b68b-a5f952400424" released by "delete_snapshot" :: held 2.185s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:37:54 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-70eb7b8d-5c18-482a-9ace-05f15d16e436 tempest-SnapshotsActionsTest-1376928580 None] Created reservations ['ef0a7678-bdfe-470a-8df2-12c294905b3d', '58229b88-c9f7-43f4-b925-65d48dd6ff8f', 'eb2b5b05-54ae-4588-a8f0-ecb73fde38bd', '221cd755-8bd1-419f-841d-298640dec609'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:37:54 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-70eb7b8d-5c18-482a-9ace-05f15d16e436 tempest-SnapshotsActionsTest-1376928580 None] Delete snapshot completed successfully. Sep 18 21:37:54 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-70eb7b8d-5c18-482a-9ace-05f15d16e436 tempest-SnapshotsActionsTest-1376928580 None] Lock "cinder-d16c661d-5258-4265-af24-4321da750ae5-delete_snapshot" released by "delete_snapshot" :: held 2.391s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:37:55 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-3ec2d18d-5539-45eb-a557-1f95589734be tempest-SnapshotsActionsTest-1764320913 None] Acquiring lock "cinder-9e3ea175-4872-4a3f-8afe-c8e6c5880cda-delete_snapshot" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:37:55 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-3ec2d18d-5539-45eb-a557-1f95589734be tempest-SnapshotsActionsTest-1764320913 None] Lock "cinder-9e3ea175-4872-4a3f-8afe-c8e6c5880cda-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:37:55 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-3ec2d18d-5539-45eb-a557-1f95589734be tempest-SnapshotsActionsTest-1764320913 None] Acquiring lock "cinder-quobyte-2fe786d8-f74b-478c-b68b-a5f952400424" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:37:55 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-3ec2d18d-5539-45eb-a557-1f95589734be tempest-SnapshotsActionsTest-1764320913 None] Lock "cinder-quobyte-2fe786d8-f74b-478c-b68b-a5f952400424" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:37:55 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-3ec2d18d-5539-45eb-a557-1f95589734be tempest-SnapshotsActionsTest-1764320913 None] Acquiring lock "cinder-quobyte-9e3ea175-4872-4a3f-8afe-c8e6c5880cda" by "_delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:37:55 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-3ec2d18d-5539-45eb-a557-1f95589734be tempest-SnapshotsActionsTest-1764320913 None] Lock "cinder-quobyte-9e3ea175-4872-4a3f-8afe-c8e6c5880cda" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:37:55 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-3ec2d18d-5539-45eb-a557-1f95589734be tempest-SnapshotsActionsTest-1764320913 None] Deleting offline snapshot 9e3ea175-4872-4a3f-8afe-c8e6c5880cda of volume 2fe786d8-f74b-478c-b68b-a5f952400424 {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 21:37:55 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-3ec2d18d-5539-45eb-a557-1f95589734be tempest-SnapshotsActionsTest-1764320913 None] snapshot_file for this snap is: volume-2fe786d8-f74b-478c-b68b-a5f952400424.9e3ea175-4872-4a3f-8afe-c8e6c5880cda {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 21:37:55 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[f07d58a8-4bdd-4794-8d08-b1178a9acaf3]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:37:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3ec2d18d-5539-45eb-a557-1f95589734be tempest-SnapshotsActionsTest-1764320913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.9e3ea175-4872-4a3f-8afe-c8e6c5880cda {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:56 devstack sudo[93076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.9e3ea175-4872-4a3f-8afe-c8e6c5880cda Sep 18 21:37:56 devstack sudo[93076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:56 devstack sudo[93076]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3ec2d18d-5539-45eb-a557-1f95589734be tempest-SnapshotsActionsTest-1764320913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.9e3ea175-4872-4a3f-8afe-c8e6c5880cda" returned: 0 in 0.437s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:56 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-3ec2d18d-5539-45eb-a557-1f95589734be tempest-SnapshotsActionsTest-1764320913 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2fe786d8-f74b-478c-b68b-a5f952400424(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86136) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 21:37:56 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[7256b3ff-0e79-4638-856d-c2a6187564f2]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:37:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3ec2d18d-5539-45eb-a557-1f95589734be tempest-SnapshotsActionsTest-1764320913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:56 devstack sudo[93082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424 Sep 18 21:37:56 devstack sudo[93082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:56 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b590da6-a076-4d59-8481-8568f32bfd08 tempest-VolumesTransfersV357Test-660018145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:37:56 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-1b590da6-a076-4d59-8481-8568f32bfd08 tempest-VolumesTransfersV357Test-660018145 None] Flow 'volume_create_manager' (895fbc74-325a-4c5c-a028-d52e312640f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:37:57 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-1b590da6-a076-4d59-8481-8568f32bfd08 tempest-VolumesTransfersV357Test-660018145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6acdac6c-5b5c-475e-a75d-12292da7e59e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:37:57 devstack sudo[93082]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:57 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-1b590da6-a076-4d59-8481-8568f32bfd08 tempest-VolumesTransfersV357Test-660018145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6acdac6c-5b5c-475e-a75d-12292da7e59e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:37:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-814990630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e81baae-ad0b-4463-b593-d042a99337bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b53f1a665afe4a4c8aae04617f7c3c78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:37:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:37:57Z,use_quota=True,user_id='2d281d9b5a124c5f8083bc595c763b7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:37:57 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-1b590da6-a076-4d59-8481-8568f32bfd08 tempest-VolumesTransfersV357Test-660018145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e989eeb3-0146-4f0a-9326-1f4151c0dccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:37:57 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-1b590da6-a076-4d59-8481-8568f32bfd08 tempest-VolumesTransfersV357Test-660018145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e989eeb3-0146-4f0a-9326-1f4151c0dccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:37:57 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-1b590da6-a076-4d59-8481-8568f32bfd08 tempest-VolumesTransfersV357Test-660018145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (574283f9-8b96-426a-85ae-5191b9e182c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:37:57 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-1b590da6-a076-4d59-8481-8568f32bfd08 tempest-VolumesTransfersV357Test-660018145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (574283f9-8b96-426a-85ae-5191b9e182c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e81baae-ad0b-4463-b593-d042a99337bd', 'volume_name': 'volume-3e81baae-ad0b-4463-b593-d042a99337bd', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:37:57 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-1b590da6-a076-4d59-8481-8568f32bfd08 tempest-VolumesTransfersV357Test-660018145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1aaa9270-1a55-4bfa-b430-b559cf0a33f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:37:57 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-1b590da6-a076-4d59-8481-8568f32bfd08 tempest-VolumesTransfersV357Test-660018145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1aaa9270-1a55-4bfa-b430-b559cf0a33f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:37:57 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-1b590da6-a076-4d59-8481-8568f32bfd08 tempest-VolumesTransfersV357Test-660018145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dae37a4c-6ad5-426f-bbff-15ccef3080dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:37:57 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-1b590da6-a076-4d59-8481-8568f32bfd08 tempest-VolumesTransfersV357Test-660018145 None] Volume 3e81baae-ad0b-4463-b593-d042a99337bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e81baae-ad0b-4463-b593-d042a99337bd', 'volume_size': 1} Sep 18 21:37:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-1b590da6-a076-4d59-8481-8568f32bfd08 tempest-VolumesTransfersV357Test-660018145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:37:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-1b590da6-a076-4d59-8481-8568f32bfd08 tempest-VolumesTransfersV357Test-660018145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:37:57 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-1b590da6-a076-4d59-8481-8568f32bfd08 tempest-VolumesTransfersV357Test-660018145 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:37:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-814990630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e81baae-ad0b-4463-b593-d042a99337bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b53f1a665afe4a4c8aae04617f7c3c78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:37:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:37:57Z,use_quota=True,user_id='2d281d9b5a124c5f8083bc595c763b7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:37:57 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-1b590da6-a076-4d59-8481-8568f32bfd08 tempest-VolumesTransfersV357Test-660018145 None] Creating volume 3e81baae-ad0b-4463-b593-d042a99337bd {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:37:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-1b590da6-a076-4d59-8481-8568f32bfd08 tempest-VolumesTransfersV357Test-660018145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:37:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-1b590da6-a076-4d59-8481-8568f32bfd08 tempest-VolumesTransfersV357Test-660018145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:37:57 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-1b590da6-a076-4d59-8481-8568f32bfd08 tempest-VolumesTransfersV357Test-660018145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:37:57 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-1b590da6-a076-4d59-8481-8568f32bfd08 tempest-VolumesTransfersV357Test-660018145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:37:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-1b590da6-a076-4d59-8481-8568f32bfd08 tempest-VolumesTransfersV357Test-660018145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:37:57 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-1b590da6-a076-4d59-8481-8568f32bfd08 tempest-VolumesTransfersV357Test-660018145 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:37:57 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-1b590da6-a076-4d59-8481-8568f32bfd08 tempest-VolumesTransfersV357Test-660018145 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:37:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1b590da6-a076-4d59-8481-8568f32bfd08 tempest-VolumesTransfersV357Test-660018145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3e81baae-ad0b-4463-b593-d042a99337bd 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3ec2d18d-5539-45eb-a557-1f95589734be tempest-SnapshotsActionsTest-1764320913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424" returned: 0 in 0.672s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3ec2d18d-5539-45eb-a557-1f95589734be tempest-SnapshotsActionsTest-1764320913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.9e3ea175-4872-4a3f-8afe-c8e6c5880cda {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:57 devstack sudo[93088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3e81baae-ad0b-4463-b593-d042a99337bd 1073741824 Sep 18 21:37:57 devstack sudo[93088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:57 devstack sudo[93089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.9e3ea175-4872-4a3f-8afe-c8e6c5880cda Sep 18 21:37:57 devstack sudo[93089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:57 devstack sudo[93089]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3ec2d18d-5539-45eb-a557-1f95589734be tempest-SnapshotsActionsTest-1764320913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.9e3ea175-4872-4a3f-8afe-c8e6c5880cda" returned: 0 in 0.458s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3ec2d18d-5539-45eb-a557-1f95589734be tempest-SnapshotsActionsTest-1764320913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.9e3ea175-4872-4a3f-8afe-c8e6c5880cda {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:57 devstack sudo[93102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.9e3ea175-4872-4a3f-8afe-c8e6c5880cda Sep 18 21:37:57 devstack sudo[93102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:57 devstack sudo[93088]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1b590da6-a076-4d59-8481-8568f32bfd08 tempest-VolumesTransfersV357Test-660018145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3e81baae-ad0b-4463-b593-d042a99337bd 1073741824" returned: 0 in 0.610s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1b590da6-a076-4d59-8481-8568f32bfd08 tempest-VolumesTransfersV357Test-660018145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3e81baae-ad0b-4463-b593-d042a99337bd {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:57 devstack sudo[93104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3e81baae-ad0b-4463-b593-d042a99337bd Sep 18 21:37:57 devstack sudo[93104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:37:57 devstack sudo[93102]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3ec2d18d-5539-45eb-a557-1f95589734be tempest-SnapshotsActionsTest-1764320913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424.9e3ea175-4872-4a3f-8afe-c8e6c5880cda" returned: 0 in 0.307s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:58 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-3ec2d18d-5539-45eb-a557-1f95589734be tempest-SnapshotsActionsTest-1764320913 None] Lock "cinder-quobyte-9e3ea175-4872-4a3f-8afe-c8e6c5880cda" released by "_delete_snapshot" :: held 2.062s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:37:58 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-3ec2d18d-5539-45eb-a557-1f95589734be tempest-SnapshotsActionsTest-1764320913 None] Lock "cinder-quobyte-2fe786d8-f74b-478c-b68b-a5f952400424" released by "delete_snapshot" :: held 2.110s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:37:58 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-3ec2d18d-5539-45eb-a557-1f95589734be tempest-SnapshotsActionsTest-1764320913 None] Created reservations ['135d7e01-ba82-4808-9c52-24cfd17e853a', '355f9d91-0d31-4987-a0ca-df803d9487fc', '03fc59ce-ca12-4346-80b6-17e30c513dff', '55a0db84-88ae-4974-beb9-dd812bd22d40'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:37:58 devstack sudo[93104]: pam_unix(sudo:session): session closed for user root Sep 18 21:37:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1b590da6-a076-4d59-8481-8568f32bfd08 tempest-VolumesTransfersV357Test-660018145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3e81baae-ad0b-4463-b593-d042a99337bd" returned: 0 in 0.357s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:37:58 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-1b590da6-a076-4d59-8481-8568f32bfd08 tempest-VolumesTransfersV357Test-660018145 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:37:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-1b590da6-a076-4d59-8481-8568f32bfd08 tempest-VolumesTransfersV357Test-660018145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:37:58 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-1b590da6-a076-4d59-8481-8568f32bfd08 tempest-VolumesTransfersV357Test-660018145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dae37a4c-6ad5-426f-bbff-15ccef3080dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e81baae-ad0b-4463-b593-d042a99337bd', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:37:58 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-1b590da6-a076-4d59-8481-8568f32bfd08 tempest-VolumesTransfersV357Test-660018145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6327a9b7-c1b5-4647-af9d-9894e7925ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:37:58 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-1b590da6-a076-4d59-8481-8568f32bfd08 tempest-VolumesTransfersV357Test-660018145 None] Volume volume-3e81baae-ad0b-4463-b593-d042a99337bd (3e81baae-ad0b-4463-b593-d042a99337bd): created successfully Sep 18 21:37:58 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-1b590da6-a076-4d59-8481-8568f32bfd08 tempest-VolumesTransfersV357Test-660018145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6327a9b7-c1b5-4647-af9d-9894e7925ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:37:58 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-1b590da6-a076-4d59-8481-8568f32bfd08 tempest-VolumesTransfersV357Test-660018145 None] Flow 'volume_create_manager' (895fbc74-325a-4c5c-a028-d52e312640f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:37:58 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-1b590da6-a076-4d59-8481-8568f32bfd08 tempest-VolumesTransfersV357Test-660018145 None] Created volume successfully. Sep 18 21:37:58 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-3ec2d18d-5539-45eb-a557-1f95589734be tempest-SnapshotsActionsTest-1764320913 None] Delete snapshot completed successfully. Sep 18 21:37:58 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-3ec2d18d-5539-45eb-a557-1f95589734be tempest-SnapshotsActionsTest-1764320913 None] Lock "cinder-9e3ea175-4872-4a3f-8afe-c8e6c5880cda-delete_snapshot" released by "delete_snapshot" :: held 2.366s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:37:59 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-9b630228-4309-4499-b9c0-568143718ebe tempest-SnapshotsActionsTest-1764320913 None] Acquiring lock "cinder-2fe786d8-f74b-478c-b68b-a5f952400424-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:37:59 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-9b630228-4309-4499-b9c0-568143718ebe tempest-SnapshotsActionsTest-1764320913 None] Lock "cinder-2fe786d8-f74b-478c-b68b-a5f952400424-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:37:59 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-9b630228-4309-4499-b9c0-568143718ebe tempest-SnapshotsActionsTest-1764320913 None] Acquiring lock "cinder-quobyte-2fe786d8-f74b-478c-b68b-a5f952400424" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:37:59 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-9b630228-4309-4499-b9c0-568143718ebe tempest-SnapshotsActionsTest-1764320913 None] Lock "cinder-quobyte-2fe786d8-f74b-478c-b68b-a5f952400424" acquired by "delete_volume" :: waited 0.022s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:37:59 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f5410ad-5023-49ec-94e7-1670438369e2]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:37:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9b630228-4309-4499-b9c0-568143718ebe tempest-SnapshotsActionsTest-1764320913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:37:59 devstack sudo[93110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424 Sep 18 21:37:59 devstack sudo[93110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:38:00 devstack sudo[93110]: pam_unix(sudo:session): session closed for user root Sep 18 21:38:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9b630228-4309-4499-b9c0-568143718ebe tempest-SnapshotsActionsTest-1764320913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424" returned: 0 in 0.609s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:38:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9b630228-4309-4499-b9c0-568143718ebe tempest-SnapshotsActionsTest-1764320913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:38:00 devstack sudo[93126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424 Sep 18 21:38:00 devstack sudo[93126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:38:00 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-c43fd976-e012-484e-ae9a-5efe3b7b66c4 tempest-VolumesTransfersV357Test-1500358817 None] Transfer volume completed successfully. Sep 18 21:38:00 devstack sudo[93126]: pam_unix(sudo:session): session closed for user root Sep 18 21:38:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9b630228-4309-4499-b9c0-568143718ebe tempest-SnapshotsActionsTest-1764320913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2fe786d8-f74b-478c-b68b-a5f952400424" returned: 0 in 0.546s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:38:00 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-9b630228-4309-4499-b9c0-568143718ebe tempest-SnapshotsActionsTest-1764320913 None] Lock "cinder-quobyte-2fe786d8-f74b-478c-b68b-a5f952400424" released by "delete_volume" :: held 1.284s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:38:00 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-9b630228-4309-4499-b9c0-568143718ebe tempest-SnapshotsActionsTest-1764320913 None] Created reservations ['6ad0ddf3-612e-4183-9983-e9c706686655', 'dbab9f1c-200b-4c25-ab64-c3c237c0d6c2', 'bf6260d3-6ab2-40b4-afd7-dbfda946cc88', '1539ee5f-6827-45ac-8479-af5289f0d434'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:38:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-9b630228-4309-4499-b9c0-568143718ebe tempest-SnapshotsActionsTest-1764320913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:38:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-9b630228-4309-4499-b9c0-568143718ebe tempest-SnapshotsActionsTest-1764320913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:38:00 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-9b630228-4309-4499-b9c0-568143718ebe tempest-SnapshotsActionsTest-1764320913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:38:00 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-9b630228-4309-4499-b9c0-568143718ebe tempest-SnapshotsActionsTest-1764320913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:38:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-9b630228-4309-4499-b9c0-568143718ebe tempest-SnapshotsActionsTest-1764320913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:38:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9b630228-4309-4499-b9c0-568143718ebe tempest-SnapshotsActionsTest-1764320913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:38:00 devstack sudo[93134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:38:00 devstack sudo[93134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:38:01 devstack sudo[93134]: pam_unix(sudo:session): session closed for user root Sep 18 21:38:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9b630228-4309-4499-b9c0-568143718ebe tempest-SnapshotsActionsTest-1764320913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.333s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:38:01 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-9b630228-4309-4499-b9c0-568143718ebe tempest-SnapshotsActionsTest-1764320913 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:38:01 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-9b630228-4309-4499-b9c0-568143718ebe tempest-SnapshotsActionsTest-1764320913 None] Deleted volume successfully. Sep 18 21:38:01 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-9b630228-4309-4499-b9c0-568143718ebe tempest-SnapshotsActionsTest-1764320913 None] Lock "cinder-2fe786d8-f74b-478c-b68b-a5f952400424-delete_volume" released by "delete_volume" :: held 1.952s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:38:01 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-a1bb2022-ca05-4c7c-aec9-2480ac63017b tempest-VolumesTransfersV357Test-1778119813 None] Acquiring lock "cinder-3e81baae-ad0b-4463-b593-d042a99337bd-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:38:01 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-a1bb2022-ca05-4c7c-aec9-2480ac63017b tempest-VolumesTransfersV357Test-1778119813 None] Lock "cinder-3e81baae-ad0b-4463-b593-d042a99337bd-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:38:01 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-a1bb2022-ca05-4c7c-aec9-2480ac63017b tempest-VolumesTransfersV357Test-1778119813 None] Acquiring lock "cinder-quobyte-3e81baae-ad0b-4463-b593-d042a99337bd" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:38:01 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-a1bb2022-ca05-4c7c-aec9-2480ac63017b tempest-VolumesTransfersV357Test-1778119813 None] Lock "cinder-quobyte-3e81baae-ad0b-4463-b593-d042a99337bd" acquired by "delete_volume" :: waited 0.022s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:38:01 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d6d6a7a-687c-4718-9a08-829d10e913ee]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:38:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-a1bb2022-ca05-4c7c-aec9-2480ac63017b tempest-VolumesTransfersV357Test-1778119813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3e81baae-ad0b-4463-b593-d042a99337bd {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:38:01 devstack sudo[93137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3e81baae-ad0b-4463-b593-d042a99337bd Sep 18 21:38:01 devstack sudo[93137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:38:01 devstack sudo[93137]: pam_unix(sudo:session): session closed for user root Sep 18 21:38:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-a1bb2022-ca05-4c7c-aec9-2480ac63017b tempest-VolumesTransfersV357Test-1778119813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3e81baae-ad0b-4463-b593-d042a99337bd" returned: 0 in 0.425s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:38:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-a1bb2022-ca05-4c7c-aec9-2480ac63017b tempest-VolumesTransfersV357Test-1778119813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3e81baae-ad0b-4463-b593-d042a99337bd {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:38:01 devstack sudo[93142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3e81baae-ad0b-4463-b593-d042a99337bd Sep 18 21:38:01 devstack sudo[93142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:38:02 devstack sudo[93142]: pam_unix(sudo:session): session closed for user root Sep 18 21:38:02 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-a1bb2022-ca05-4c7c-aec9-2480ac63017b tempest-VolumesTransfersV357Test-1778119813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3e81baae-ad0b-4463-b593-d042a99337bd" returned: 0 in 0.377s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:38:02 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-a1bb2022-ca05-4c7c-aec9-2480ac63017b tempest-VolumesTransfersV357Test-1778119813 None] Lock "cinder-quobyte-3e81baae-ad0b-4463-b593-d042a99337bd" released by "delete_volume" :: held 0.870s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:38:02 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-a1bb2022-ca05-4c7c-aec9-2480ac63017b tempest-VolumesTransfersV357Test-1778119813 None] Created reservations ['169bc094-c8ab-48dd-a44e-b8bfa79bd706', '12d0f42a-bd59-45bc-87c7-ce50e9b65981', '3250cad8-9699-4fff-b36b-bf6b394d363d', '05c0aad0-8306-4fe2-a124-2dec4871a751'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:38:02 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-a1bb2022-ca05-4c7c-aec9-2480ac63017b tempest-VolumesTransfersV357Test-1778119813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:38:02 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-a1bb2022-ca05-4c7c-aec9-2480ac63017b tempest-VolumesTransfersV357Test-1778119813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:38:02 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-a1bb2022-ca05-4c7c-aec9-2480ac63017b tempest-VolumesTransfersV357Test-1778119813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:38:02 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-a1bb2022-ca05-4c7c-aec9-2480ac63017b tempest-VolumesTransfersV357Test-1778119813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:38:02 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-a1bb2022-ca05-4c7c-aec9-2480ac63017b tempest-VolumesTransfersV357Test-1778119813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:38:02 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-a1bb2022-ca05-4c7c-aec9-2480ac63017b tempest-VolumesTransfersV357Test-1778119813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:38:02 devstack sudo[93146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:38:02 devstack sudo[93146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:38:02 devstack sudo[93146]: pam_unix(sudo:session): session closed for user root Sep 18 21:38:02 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-a1bb2022-ca05-4c7c-aec9-2480ac63017b tempest-VolumesTransfersV357Test-1778119813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.330s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:38:02 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-a1bb2022-ca05-4c7c-aec9-2480ac63017b tempest-VolumesTransfersV357Test-1778119813 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:38:02 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-a1bb2022-ca05-4c7c-aec9-2480ac63017b tempest-VolumesTransfersV357Test-1778119813 None] Deleted volume successfully. Sep 18 21:38:02 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-a1bb2022-ca05-4c7c-aec9-2480ac63017b tempest-VolumesTransfersV357Test-1778119813 None] Lock "cinder-3e81baae-ad0b-4463-b593-d042a99337bd-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:38:04 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-cad0fec8-93d6-4d1b-bb1a-da33785724a1 tempest-VolumesTransfersV357Test-660018145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:38:04 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-cad0fec8-93d6-4d1b-bb1a-da33785724a1 tempest-VolumesTransfersV357Test-660018145 None] Flow 'volume_create_manager' (5d9f77fd-a744-4192-9b2a-300063a1232f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:38:04 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-cad0fec8-93d6-4d1b-bb1a-da33785724a1 tempest-VolumesTransfersV357Test-660018145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f5f9efe-7943-4f3c-a13d-27a7577ea9f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:38:04 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-cad0fec8-93d6-4d1b-bb1a-da33785724a1 tempest-VolumesTransfersV357Test-660018145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f5f9efe-7943-4f3c-a13d-27a7577ea9f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:38:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1378453066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e004af38-32f3-46aa-82c8-97a80c1052f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b53f1a665afe4a4c8aae04617f7c3c78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:38:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:38:05Z,use_quota=True,user_id='2d281d9b5a124c5f8083bc595c763b7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:38:04 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-cad0fec8-93d6-4d1b-bb1a-da33785724a1 tempest-VolumesTransfersV357Test-660018145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a51adfe-74ba-42f3-8941-718ee9ee29ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:38:04 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-cad0fec8-93d6-4d1b-bb1a-da33785724a1 tempest-VolumesTransfersV357Test-660018145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a51adfe-74ba-42f3-8941-718ee9ee29ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:38:04 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-cad0fec8-93d6-4d1b-bb1a-da33785724a1 tempest-VolumesTransfersV357Test-660018145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8edf3b55-f7b1-4d6b-bd1b-09ece94bf19c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:38:04 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-cad0fec8-93d6-4d1b-bb1a-da33785724a1 tempest-VolumesTransfersV357Test-660018145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8edf3b55-f7b1-4d6b-bd1b-09ece94bf19c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e004af38-32f3-46aa-82c8-97a80c1052f2', 'volume_name': 'volume-e004af38-32f3-46aa-82c8-97a80c1052f2', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:38:04 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-cad0fec8-93d6-4d1b-bb1a-da33785724a1 tempest-VolumesTransfersV357Test-660018145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd46566b-7e0c-4b3f-a8a7-7d09f9ebc1b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:38:04 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-cad0fec8-93d6-4d1b-bb1a-da33785724a1 tempest-VolumesTransfersV357Test-660018145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd46566b-7e0c-4b3f-a8a7-7d09f9ebc1b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:38:04 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-cad0fec8-93d6-4d1b-bb1a-da33785724a1 tempest-VolumesTransfersV357Test-660018145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb973ad9-1bfd-4135-acb7-4b4e20e543b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:38:04 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-cad0fec8-93d6-4d1b-bb1a-da33785724a1 tempest-VolumesTransfersV357Test-660018145 None] Volume e004af38-32f3-46aa-82c8-97a80c1052f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e004af38-32f3-46aa-82c8-97a80c1052f2', 'volume_size': 1} Sep 18 21:38:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-cad0fec8-93d6-4d1b-bb1a-da33785724a1 tempest-VolumesTransfersV357Test-660018145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:38:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-cad0fec8-93d6-4d1b-bb1a-da33785724a1 tempest-VolumesTransfersV357Test-660018145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:38:04 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-cad0fec8-93d6-4d1b-bb1a-da33785724a1 tempest-VolumesTransfersV357Test-660018145 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:38:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1378453066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e004af38-32f3-46aa-82c8-97a80c1052f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b53f1a665afe4a4c8aae04617f7c3c78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:38:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:38:05Z,use_quota=True,user_id='2d281d9b5a124c5f8083bc595c763b7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:38:04 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-cad0fec8-93d6-4d1b-bb1a-da33785724a1 tempest-VolumesTransfersV357Test-660018145 None] Creating volume e004af38-32f3-46aa-82c8-97a80c1052f2 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:38:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-cad0fec8-93d6-4d1b-bb1a-da33785724a1 tempest-VolumesTransfersV357Test-660018145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:38:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-cad0fec8-93d6-4d1b-bb1a-da33785724a1 tempest-VolumesTransfersV357Test-660018145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:38:04 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-cad0fec8-93d6-4d1b-bb1a-da33785724a1 tempest-VolumesTransfersV357Test-660018145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:38:05 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-cad0fec8-93d6-4d1b-bb1a-da33785724a1 tempest-VolumesTransfersV357Test-660018145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:38:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-cad0fec8-93d6-4d1b-bb1a-da33785724a1 tempest-VolumesTransfersV357Test-660018145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:38:05 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-cad0fec8-93d6-4d1b-bb1a-da33785724a1 tempest-VolumesTransfersV357Test-660018145 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:38:05 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-cad0fec8-93d6-4d1b-bb1a-da33785724a1 tempest-VolumesTransfersV357Test-660018145 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:38:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-cad0fec8-93d6-4d1b-bb1a-da33785724a1 tempest-VolumesTransfersV357Test-660018145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e004af38-32f3-46aa-82c8-97a80c1052f2 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:38:05 devstack sudo[93216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e004af38-32f3-46aa-82c8-97a80c1052f2 1073741824 Sep 18 21:38:05 devstack sudo[93216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:38:05 devstack cinder-volume[86136]: DEBUG oslo_service.periodic_task [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86136) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 21:38:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:38:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:38:05 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:38:05 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:38:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.055s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:38:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:38:05 devstack sudo[93219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:38:05 devstack sudo[93219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:38:05 devstack sudo[93219]: pam_unix(sudo:session): session closed for user root Sep 18 21:38:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.743s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:38:05 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:38:05 devstack sudo[93216]: pam_unix(sudo:session): session closed for user root Sep 18 21:38:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-cad0fec8-93d6-4d1b-bb1a-da33785724a1 tempest-VolumesTransfersV357Test-660018145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e004af38-32f3-46aa-82c8-97a80c1052f2 1073741824" returned: 0 in 0.975s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:38:06 devstack cinder-volume[86136]: DEBUG oslo_service.periodic_task [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Running periodic task VolumeManager._thread_info {{(pid=86136) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 21:38:06 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] thread count: 28 {{(pid=86136) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 18 21:38:06 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] thread info: [<_MainThread(MainThread, started 138548347871360)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86136) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 18 21:38:06 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-cad0fec8-93d6-4d1b-bb1a-da33785724a1 tempest-VolumesTransfersV357Test-660018145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e004af38-32f3-46aa-82c8-97a80c1052f2 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:38:06 devstack sudo[93226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e004af38-32f3-46aa-82c8-97a80c1052f2 Sep 18 21:38:06 devstack sudo[93226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:38:06 devstack sudo[93226]: pam_unix(sudo:session): session closed for user root Sep 18 21:38:06 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-cad0fec8-93d6-4d1b-bb1a-da33785724a1 tempest-VolumesTransfersV357Test-660018145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e004af38-32f3-46aa-82c8-97a80c1052f2" returned: 0 in 0.431s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:38:06 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-cad0fec8-93d6-4d1b-bb1a-da33785724a1 tempest-VolumesTransfersV357Test-660018145 None] <== create_volume: return (1515ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:38:06 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-cad0fec8-93d6-4d1b-bb1a-da33785724a1 tempest-VolumesTransfersV357Test-660018145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.519s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:38:06 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-cad0fec8-93d6-4d1b-bb1a-da33785724a1 tempest-VolumesTransfersV357Test-660018145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb973ad9-1bfd-4135-acb7-4b4e20e543b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e004af38-32f3-46aa-82c8-97a80c1052f2', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:38:06 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-cad0fec8-93d6-4d1b-bb1a-da33785724a1 tempest-VolumesTransfersV357Test-660018145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3daae369-a960-46fa-bcd9-d00f658ad92e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:38:06 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-cad0fec8-93d6-4d1b-bb1a-da33785724a1 tempest-VolumesTransfersV357Test-660018145 None] Volume volume-e004af38-32f3-46aa-82c8-97a80c1052f2 (e004af38-32f3-46aa-82c8-97a80c1052f2): created successfully Sep 18 21:38:06 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-cad0fec8-93d6-4d1b-bb1a-da33785724a1 tempest-VolumesTransfersV357Test-660018145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3daae369-a960-46fa-bcd9-d00f658ad92e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:38:06 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-cad0fec8-93d6-4d1b-bb1a-da33785724a1 tempest-VolumesTransfersV357Test-660018145 None] Flow 'volume_create_manager' (5d9f77fd-a744-4192-9b2a-300063a1232f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:38:06 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-cad0fec8-93d6-4d1b-bb1a-da33785724a1 tempest-VolumesTransfersV357Test-660018145 None] Created volume successfully. Sep 18 21:38:07 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-aeadd353-0230-4f91-a769-813eae56d8b0 tempest-VolumesTransfersV357Test-1778119813 None] Acquiring lock "cinder-e004af38-32f3-46aa-82c8-97a80c1052f2-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:38:07 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-aeadd353-0230-4f91-a769-813eae56d8b0 tempest-VolumesTransfersV357Test-1778119813 None] Lock "cinder-e004af38-32f3-46aa-82c8-97a80c1052f2-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:38:07 devstack cinder-volume[86136]: DEBUG dbcounter [-] [86136] Writing DB stats cinder:UPDATE=136,cinder:SELECT=110,cinder:INSERT=34,cinder:DELETE=10 {{(pid=86136) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 21:38:07 devstack cinder-volume[86136]: DEBUG dbcounter [-] [86136] Writing DB stats cinder:SELECT=134,cinder:UPDATE=142,cinder:INSERT=40,cinder:DELETE=11 {{(pid=86136) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 21:38:07 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-aeadd353-0230-4f91-a769-813eae56d8b0 tempest-VolumesTransfersV357Test-1778119813 None] Acquiring lock "cinder-quobyte-e004af38-32f3-46aa-82c8-97a80c1052f2" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:38:07 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-aeadd353-0230-4f91-a769-813eae56d8b0 tempest-VolumesTransfersV357Test-1778119813 None] Lock "cinder-quobyte-e004af38-32f3-46aa-82c8-97a80c1052f2" acquired by "delete_volume" :: waited 0.043s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:38:07 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7aef434-2038-4f07-b032-7d478620239d]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:38:07 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-aeadd353-0230-4f91-a769-813eae56d8b0 tempest-VolumesTransfersV357Test-1778119813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e004af38-32f3-46aa-82c8-97a80c1052f2 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:38:07 devstack sudo[93230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e004af38-32f3-46aa-82c8-97a80c1052f2 Sep 18 21:38:07 devstack sudo[93230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:38:08 devstack sudo[93230]: pam_unix(sudo:session): session closed for user root Sep 18 21:38:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-aeadd353-0230-4f91-a769-813eae56d8b0 tempest-VolumesTransfersV357Test-1778119813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e004af38-32f3-46aa-82c8-97a80c1052f2" returned: 0 in 0.720s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:38:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-aeadd353-0230-4f91-a769-813eae56d8b0 tempest-VolumesTransfersV357Test-1778119813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e004af38-32f3-46aa-82c8-97a80c1052f2 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:38:08 devstack sudo[93236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e004af38-32f3-46aa-82c8-97a80c1052f2 Sep 18 21:38:08 devstack sudo[93236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:38:08 devstack sudo[93236]: pam_unix(sudo:session): session closed for user root Sep 18 21:38:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-aeadd353-0230-4f91-a769-813eae56d8b0 tempest-VolumesTransfersV357Test-1778119813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e004af38-32f3-46aa-82c8-97a80c1052f2" returned: 0 in 0.450s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:38:08 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-aeadd353-0230-4f91-a769-813eae56d8b0 tempest-VolumesTransfersV357Test-1778119813 None] Lock "cinder-quobyte-e004af38-32f3-46aa-82c8-97a80c1052f2" released by "delete_volume" :: held 1.249s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:38:08 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-aeadd353-0230-4f91-a769-813eae56d8b0 tempest-VolumesTransfersV357Test-1778119813 None] Created reservations ['2bccdd42-51e7-4675-9f4b-2d2ce032c8a9', '4cd7f3d3-76c4-4837-8b5d-58ac55bfddc8', '9e681a4c-c1f1-4fd2-8c29-07032a1a11b1', '0b8e5400-68a9-436b-8959-09c52983c14e'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:38:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-aeadd353-0230-4f91-a769-813eae56d8b0 tempest-VolumesTransfersV357Test-1778119813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:38:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-aeadd353-0230-4f91-a769-813eae56d8b0 tempest-VolumesTransfersV357Test-1778119813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:38:09 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-aeadd353-0230-4f91-a769-813eae56d8b0 tempest-VolumesTransfersV357Test-1778119813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:38:09 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-aeadd353-0230-4f91-a769-813eae56d8b0 tempest-VolumesTransfersV357Test-1778119813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:38:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-aeadd353-0230-4f91-a769-813eae56d8b0 tempest-VolumesTransfersV357Test-1778119813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:38:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-aeadd353-0230-4f91-a769-813eae56d8b0 tempest-VolumesTransfersV357Test-1778119813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:38:09 devstack sudo[93240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:38:09 devstack sudo[93240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:38:09 devstack sudo[93240]: pam_unix(sudo:session): session closed for user root Sep 18 21:38:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-aeadd353-0230-4f91-a769-813eae56d8b0 tempest-VolumesTransfersV357Test-1778119813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.470s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:38:09 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-aeadd353-0230-4f91-a769-813eae56d8b0 tempest-VolumesTransfersV357Test-1778119813 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:38:09 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-aeadd353-0230-4f91-a769-813eae56d8b0 tempest-VolumesTransfersV357Test-1778119813 None] Deleted volume successfully. Sep 18 21:38:09 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-aeadd353-0230-4f91-a769-813eae56d8b0 tempest-VolumesTransfersV357Test-1778119813 None] Lock "cinder-e004af38-32f3-46aa-82c8-97a80c1052f2-delete_volume" released by "delete_volume" :: held 2.234s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:38:15 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-07ab55a4-a91e-425b-a2e2-5142e50d2c7a tempest-VolumeRetypeWithoutMigrationTest-509015048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:38:15 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-07ab55a4-a91e-425b-a2e2-5142e50d2c7a tempest-VolumeRetypeWithoutMigrationTest-509015048 None] Flow 'volume_create_manager' (7d85bb10-0b2b-4287-abc3-3b14e0672b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:38:15 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-07ab55a4-a91e-425b-a2e2-5142e50d2c7a tempest-VolumeRetypeWithoutMigrationTest-509015048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88a4ff88-a618-40f3-835f-c01f06898fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:38:15 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-07ab55a4-a91e-425b-a2e2-5142e50d2c7a tempest-VolumeRetypeWithoutMigrationTest-509015048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88a4ff88-a618-40f3-835f-c01f06898fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:38:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1879177082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46416dc0-fa7c-488d-a5fc-0931babad2bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b94464bd70b4a5dabf203f5495a2bfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:38:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:38:16Z,use_quota=True,user_id='30de1566f8834f26aac8c1d8b33164d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f91bdb2-a21d-407d-9857-ab01d2f78450),volume_type_id=7f91bdb2-a21d-407d-9857-ab01d2f78450)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:38:15 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-07ab55a4-a91e-425b-a2e2-5142e50d2c7a tempest-VolumeRetypeWithoutMigrationTest-509015048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13e75b37-bffa-40fd-93d9-67b9cbfb796b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:38:15 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-07ab55a4-a91e-425b-a2e2-5142e50d2c7a tempest-VolumeRetypeWithoutMigrationTest-509015048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13e75b37-bffa-40fd-93d9-67b9cbfb796b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:38:15 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-07ab55a4-a91e-425b-a2e2-5142e50d2c7a tempest-VolumeRetypeWithoutMigrationTest-509015048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea9c108a-7138-451c-89f9-24710a2f9301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:38:15 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-07ab55a4-a91e-425b-a2e2-5142e50d2c7a tempest-VolumeRetypeWithoutMigrationTest-509015048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea9c108a-7138-451c-89f9-24710a2f9301) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46416dc0-fa7c-488d-a5fc-0931babad2bd', 'volume_name': 'volume-46416dc0-fa7c-488d-a5fc-0931babad2bd', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:38:15 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-07ab55a4-a91e-425b-a2e2-5142e50d2c7a tempest-VolumeRetypeWithoutMigrationTest-509015048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0c39cc2-6465-4aea-a889-a62dacef83b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:38:15 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-07ab55a4-a91e-425b-a2e2-5142e50d2c7a tempest-VolumeRetypeWithoutMigrationTest-509015048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0c39cc2-6465-4aea-a889-a62dacef83b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:38:15 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-07ab55a4-a91e-425b-a2e2-5142e50d2c7a tempest-VolumeRetypeWithoutMigrationTest-509015048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4f35f65-d34b-4f5a-8d49-41b697af4400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:38:15 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-07ab55a4-a91e-425b-a2e2-5142e50d2c7a tempest-VolumeRetypeWithoutMigrationTest-509015048 None] Volume 46416dc0-fa7c-488d-a5fc-0931babad2bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46416dc0-fa7c-488d-a5fc-0931babad2bd', 'volume_size': 1} Sep 18 21:38:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-07ab55a4-a91e-425b-a2e2-5142e50d2c7a tempest-VolumeRetypeWithoutMigrationTest-509015048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:38:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-07ab55a4-a91e-425b-a2e2-5142e50d2c7a tempest-VolumeRetypeWithoutMigrationTest-509015048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:38:15 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-07ab55a4-a91e-425b-a2e2-5142e50d2c7a tempest-VolumeRetypeWithoutMigrationTest-509015048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:38:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1879177082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46416dc0-fa7c-488d-a5fc-0931babad2bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b94464bd70b4a5dabf203f5495a2bfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:38:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:38:16Z,use_quota=True,user_id='30de1566f8834f26aac8c1d8b33164d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f91bdb2-a21d-407d-9857-ab01d2f78450),volume_type_id=7f91bdb2-a21d-407d-9857-ab01d2f78450)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:38:15 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-07ab55a4-a91e-425b-a2e2-5142e50d2c7a tempest-VolumeRetypeWithoutMigrationTest-509015048 None] Creating volume 46416dc0-fa7c-488d-a5fc-0931babad2bd {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:38:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-07ab55a4-a91e-425b-a2e2-5142e50d2c7a tempest-VolumeRetypeWithoutMigrationTest-509015048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:38:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-07ab55a4-a91e-425b-a2e2-5142e50d2c7a tempest-VolumeRetypeWithoutMigrationTest-509015048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:38:15 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-07ab55a4-a91e-425b-a2e2-5142e50d2c7a tempest-VolumeRetypeWithoutMigrationTest-509015048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:38:15 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-07ab55a4-a91e-425b-a2e2-5142e50d2c7a tempest-VolumeRetypeWithoutMigrationTest-509015048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:38:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-07ab55a4-a91e-425b-a2e2-5142e50d2c7a tempest-VolumeRetypeWithoutMigrationTest-509015048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:38:15 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-07ab55a4-a91e-425b-a2e2-5142e50d2c7a tempest-VolumeRetypeWithoutMigrationTest-509015048 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:38:15 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-07ab55a4-a91e-425b-a2e2-5142e50d2c7a tempest-VolumeRetypeWithoutMigrationTest-509015048 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:38:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-07ab55a4-a91e-425b-a2e2-5142e50d2c7a tempest-VolumeRetypeWithoutMigrationTest-509015048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-46416dc0-fa7c-488d-a5fc-0931babad2bd 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:38:16 devstack sudo[93319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-46416dc0-fa7c-488d-a5fc-0931babad2bd 1073741824 Sep 18 21:38:16 devstack sudo[93319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:38:16 devstack sudo[93319]: pam_unix(sudo:session): session closed for user root Sep 18 21:38:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-07ab55a4-a91e-425b-a2e2-5142e50d2c7a tempest-VolumeRetypeWithoutMigrationTest-509015048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-46416dc0-fa7c-488d-a5fc-0931babad2bd 1073741824" returned: 0 in 0.739s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:38:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-07ab55a4-a91e-425b-a2e2-5142e50d2c7a tempest-VolumeRetypeWithoutMigrationTest-509015048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-46416dc0-fa7c-488d-a5fc-0931babad2bd {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:38:16 devstack sudo[93328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-46416dc0-fa7c-488d-a5fc-0931babad2bd Sep 18 21:38:16 devstack sudo[93328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:38:17 devstack sudo[93328]: pam_unix(sudo:session): session closed for user root Sep 18 21:38:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-07ab55a4-a91e-425b-a2e2-5142e50d2c7a tempest-VolumeRetypeWithoutMigrationTest-509015048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-46416dc0-fa7c-488d-a5fc-0931babad2bd" returned: 0 in 0.406s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:38:17 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-07ab55a4-a91e-425b-a2e2-5142e50d2c7a tempest-VolumeRetypeWithoutMigrationTest-509015048 None] <== create_volume: return (1279ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:38:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-07ab55a4-a91e-425b-a2e2-5142e50d2c7a tempest-VolumeRetypeWithoutMigrationTest-509015048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.286s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:38:17 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-07ab55a4-a91e-425b-a2e2-5142e50d2c7a tempest-VolumeRetypeWithoutMigrationTest-509015048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4f35f65-d34b-4f5a-8d49-41b697af4400) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46416dc0-fa7c-488d-a5fc-0931babad2bd', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:38:17 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-07ab55a4-a91e-425b-a2e2-5142e50d2c7a tempest-VolumeRetypeWithoutMigrationTest-509015048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (396e8272-b178-4ce0-887f-8c83a0e4608a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:38:17 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-07ab55a4-a91e-425b-a2e2-5142e50d2c7a tempest-VolumeRetypeWithoutMigrationTest-509015048 None] Volume volume-46416dc0-fa7c-488d-a5fc-0931babad2bd (46416dc0-fa7c-488d-a5fc-0931babad2bd): created successfully Sep 18 21:38:17 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-07ab55a4-a91e-425b-a2e2-5142e50d2c7a tempest-VolumeRetypeWithoutMigrationTest-509015048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (396e8272-b178-4ce0-887f-8c83a0e4608a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:38:17 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-07ab55a4-a91e-425b-a2e2-5142e50d2c7a tempest-VolumeRetypeWithoutMigrationTest-509015048 None] Flow 'volume_create_manager' (7d85bb10-0b2b-4287-abc3-3b14e0672b89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:38:17 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-07ab55a4-a91e-425b-a2e2-5142e50d2c7a tempest-VolumeRetypeWithoutMigrationTest-509015048 None] Created volume successfully. Sep 18 21:38:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c607b770-ab06-4af1-b203-192badc1e5bd tempest-VolumeRetypeWithoutMigrationTest-509015048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:38:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c607b770-ab06-4af1-b203-192badc1e5bd tempest-VolumeRetypeWithoutMigrationTest-509015048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:38:18 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-c607b770-ab06-4af1-b203-192badc1e5bd tempest-VolumeRetypeWithoutMigrationTest-509015048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:38:18 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-c607b770-ab06-4af1-b203-192badc1e5bd tempest-VolumeRetypeWithoutMigrationTest-509015048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:38:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c607b770-ab06-4af1-b203-192badc1e5bd tempest-VolumeRetypeWithoutMigrationTest-509015048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:38:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c607b770-ab06-4af1-b203-192badc1e5bd tempest-VolumeRetypeWithoutMigrationTest-509015048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:38:18 devstack sudo[93355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:38:18 devstack sudo[93355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:38:18 devstack sudo[93355]: pam_unix(sudo:session): session closed for user root Sep 18 21:38:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c607b770-ab06-4af1-b203-192badc1e5bd tempest-VolumeRetypeWithoutMigrationTest-509015048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.379s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:38:18 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-c607b770-ab06-4af1-b203-192badc1e5bd tempest-VolumeRetypeWithoutMigrationTest-509015048 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:38:18 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-c607b770-ab06-4af1-b203-192badc1e5bd tempest-VolumeRetypeWithoutMigrationTest-509015048 None] Retype volume completed successfully. Sep 18 21:38:20 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-e1569076-ca1f-4a94-b426-b31f007d8885 tempest-VolumeRetypeWithoutMigrationTest-509015048 None] Acquiring lock "cinder-46416dc0-fa7c-488d-a5fc-0931babad2bd-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:38:20 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-e1569076-ca1f-4a94-b426-b31f007d8885 tempest-VolumeRetypeWithoutMigrationTest-509015048 None] Lock "cinder-46416dc0-fa7c-488d-a5fc-0931babad2bd-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:38:20 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-e1569076-ca1f-4a94-b426-b31f007d8885 tempest-VolumeRetypeWithoutMigrationTest-509015048 None] Acquiring lock "cinder-quobyte-46416dc0-fa7c-488d-a5fc-0931babad2bd" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:38:20 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-e1569076-ca1f-4a94-b426-b31f007d8885 tempest-VolumeRetypeWithoutMigrationTest-509015048 None] Lock "cinder-quobyte-46416dc0-fa7c-488d-a5fc-0931babad2bd" acquired by "delete_volume" :: waited 0.041s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:38:20 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd446d1-4ebb-4fe4-b924-71200fd80b9c]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:38:20 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e1569076-ca1f-4a94-b426-b31f007d8885 tempest-VolumeRetypeWithoutMigrationTest-509015048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-46416dc0-fa7c-488d-a5fc-0931babad2bd {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:38:20 devstack sudo[93434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-46416dc0-fa7c-488d-a5fc-0931babad2bd Sep 18 21:38:20 devstack sudo[93434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:38:21 devstack sudo[93434]: pam_unix(sudo:session): session closed for user root Sep 18 21:38:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e1569076-ca1f-4a94-b426-b31f007d8885 tempest-VolumeRetypeWithoutMigrationTest-509015048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-46416dc0-fa7c-488d-a5fc-0931babad2bd" returned: 0 in 0.885s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:38:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e1569076-ca1f-4a94-b426-b31f007d8885 tempest-VolumeRetypeWithoutMigrationTest-509015048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-46416dc0-fa7c-488d-a5fc-0931babad2bd {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:38:21 devstack sudo[93471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-46416dc0-fa7c-488d-a5fc-0931babad2bd Sep 18 21:38:21 devstack sudo[93471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:38:22 devstack sudo[93471]: pam_unix(sudo:session): session closed for user root Sep 18 21:38:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e1569076-ca1f-4a94-b426-b31f007d8885 tempest-VolumeRetypeWithoutMigrationTest-509015048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-46416dc0-fa7c-488d-a5fc-0931babad2bd" returned: 0 in 0.731s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:38:22 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-e1569076-ca1f-4a94-b426-b31f007d8885 tempest-VolumeRetypeWithoutMigrationTest-509015048 None] Lock "cinder-quobyte-46416dc0-fa7c-488d-a5fc-0931babad2bd" released by "delete_volume" :: held 1.748s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:38:22 devstack cinder-volume[86136]: WARNING cinder.quota [None req-e1569076-ca1f-4a94-b426-b31f007d8885 tempest-VolumeRetypeWithoutMigrationTest-509015048 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 18 21:38:22 devstack cinder-volume[86136]: WARNING cinder.quota [None req-e1569076-ca1f-4a94-b426-b31f007d8885 tempest-VolumeRetypeWithoutMigrationTest-509015048 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 18 21:38:22 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-e1569076-ca1f-4a94-b426-b31f007d8885 tempest-VolumeRetypeWithoutMigrationTest-509015048 None] Created reservations ['4198f38e-001f-4b99-9c55-fc24d2147f50', '6228df1e-d7c1-474c-9722-1d4f8c3dea75', '0de31dd4-0eb9-4df9-817b-3d71d93f1140', '2b70c792-25da-462b-b34a-7c374ae813d1'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:38:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-e1569076-ca1f-4a94-b426-b31f007d8885 tempest-VolumeRetypeWithoutMigrationTest-509015048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:38:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-e1569076-ca1f-4a94-b426-b31f007d8885 tempest-VolumeRetypeWithoutMigrationTest-509015048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:38:22 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-e1569076-ca1f-4a94-b426-b31f007d8885 tempest-VolumeRetypeWithoutMigrationTest-509015048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:38:22 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-e1569076-ca1f-4a94-b426-b31f007d8885 tempest-VolumeRetypeWithoutMigrationTest-509015048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:38:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-e1569076-ca1f-4a94-b426-b31f007d8885 tempest-VolumeRetypeWithoutMigrationTest-509015048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:38:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e1569076-ca1f-4a94-b426-b31f007d8885 tempest-VolumeRetypeWithoutMigrationTest-509015048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:38:22 devstack sudo[93475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:38:22 devstack sudo[93475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:38:22 devstack sudo[93475]: pam_unix(sudo:session): session closed for user root Sep 18 21:38:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e1569076-ca1f-4a94-b426-b31f007d8885 tempest-VolumeRetypeWithoutMigrationTest-509015048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.555s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:38:22 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-e1569076-ca1f-4a94-b426-b31f007d8885 tempest-VolumeRetypeWithoutMigrationTest-509015048 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:38:22 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-e1569076-ca1f-4a94-b426-b31f007d8885 tempest-VolumeRetypeWithoutMigrationTest-509015048 None] Deleted volume successfully. Sep 18 21:38:22 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-e1569076-ca1f-4a94-b426-b31f007d8885 tempest-VolumeRetypeWithoutMigrationTest-509015048 None] Lock "cinder-46416dc0-fa7c-488d-a5fc-0931babad2bd-delete_volume" released by "delete_volume" :: held 2.732s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:38:25 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-2745e219-4009-4426-804b-9023d62190c2 tempest-VolumesCloneTest-522778170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:38:25 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2745e219-4009-4426-804b-9023d62190c2 tempest-VolumesCloneTest-522778170 None] Flow 'volume_create_manager' (3daa8496-59df-46d6-bf53-decdeb1474c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:38:25 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2745e219-4009-4426-804b-9023d62190c2 tempest-VolumesCloneTest-522778170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b9e500b-c246-46dc-a86d-a3e7b82bc1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:38:25 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2745e219-4009-4426-804b-9023d62190c2 tempest-VolumesCloneTest-522778170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b9e500b-c246-46dc-a86d-a3e7b82bc1b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:38:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1609202896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bc0e2be-a83b-42ed-845c-83cf47207c47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8e7d97ba3724c0aae86e638e70fbe82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:38:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:38:25Z,use_quota=True,user_id='8c93dcd13d2146069e0269bf8b4f29fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:38:25 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2745e219-4009-4426-804b-9023d62190c2 tempest-VolumesCloneTest-522778170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8c17a8b-bef7-44d6-96d0-18f2fcb44e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:38:25 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2745e219-4009-4426-804b-9023d62190c2 tempest-VolumesCloneTest-522778170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8c17a8b-bef7-44d6-96d0-18f2fcb44e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:38:25 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2745e219-4009-4426-804b-9023d62190c2 tempest-VolumesCloneTest-522778170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f86ce69c-f827-40b1-a730-ca4b3e561dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:38:25 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2745e219-4009-4426-804b-9023d62190c2 tempest-VolumesCloneTest-522778170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f86ce69c-f827-40b1-a730-ca4b3e561dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bc0e2be-a83b-42ed-845c-83cf47207c47', 'volume_name': 'volume-4bc0e2be-a83b-42ed-845c-83cf47207c47', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:38:25 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2745e219-4009-4426-804b-9023d62190c2 tempest-VolumesCloneTest-522778170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d567d642-3efb-422a-a94f-f7c841766e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:38:25 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2745e219-4009-4426-804b-9023d62190c2 tempest-VolumesCloneTest-522778170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d567d642-3efb-422a-a94f-f7c841766e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:38:25 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2745e219-4009-4426-804b-9023d62190c2 tempest-VolumesCloneTest-522778170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2875156-3720-427f-a9a3-de4bb93edcb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:38:25 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-2745e219-4009-4426-804b-9023d62190c2 tempest-VolumesCloneTest-522778170 None] Volume 4bc0e2be-a83b-42ed-845c-83cf47207c47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bc0e2be-a83b-42ed-845c-83cf47207c47', 'volume_size': 1} Sep 18 21:38:25 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-2745e219-4009-4426-804b-9023d62190c2 tempest-VolumesCloneTest-522778170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:38:25 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-2745e219-4009-4426-804b-9023d62190c2 tempest-VolumesCloneTest-522778170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:38:25 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-2745e219-4009-4426-804b-9023d62190c2 tempest-VolumesCloneTest-522778170 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:38:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1609202896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bc0e2be-a83b-42ed-845c-83cf47207c47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8e7d97ba3724c0aae86e638e70fbe82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:38:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:38:25Z,use_quota=True,user_id='8c93dcd13d2146069e0269bf8b4f29fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:38:25 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-2745e219-4009-4426-804b-9023d62190c2 tempest-VolumesCloneTest-522778170 None] Creating volume 4bc0e2be-a83b-42ed-845c-83cf47207c47 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:38:25 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-2745e219-4009-4426-804b-9023d62190c2 tempest-VolumesCloneTest-522778170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:38:25 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-2745e219-4009-4426-804b-9023d62190c2 tempest-VolumesCloneTest-522778170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:38:25 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-2745e219-4009-4426-804b-9023d62190c2 tempest-VolumesCloneTest-522778170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:38:25 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-2745e219-4009-4426-804b-9023d62190c2 tempest-VolumesCloneTest-522778170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:38:25 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-2745e219-4009-4426-804b-9023d62190c2 tempest-VolumesCloneTest-522778170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:38:25 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-2745e219-4009-4426-804b-9023d62190c2 tempest-VolumesCloneTest-522778170 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:38:25 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-2745e219-4009-4426-804b-9023d62190c2 tempest-VolumesCloneTest-522778170 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:38:25 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-2745e219-4009-4426-804b-9023d62190c2 tempest-VolumesCloneTest-522778170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4bc0e2be-a83b-42ed-845c-83cf47207c47 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:38:25 devstack sudo[93481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4bc0e2be-a83b-42ed-845c-83cf47207c47 1073741824 Sep 18 21:38:25 devstack sudo[93481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:38:26 devstack sudo[93481]: pam_unix(sudo:session): session closed for user root Sep 18 21:38:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-2745e219-4009-4426-804b-9023d62190c2 tempest-VolumesCloneTest-522778170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4bc0e2be-a83b-42ed-845c-83cf47207c47 1073741824" returned: 0 in 0.924s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:38:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-2745e219-4009-4426-804b-9023d62190c2 tempest-VolumesCloneTest-522778170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4bc0e2be-a83b-42ed-845c-83cf47207c47 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:38:26 devstack sudo[93492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4bc0e2be-a83b-42ed-845c-83cf47207c47 Sep 18 21:38:26 devstack sudo[93492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:38:26 devstack sudo[93492]: pam_unix(sudo:session): session closed for user root Sep 18 21:38:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-2745e219-4009-4426-804b-9023d62190c2 tempest-VolumesCloneTest-522778170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4bc0e2be-a83b-42ed-845c-83cf47207c47" returned: 0 in 0.510s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:38:26 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-2745e219-4009-4426-804b-9023d62190c2 tempest-VolumesCloneTest-522778170 None] <== create_volume: return (1504ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:38:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-2745e219-4009-4426-804b-9023d62190c2 tempest-VolumesCloneTest-522778170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.509s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:38:26 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2745e219-4009-4426-804b-9023d62190c2 tempest-VolumesCloneTest-522778170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2875156-3720-427f-a9a3-de4bb93edcb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bc0e2be-a83b-42ed-845c-83cf47207c47', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:38:26 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2745e219-4009-4426-804b-9023d62190c2 tempest-VolumesCloneTest-522778170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2dd81ad-456e-48e3-87c5-092248339eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:38:26 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-2745e219-4009-4426-804b-9023d62190c2 tempest-VolumesCloneTest-522778170 None] Volume volume-4bc0e2be-a83b-42ed-845c-83cf47207c47 (4bc0e2be-a83b-42ed-845c-83cf47207c47): created successfully Sep 18 21:38:26 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2745e219-4009-4426-804b-9023d62190c2 tempest-VolumesCloneTest-522778170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2dd81ad-456e-48e3-87c5-092248339eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:38:26 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2745e219-4009-4426-804b-9023d62190c2 tempest-VolumesCloneTest-522778170 None] Flow 'volume_create_manager' (3daa8496-59df-46d6-bf53-decdeb1474c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:38:26 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-2745e219-4009-4426-804b-9023d62190c2 tempest-VolumesCloneTest-522778170 None] Created volume successfully. Sep 18 21:38:28 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-107417ad-6c1f-417d-9e94-5f2e48572cf1 tempest-VolumesCloneTest-522778170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:38:28 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-107417ad-6c1f-417d-9e94-5f2e48572cf1 tempest-VolumesCloneTest-522778170 None] Flow 'volume_create_manager' (662a107c-87b4-48dd-8f75-63ed915716a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:38:28 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-107417ad-6c1f-417d-9e94-5f2e48572cf1 tempest-VolumesCloneTest-522778170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b007a33-2a90-4166-bd88-19cb52221960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:38:28 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-107417ad-6c1f-417d-9e94-5f2e48572cf1 tempest-VolumesCloneTest-522778170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b007a33-2a90-4166-bd88-19cb52221960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:38:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-525633547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1c5fc84-5171-48af-b674-3d404849ac2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8e7d97ba3724c0aae86e638e70fbe82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:38:28Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=4bc0e2be-a83b-42ed-845c-83cf47207c47,status='creating',terminated_at=None,updated_at=2026-09-18T19:38:28Z,use_quota=True,user_id='8c93dcd13d2146069e0269bf8b4f29fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:38:28 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-107417ad-6c1f-417d-9e94-5f2e48572cf1 tempest-VolumesCloneTest-522778170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e227706-9bd4-4a56-aae2-e32d62b0897d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:38:28 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-107417ad-6c1f-417d-9e94-5f2e48572cf1 tempest-VolumesCloneTest-522778170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e227706-9bd4-4a56-aae2-e32d62b0897d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:38:28 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-107417ad-6c1f-417d-9e94-5f2e48572cf1 tempest-VolumesCloneTest-522778170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e67e8459-e3be-42e0-9ac5-d41acc09e1d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:38:28 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-107417ad-6c1f-417d-9e94-5f2e48572cf1 tempest-VolumesCloneTest-522778170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e67e8459-e3be-42e0-9ac5-d41acc09e1d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'a1c5fc84-5171-48af-b674-3d404849ac2c', 'volume_name': 'volume-a1c5fc84-5171-48af-b674-3d404849ac2c', 'volume_size': 2, 'source_volid': '4bc0e2be-a83b-42ed-845c-83cf47207c47', 'source_volstatus': 'available'}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:38:28 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-107417ad-6c1f-417d-9e94-5f2e48572cf1 tempest-VolumesCloneTest-522778170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (328facfd-b404-490b-8568-1b4da9dbe9db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:38:28 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-107417ad-6c1f-417d-9e94-5f2e48572cf1 tempest-VolumesCloneTest-522778170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (328facfd-b404-490b-8568-1b4da9dbe9db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:38:28 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-107417ad-6c1f-417d-9e94-5f2e48572cf1 tempest-VolumesCloneTest-522778170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc1d49a9-979d-4b40-b437-6e8c6aa313ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:38:28 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-107417ad-6c1f-417d-9e94-5f2e48572cf1 tempest-VolumesCloneTest-522778170 None] Volume a1c5fc84-5171-48af-b674-3d404849ac2c: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-a1c5fc84-5171-48af-b674-3d404849ac2c', 'volume_size': 2, 'source_volid': '4bc0e2be-a83b-42ed-845c-83cf47207c47', 'source_volstatus': 'available'} Sep 18 21:38:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-107417ad-6c1f-417d-9e94-5f2e48572cf1 tempest-VolumesCloneTest-522778170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:38:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-107417ad-6c1f-417d-9e94-5f2e48572cf1 tempest-VolumesCloneTest-522778170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:38:28 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-107417ad-6c1f-417d-9e94-5f2e48572cf1 tempest-VolumesCloneTest-522778170 None] Cloning volume 4bc0e2be-a83b-42ed-845c-83cf47207c47 to volume a1c5fc84-5171-48af-b674-3d404849ac2c Sep 18 21:38:28 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-107417ad-6c1f-417d-9e94-5f2e48572cf1 tempest-VolumesCloneTest-522778170 None] Creating offline snapshot 1e017835-02e2-4729-b59d-431539210553 of volume 4bc0e2be-a83b-42ed-845c-83cf47207c47 {{(pid=86136) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 21:38:28 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d0c53d-ad6b-41ca-bd29-0552d384d348]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:38:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-107417ad-6c1f-417d-9e94-5f2e48572cf1 tempest-VolumesCloneTest-522778170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4bc0e2be-a83b-42ed-845c-83cf47207c47 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:38:28 devstack sudo[93531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4bc0e2be-a83b-42ed-845c-83cf47207c47 Sep 18 21:38:28 devstack sudo[93531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:38:29 devstack sudo[93531]: pam_unix(sudo:session): session closed for user root Sep 18 21:38:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-107417ad-6c1f-417d-9e94-5f2e48572cf1 tempest-VolumesCloneTest-522778170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4bc0e2be-a83b-42ed-845c-83cf47207c47" returned: 0 in 0.518s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:38:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-107417ad-6c1f-417d-9e94-5f2e48572cf1 tempest-VolumesCloneTest-522778170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4bc0e2be-a83b-42ed-845c-83cf47207c47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4bc0e2be-a83b-42ed-845c-83cf47207c47.1e017835-02e2-4729-b59d-431539210553 1G {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:38:29 devstack sudo[93538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4bc0e2be-a83b-42ed-845c-83cf47207c47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4bc0e2be-a83b-42ed-845c-83cf47207c47.1e017835-02e2-4729-b59d-431539210553 1G Sep 18 21:38:29 devstack sudo[93538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:38:30 devstack sudo[93538]: pam_unix(sudo:session): session closed for user root Sep 18 21:38:30 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-107417ad-6c1f-417d-9e94-5f2e48572cf1 tempest-VolumesCloneTest-522778170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4bc0e2be-a83b-42ed-845c-83cf47207c47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4bc0e2be-a83b-42ed-845c-83cf47207c47.1e017835-02e2-4729-b59d-431539210553 1G" returned: 0 in 0.904s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:38:30 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-107417ad-6c1f-417d-9e94-5f2e48572cf1 tempest-VolumesCloneTest-522778170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bc0e2be-a83b-42ed-845c-83cf47207c47 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4bc0e2be-a83b-42ed-845c-83cf47207c47.1e017835-02e2-4729-b59d-431539210553 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:38:30 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-4be35ca9-9213-463d-a35e-c128be8b5b46 tempest-AttachVolumeTestJSON-1287281091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:38:30 devstack sudo[93547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bc0e2be-a83b-42ed-845c-83cf47207c47 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4bc0e2be-a83b-42ed-845c-83cf47207c47.1e017835-02e2-4729-b59d-431539210553 Sep 18 21:38:30 devstack sudo[93547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:38:30 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-4be35ca9-9213-463d-a35e-c128be8b5b46 tempest-AttachVolumeTestJSON-1287281091 None] Flow 'volume_create_manager' (737952f9-10c9-41b2-8543-5cf49063b39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:38:30 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-4be35ca9-9213-463d-a35e-c128be8b5b46 tempest-AttachVolumeTestJSON-1287281091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54497066-ba2a-43a1-adc1-a94a4f6d557c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:38:30 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-4be35ca9-9213-463d-a35e-c128be8b5b46 tempest-AttachVolumeTestJSON-1287281091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54497066-ba2a-43a1-adc1-a94a4f6d557c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:38:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-786664119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce85900b-879a-44fb-997e-4758a0aab7f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79bcd1aa64ac4dff810185818cb31273',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:38:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:38:30Z,use_quota=True,user_id='d10943648fea4421b3587860331c232b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:38:30 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-4be35ca9-9213-463d-a35e-c128be8b5b46 tempest-AttachVolumeTestJSON-1287281091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89df3e60-9ff5-4aec-b4dc-cff5d2e91d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:38:30 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-4be35ca9-9213-463d-a35e-c128be8b5b46 tempest-AttachVolumeTestJSON-1287281091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89df3e60-9ff5-4aec-b4dc-cff5d2e91d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:38:30 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-4be35ca9-9213-463d-a35e-c128be8b5b46 tempest-AttachVolumeTestJSON-1287281091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6951ef81-c0f3-4133-8aab-996d71aa8f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:38:30 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-4be35ca9-9213-463d-a35e-c128be8b5b46 tempest-AttachVolumeTestJSON-1287281091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6951ef81-c0f3-4133-8aab-996d71aa8f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce85900b-879a-44fb-997e-4758a0aab7f5', 'volume_name': 'volume-ce85900b-879a-44fb-997e-4758a0aab7f5', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:38:30 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-4be35ca9-9213-463d-a35e-c128be8b5b46 tempest-AttachVolumeTestJSON-1287281091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13601369-d6c8-486e-b399-e3c1a50f1cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:38:30 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-4be35ca9-9213-463d-a35e-c128be8b5b46 tempest-AttachVolumeTestJSON-1287281091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13601369-d6c8-486e-b399-e3c1a50f1cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:38:30 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-4be35ca9-9213-463d-a35e-c128be8b5b46 tempest-AttachVolumeTestJSON-1287281091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f915c72a-ce54-43b2-9e7d-ae1fe4bb74cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:38:30 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-4be35ca9-9213-463d-a35e-c128be8b5b46 tempest-AttachVolumeTestJSON-1287281091 None] Volume ce85900b-879a-44fb-997e-4758a0aab7f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce85900b-879a-44fb-997e-4758a0aab7f5', 'volume_size': 1} Sep 18 21:38:30 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-4be35ca9-9213-463d-a35e-c128be8b5b46 tempest-AttachVolumeTestJSON-1287281091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:38:30 devstack sudo[93547]: pam_unix(sudo:session): session closed for user root Sep 18 21:38:30 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-107417ad-6c1f-417d-9e94-5f2e48572cf1 tempest-VolumesCloneTest-522778170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bc0e2be-a83b-42ed-845c-83cf47207c47 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4bc0e2be-a83b-42ed-845c-83cf47207c47.1e017835-02e2-4729-b59d-431539210553" returned: 0 in 0.520s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:38:30 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-107417ad-6c1f-417d-9e94-5f2e48572cf1 tempest-VolumesCloneTest-522778170 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4bc0e2be-a83b-42ed-845c-83cf47207c47.1e017835-02e2-4729-b59d-431539210553 is being set with open permissions: ugo+rw Sep 18 21:38:30 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-107417ad-6c1f-417d-9e94-5f2e48572cf1 tempest-VolumesCloneTest-522778170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4bc0e2be-a83b-42ed-845c-83cf47207c47.1e017835-02e2-4729-b59d-431539210553 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:38:30 devstack sudo[93553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4bc0e2be-a83b-42ed-845c-83cf47207c47.1e017835-02e2-4729-b59d-431539210553 Sep 18 21:38:30 devstack sudo[93553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:38:31 devstack sudo[93553]: pam_unix(sudo:session): session closed for user root Sep 18 21:38:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-107417ad-6c1f-417d-9e94-5f2e48572cf1 tempest-VolumesCloneTest-522778170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4bc0e2be-a83b-42ed-845c-83cf47207c47.1e017835-02e2-4729-b59d-431539210553" returned: 0 in 0.509s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:38:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-107417ad-6c1f-417d-9e94-5f2e48572cf1 tempest-VolumesCloneTest-522778170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4bc0e2be-a83b-42ed-845c-83cf47207c47.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:38:31 devstack sudo[93556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4bc0e2be-a83b-42ed-845c-83cf47207c47.info Sep 18 21:38:31 devstack sudo[93556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:38:31 devstack sudo[93556]: pam_unix(sudo:session): session closed for user root Sep 18 21:38:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-107417ad-6c1f-417d-9e94-5f2e48572cf1 tempest-VolumesCloneTest-522778170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4bc0e2be-a83b-42ed-845c-83cf47207c47.info" returned: 0 in 0.483s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:38:31 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-107417ad-6c1f-417d-9e94-5f2e48572cf1 tempest-VolumesCloneTest-522778170 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4bc0e2be-a83b-42ed-845c-83cf47207c47.info is being set with open permissions: ugo+rw Sep 18 21:38:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-107417ad-6c1f-417d-9e94-5f2e48572cf1 tempest-VolumesCloneTest-522778170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4bc0e2be-a83b-42ed-845c-83cf47207c47.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:38:31 devstack sudo[93559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4bc0e2be-a83b-42ed-845c-83cf47207c47.info Sep 18 21:38:31 devstack sudo[93559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:38:32 devstack sudo[93559]: pam_unix(sudo:session): session closed for user root Sep 18 21:38:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-107417ad-6c1f-417d-9e94-5f2e48572cf1 tempest-VolumesCloneTest-522778170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4bc0e2be-a83b-42ed-845c-83cf47207c47.info" returned: 0 in 0.402s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:38:32 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-107417ad-6c1f-417d-9e94-5f2e48572cf1 tempest-VolumesCloneTest-522778170 None] Acquiring lock "cinder-quobyte-a1c5fc84-5171-48af-b674-3d404849ac2c" by "_copy_volume_from_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:38:32 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-107417ad-6c1f-417d-9e94-5f2e48572cf1 tempest-VolumesCloneTest-522778170 None] Lock "cinder-quobyte-a1c5fc84-5171-48af-b674-3d404849ac2c" acquired by "_copy_volume_from_snapshot" :: waited 0.040s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:38:32 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-107417ad-6c1f-417d-9e94-5f2e48572cf1 tempest-VolumesCloneTest-522778170 None] snapshot: 1e017835-02e2-4729-b59d-431539210553, volume: a1c5fc84-5171-48af-b674-3d404849ac2c, {{(pid=86136) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 18 21:38:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-107417ad-6c1f-417d-9e94-5f2e48572cf1 tempest-VolumesCloneTest-522778170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:38:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-107417ad-6c1f-417d-9e94-5f2e48572cf1 tempest-VolumesCloneTest-522778170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:38:32 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-107417ad-6c1f-417d-9e94-5f2e48572cf1 tempest-VolumesCloneTest-522778170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:38:32 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-107417ad-6c1f-417d-9e94-5f2e48572cf1 tempest-VolumesCloneTest-522778170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:38:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-107417ad-6c1f-417d-9e94-5f2e48572cf1 tempest-VolumesCloneTest-522778170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:38:32 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f1cdb8-85f1-4064-8a7b-25cfa0e5b98e]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:38:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-107417ad-6c1f-417d-9e94-5f2e48572cf1 tempest-VolumesCloneTest-522778170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4bc0e2be-a83b-42ed-845c-83cf47207c47.1e017835-02e2-4729-b59d-431539210553 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:38:32 devstack sudo[93562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4bc0e2be-a83b-42ed-845c-83cf47207c47.1e017835-02e2-4729-b59d-431539210553 Sep 18 21:38:32 devstack sudo[93562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:38:32 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfb20e97-466d-4b66-83c4-d1dc0d9dd905 tempest-ServerRescueNegativeTestJSON-959409164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:38:32 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-dfb20e97-466d-4b66-83c4-d1dc0d9dd905 tempest-ServerRescueNegativeTestJSON-959409164 None] Flow 'volume_create_manager' (41d8a18d-d929-4f87-9d89-2b761b354172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:38:32 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-dfb20e97-466d-4b66-83c4-d1dc0d9dd905 tempest-ServerRescueNegativeTestJSON-959409164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12e81564-2f17-400c-bf81-760f65b36ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:38:32 devstack sudo[93562]: pam_unix(sudo:session): session closed for user root Sep 18 21:38:32 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-dfb20e97-466d-4b66-83c4-d1dc0d9dd905 tempest-ServerRescueNegativeTestJSON-959409164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12e81564-2f17-400c-bf81-760f65b36ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:38:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2050591049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=094a1cd3-8a22-4204-95d4-3ddb93798f8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d40211f09b6547a8891cd304aee8244b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:38:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:38:33Z,use_quota=True,user_id='bba39af80a0d42eab8feb444c2708b72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:38:32 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-dfb20e97-466d-4b66-83c4-d1dc0d9dd905 tempest-ServerRescueNegativeTestJSON-959409164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0afe6add-b85f-4276-86de-bbf7f7ea6daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:38:32 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-dfb20e97-466d-4b66-83c4-d1dc0d9dd905 tempest-ServerRescueNegativeTestJSON-959409164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0afe6add-b85f-4276-86de-bbf7f7ea6daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:38:32 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-dfb20e97-466d-4b66-83c4-d1dc0d9dd905 tempest-ServerRescueNegativeTestJSON-959409164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6c58a5c-d342-41e8-8e47-88827aebb9d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:38:32 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-dfb20e97-466d-4b66-83c4-d1dc0d9dd905 tempest-ServerRescueNegativeTestJSON-959409164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6c58a5c-d342-41e8-8e47-88827aebb9d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '094a1cd3-8a22-4204-95d4-3ddb93798f8d', 'volume_name': 'volume-094a1cd3-8a22-4204-95d4-3ddb93798f8d', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:38:32 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-dfb20e97-466d-4b66-83c4-d1dc0d9dd905 tempest-ServerRescueNegativeTestJSON-959409164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92fc2809-c867-43ea-bfd5-7fa0a1955152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:38:32 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-dfb20e97-466d-4b66-83c4-d1dc0d9dd905 tempest-ServerRescueNegativeTestJSON-959409164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92fc2809-c867-43ea-bfd5-7fa0a1955152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:38:32 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-dfb20e97-466d-4b66-83c4-d1dc0d9dd905 tempest-ServerRescueNegativeTestJSON-959409164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82cff375-13f0-405f-9481-8cb95da1ebc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:38:32 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-dfb20e97-466d-4b66-83c4-d1dc0d9dd905 tempest-ServerRescueNegativeTestJSON-959409164 None] Volume 094a1cd3-8a22-4204-95d4-3ddb93798f8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-094a1cd3-8a22-4204-95d4-3ddb93798f8d', 'volume_size': 1} Sep 18 21:38:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-dfb20e97-466d-4b66-83c4-d1dc0d9dd905 tempest-ServerRescueNegativeTestJSON-959409164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:38:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-107417ad-6c1f-417d-9e94-5f2e48572cf1 tempest-VolumesCloneTest-522778170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4bc0e2be-a83b-42ed-845c-83cf47207c47.1e017835-02e2-4729-b59d-431539210553" returned: 0 in 0.668s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:38:32 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-107417ad-6c1f-417d-9e94-5f2e48572cf1 tempest-VolumesCloneTest-522778170 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4bc0e2be-a83b-42ed-845c-83cf47207c47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86136) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 21:38:32 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6697301-864d-4bf8-aeb1-f6d5385a4610]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:38:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-107417ad-6c1f-417d-9e94-5f2e48572cf1 tempest-VolumesCloneTest-522778170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4bc0e2be-a83b-42ed-845c-83cf47207c47 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:38:33 devstack sudo[93568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4bc0e2be-a83b-42ed-845c-83cf47207c47 Sep 18 21:38:33 devstack sudo[93568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:38:33 devstack sudo[93568]: pam_unix(sudo:session): session closed for user root Sep 18 21:38:33 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-107417ad-6c1f-417d-9e94-5f2e48572cf1 tempest-VolumesCloneTest-522778170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4bc0e2be-a83b-42ed-845c-83cf47207c47" returned: 0 in 0.527s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:38:33 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-107417ad-6c1f-417d-9e94-5f2e48572cf1 tempest-VolumesCloneTest-522778170 None] will copy from snapshot at /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4bc0e2be-a83b-42ed-845c-83cf47207c47 {{(pid=86136) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 18 21:38:33 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-107417ad-6c1f-417d-9e94-5f2e48572cf1 tempest-VolumesCloneTest-522778170 None] Creating direct copy from snapshot {{(pid=86136) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 18 21:38:33 devstack cinder-volume[86136]: DEBUG cinder.utils [None req-107417ad-6c1f-417d-9e94-5f2e48572cf1 tempest-VolumesCloneTest-522778170 None] Path /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a1c5fc84-5171-48af-b674-3d404849ac2c not found in is_blk_device check {{(pid=86136) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 18 21:38:33 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-107417ad-6c1f-417d-9e94-5f2e48572cf1 tempest-VolumesCloneTest-522778170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4bc0e2be-a83b-42ed-845c-83cf47207c47 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a1c5fc84-5171-48af-b674-3d404849ac2c {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:38:33 devstack sudo[93573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4bc0e2be-a83b-42ed-845c-83cf47207c47 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a1c5fc84-5171-48af-b674-3d404849ac2c Sep 18 21:38:33 devstack sudo[93573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:38:42 devstack cinder-volume[86136]: DEBUG dbcounter [-] [86136] Writing DB stats cinder:SELECT=33,cinder:INSERT=5,cinder:UPDATE=25,cinder:DELETE=1 {{(pid=86136) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 21:38:42 devstack cinder-volume[86136]: DEBUG dbcounter [-] [86136] Writing DB stats cinder:SELECT=20,cinder:INSERT=7,cinder:UPDATE=31,cinder:DELETE=3 {{(pid=86136) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 21:38:43 devstack sudo[93573]: pam_unix(sudo:session): session closed for user root Sep 18 21:38:43 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-107417ad-6c1f-417d-9e94-5f2e48572cf1 tempest-VolumesCloneTest-522778170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4bc0e2be-a83b-42ed-845c-83cf47207c47 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a1c5fc84-5171-48af-b674-3d404849ac2c" returned: 0 in 10.325s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:38:43 devstack cinder-volume[86136]: DEBUG cinder.image.image_utils [None req-107417ad-6c1f-417d-9e94-5f2e48572cf1 tempest-VolumesCloneTest-522778170 None] Image conversion details: src /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4bc0e2be-a83b-42ed-845c-83cf47207c47, size 1024.00 MB, duration 10.33 sec, destination /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a1c5fc84-5171-48af-b674-3d404849ac2c {{(pid=86136) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 18 21:38:43 devstack cinder-volume[86136]: INFO cinder.image.image_utils [None req-107417ad-6c1f-417d-9e94-5f2e48572cf1 tempest-VolumesCloneTest-522778170 None] Converted 1024.00 MB image at 99.17 MB/s Sep 18 21:38:43 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-107417ad-6c1f-417d-9e94-5f2e48572cf1 tempest-VolumesCloneTest-522778170 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a1c5fc84-5171-48af-b674-3d404849ac2c is being set with open permissions: ugo+rw Sep 18 21:38:43 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-107417ad-6c1f-417d-9e94-5f2e48572cf1 tempest-VolumesCloneTest-522778170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a1c5fc84-5171-48af-b674-3d404849ac2c {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:38:43 devstack sudo[93614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a1c5fc84-5171-48af-b674-3d404849ac2c Sep 18 21:38:43 devstack sudo[93614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:38:44 devstack sudo[93614]: pam_unix(sudo:session): session closed for user root Sep 18 21:38:44 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-107417ad-6c1f-417d-9e94-5f2e48572cf1 tempest-VolumesCloneTest-522778170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a1c5fc84-5171-48af-b674-3d404849ac2c" returned: 0 in 0.342s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:38:44 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-107417ad-6c1f-417d-9e94-5f2e48572cf1 tempest-VolumesCloneTest-522778170 None] Lock "cinder-quobyte-a1c5fc84-5171-48af-b674-3d404849ac2c" released by "_copy_volume_from_snapshot" :: held 12.024s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:38:44 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-107417ad-6c1f-417d-9e94-5f2e48572cf1 tempest-VolumesCloneTest-522778170 None] Acquiring lock "cinder-quobyte-1e017835-02e2-4729-b59d-431539210553" by "_delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:38:44 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-107417ad-6c1f-417d-9e94-5f2e48572cf1 tempest-VolumesCloneTest-522778170 None] Lock "cinder-quobyte-1e017835-02e2-4729-b59d-431539210553" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:38:44 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-107417ad-6c1f-417d-9e94-5f2e48572cf1 tempest-VolumesCloneTest-522778170 None] Deleting offline snapshot 1e017835-02e2-4729-b59d-431539210553 of volume 4bc0e2be-a83b-42ed-845c-83cf47207c47 {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 21:38:44 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-107417ad-6c1f-417d-9e94-5f2e48572cf1 tempest-VolumesCloneTest-522778170 None] snapshot_file for this snap is: volume-4bc0e2be-a83b-42ed-845c-83cf47207c47.1e017835-02e2-4729-b59d-431539210553 {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 21:38:44 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[45cc80da-5755-44b0-9351-7fd1bdd3d28c]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:38:44 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-107417ad-6c1f-417d-9e94-5f2e48572cf1 tempest-VolumesCloneTest-522778170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4bc0e2be-a83b-42ed-845c-83cf47207c47.1e017835-02e2-4729-b59d-431539210553 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:38:44 devstack sudo[93623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4bc0e2be-a83b-42ed-845c-83cf47207c47.1e017835-02e2-4729-b59d-431539210553 Sep 18 21:38:44 devstack sudo[93623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:38:44 devstack sudo[93623]: pam_unix(sudo:session): session closed for user root Sep 18 21:38:44 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-107417ad-6c1f-417d-9e94-5f2e48572cf1 tempest-VolumesCloneTest-522778170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4bc0e2be-a83b-42ed-845c-83cf47207c47.1e017835-02e2-4729-b59d-431539210553" returned: 0 in 0.470s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:38:44 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-107417ad-6c1f-417d-9e94-5f2e48572cf1 tempest-VolumesCloneTest-522778170 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4bc0e2be-a83b-42ed-845c-83cf47207c47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86136) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 21:38:44 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c70e8b-c9a9-4590-ae7a-73861be1da9c]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:38:44 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-107417ad-6c1f-417d-9e94-5f2e48572cf1 tempest-VolumesCloneTest-522778170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4bc0e2be-a83b-42ed-845c-83cf47207c47 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:38:45 devstack sudo[93637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4bc0e2be-a83b-42ed-845c-83cf47207c47 Sep 18 21:38:45 devstack sudo[93637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:38:45 devstack sudo[93637]: pam_unix(sudo:session): session closed for user root Sep 18 21:38:45 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-107417ad-6c1f-417d-9e94-5f2e48572cf1 tempest-VolumesCloneTest-522778170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4bc0e2be-a83b-42ed-845c-83cf47207c47" returned: 0 in 0.658s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:38:45 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-107417ad-6c1f-417d-9e94-5f2e48572cf1 tempest-VolumesCloneTest-522778170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4bc0e2be-a83b-42ed-845c-83cf47207c47.1e017835-02e2-4729-b59d-431539210553 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:38:45 devstack sudo[93642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4bc0e2be-a83b-42ed-845c-83cf47207c47.1e017835-02e2-4729-b59d-431539210553 Sep 18 21:38:45 devstack sudo[93642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:38:45 devstack sudo[93642]: pam_unix(sudo:session): session closed for user root Sep 18 21:38:45 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-107417ad-6c1f-417d-9e94-5f2e48572cf1 tempest-VolumesCloneTest-522778170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4bc0e2be-a83b-42ed-845c-83cf47207c47.1e017835-02e2-4729-b59d-431539210553" returned: 0 in 0.372s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:38:45 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-107417ad-6c1f-417d-9e94-5f2e48572cf1 tempest-VolumesCloneTest-522778170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4bc0e2be-a83b-42ed-845c-83cf47207c47.1e017835-02e2-4729-b59d-431539210553 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:38:45 devstack sudo[93647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4bc0e2be-a83b-42ed-845c-83cf47207c47.1e017835-02e2-4729-b59d-431539210553 Sep 18 21:38:45 devstack sudo[93647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:38:46 devstack sudo[93647]: pam_unix(sudo:session): session closed for user root Sep 18 21:38:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-107417ad-6c1f-417d-9e94-5f2e48572cf1 tempest-VolumesCloneTest-522778170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4bc0e2be-a83b-42ed-845c-83cf47207c47.1e017835-02e2-4729-b59d-431539210553" returned: 0 in 0.272s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:38:46 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-107417ad-6c1f-417d-9e94-5f2e48572cf1 tempest-VolumesCloneTest-522778170 None] Lock "cinder-quobyte-1e017835-02e2-4729-b59d-431539210553" released by "_delete_snapshot" :: held 1.911s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:38:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-107417ad-6c1f-417d-9e94-5f2e48572cf1 tempest-VolumesCloneTest-522778170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.617s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:38:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-4be35ca9-9213-463d-a35e-c128be8b5b46 tempest-AttachVolumeTestJSON-1287281091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.911s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:38:46 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-4be35ca9-9213-463d-a35e-c128be8b5b46 tempest-AttachVolumeTestJSON-1287281091 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:38:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-786664119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce85900b-879a-44fb-997e-4758a0aab7f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79bcd1aa64ac4dff810185818cb31273',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:38:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:38:30Z,use_quota=True,user_id='d10943648fea4421b3587860331c232b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:38:46 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-4be35ca9-9213-463d-a35e-c128be8b5b46 tempest-AttachVolumeTestJSON-1287281091 None] Creating volume ce85900b-879a-44fb-997e-4758a0aab7f5 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:38:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-4be35ca9-9213-463d-a35e-c128be8b5b46 tempest-AttachVolumeTestJSON-1287281091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:38:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-4be35ca9-9213-463d-a35e-c128be8b5b46 tempest-AttachVolumeTestJSON-1287281091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:38:46 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-4be35ca9-9213-463d-a35e-c128be8b5b46 tempest-AttachVolumeTestJSON-1287281091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:38:46 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-4be35ca9-9213-463d-a35e-c128be8b5b46 tempest-AttachVolumeTestJSON-1287281091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:38:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-4be35ca9-9213-463d-a35e-c128be8b5b46 tempest-AttachVolumeTestJSON-1287281091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:38:46 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-4be35ca9-9213-463d-a35e-c128be8b5b46 tempest-AttachVolumeTestJSON-1287281091 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:38:46 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-4be35ca9-9213-463d-a35e-c128be8b5b46 tempest-AttachVolumeTestJSON-1287281091 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:38:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-4be35ca9-9213-463d-a35e-c128be8b5b46 tempest-AttachVolumeTestJSON-1287281091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ce85900b-879a-44fb-997e-4758a0aab7f5 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:38:46 devstack sudo[93650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ce85900b-879a-44fb-997e-4758a0aab7f5 1073741824 Sep 18 21:38:46 devstack sudo[93650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:38:46 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-107417ad-6c1f-417d-9e94-5f2e48572cf1 tempest-VolumesCloneTest-522778170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc1d49a9-979d-4b40-b437-6e8c6aa313ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1c5fc84-5171-48af-b674-3d404849ac2c', 'volume_size': 2, 'source_volid': '4bc0e2be-a83b-42ed-845c-83cf47207c47', 'source_volstatus': 'available'}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:38:46 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-107417ad-6c1f-417d-9e94-5f2e48572cf1 tempest-VolumesCloneTest-522778170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc10810c-b378-46c6-9744-5296f6a2b17d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:38:46 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-107417ad-6c1f-417d-9e94-5f2e48572cf1 tempest-VolumesCloneTest-522778170 None] Volume volume-a1c5fc84-5171-48af-b674-3d404849ac2c (a1c5fc84-5171-48af-b674-3d404849ac2c): created successfully Sep 18 21:38:46 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-107417ad-6c1f-417d-9e94-5f2e48572cf1 tempest-VolumesCloneTest-522778170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc10810c-b378-46c6-9744-5296f6a2b17d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:38:46 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-107417ad-6c1f-417d-9e94-5f2e48572cf1 tempest-VolumesCloneTest-522778170 None] Flow 'volume_create_manager' (662a107c-87b4-48dd-8f75-63ed915716a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:38:46 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-107417ad-6c1f-417d-9e94-5f2e48572cf1 tempest-VolumesCloneTest-522778170 None] Created volume successfully. Sep 18 21:38:46 devstack sudo[93650]: pam_unix(sudo:session): session closed for user root Sep 18 21:38:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-4be35ca9-9213-463d-a35e-c128be8b5b46 tempest-AttachVolumeTestJSON-1287281091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ce85900b-879a-44fb-997e-4758a0aab7f5 1073741824" returned: 0 in 0.562s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:38:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-4be35ca9-9213-463d-a35e-c128be8b5b46 tempest-AttachVolumeTestJSON-1287281091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ce85900b-879a-44fb-997e-4758a0aab7f5 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:38:46 devstack sudo[93657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ce85900b-879a-44fb-997e-4758a0aab7f5 Sep 18 21:38:46 devstack sudo[93657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:38:46 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d2503df5-f050-4c27-87a6-9dbed7a635c6 tempest-VolumesCloneTest-522778170 None] Acquiring lock "cinder-a1c5fc84-5171-48af-b674-3d404849ac2c-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:38:47 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d2503df5-f050-4c27-87a6-9dbed7a635c6 tempest-VolumesCloneTest-522778170 None] Lock "cinder-a1c5fc84-5171-48af-b674-3d404849ac2c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:38:47 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d2503df5-f050-4c27-87a6-9dbed7a635c6 tempest-VolumesCloneTest-522778170 None] Acquiring lock "cinder-quobyte-a1c5fc84-5171-48af-b674-3d404849ac2c" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:38:47 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d2503df5-f050-4c27-87a6-9dbed7a635c6 tempest-VolumesCloneTest-522778170 None] Lock "cinder-quobyte-a1c5fc84-5171-48af-b674-3d404849ac2c" acquired by "delete_volume" :: waited 0.017s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:38:47 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[c620d5c3-2809-4fa9-a16c-83fa295c865c]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:38:47 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d2503df5-f050-4c27-87a6-9dbed7a635c6 tempest-VolumesCloneTest-522778170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a1c5fc84-5171-48af-b674-3d404849ac2c {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:38:47 devstack sudo[93657]: pam_unix(sudo:session): session closed for user root Sep 18 21:38:47 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-4be35ca9-9213-463d-a35e-c128be8b5b46 tempest-AttachVolumeTestJSON-1287281091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ce85900b-879a-44fb-997e-4758a0aab7f5" returned: 0 in 0.287s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:38:47 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-4be35ca9-9213-463d-a35e-c128be8b5b46 tempest-AttachVolumeTestJSON-1287281091 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:38:47 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-4be35ca9-9213-463d-a35e-c128be8b5b46 tempest-AttachVolumeTestJSON-1287281091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:38:47 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-dfb20e97-466d-4b66-83c4-d1dc0d9dd905 tempest-ServerRescueNegativeTestJSON-959409164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.188s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:38:47 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-dfb20e97-466d-4b66-83c4-d1dc0d9dd905 tempest-ServerRescueNegativeTestJSON-959409164 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:38:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2050591049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=094a1cd3-8a22-4204-95d4-3ddb93798f8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d40211f09b6547a8891cd304aee8244b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:38:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:38:33Z,use_quota=True,user_id='bba39af80a0d42eab8feb444c2708b72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:38:47 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-dfb20e97-466d-4b66-83c4-d1dc0d9dd905 tempest-ServerRescueNegativeTestJSON-959409164 None] Creating volume 094a1cd3-8a22-4204-95d4-3ddb93798f8d {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:38:47 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-dfb20e97-466d-4b66-83c4-d1dc0d9dd905 tempest-ServerRescueNegativeTestJSON-959409164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:38:47 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-dfb20e97-466d-4b66-83c4-d1dc0d9dd905 tempest-ServerRescueNegativeTestJSON-959409164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:38:47 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-dfb20e97-466d-4b66-83c4-d1dc0d9dd905 tempest-ServerRescueNegativeTestJSON-959409164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:38:47 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-dfb20e97-466d-4b66-83c4-d1dc0d9dd905 tempest-ServerRescueNegativeTestJSON-959409164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:38:47 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-dfb20e97-466d-4b66-83c4-d1dc0d9dd905 tempest-ServerRescueNegativeTestJSON-959409164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:38:47 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-dfb20e97-466d-4b66-83c4-d1dc0d9dd905 tempest-ServerRescueNegativeTestJSON-959409164 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:38:47 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-dfb20e97-466d-4b66-83c4-d1dc0d9dd905 tempest-ServerRescueNegativeTestJSON-959409164 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:38:47 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-dfb20e97-466d-4b66-83c4-d1dc0d9dd905 tempest-ServerRescueNegativeTestJSON-959409164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-094a1cd3-8a22-4204-95d4-3ddb93798f8d 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:38:47 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-4be35ca9-9213-463d-a35e-c128be8b5b46 tempest-AttachVolumeTestJSON-1287281091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f915c72a-ce54-43b2-9e7d-ae1fe4bb74cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce85900b-879a-44fb-997e-4758a0aab7f5', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:38:47 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-4be35ca9-9213-463d-a35e-c128be8b5b46 tempest-AttachVolumeTestJSON-1287281091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84fbb650-ee44-4d0c-bf64-276cbe99903b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:38:47 devstack sudo[93661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-094a1cd3-8a22-4204-95d4-3ddb93798f8d 1073741824 Sep 18 21:38:47 devstack sudo[93661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:38:47 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-4be35ca9-9213-463d-a35e-c128be8b5b46 tempest-AttachVolumeTestJSON-1287281091 None] Volume volume-ce85900b-879a-44fb-997e-4758a0aab7f5 (ce85900b-879a-44fb-997e-4758a0aab7f5): created successfully Sep 18 21:38:47 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-4be35ca9-9213-463d-a35e-c128be8b5b46 tempest-AttachVolumeTestJSON-1287281091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84fbb650-ee44-4d0c-bf64-276cbe99903b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:38:47 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-4be35ca9-9213-463d-a35e-c128be8b5b46 tempest-AttachVolumeTestJSON-1287281091 None] Flow 'volume_create_manager' (737952f9-10c9-41b2-8543-5cf49063b39b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:38:47 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-4be35ca9-9213-463d-a35e-c128be8b5b46 tempest-AttachVolumeTestJSON-1287281091 None] Created volume successfully. Sep 18 21:38:47 devstack sudo[93660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a1c5fc84-5171-48af-b674-3d404849ac2c Sep 18 21:38:47 devstack sudo[93660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:38:47 devstack sudo[93660]: pam_unix(sudo:session): session closed for user root Sep 18 21:38:47 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d2503df5-f050-4c27-87a6-9dbed7a635c6 tempest-VolumesCloneTest-522778170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a1c5fc84-5171-48af-b674-3d404849ac2c" returned: 0 in 0.411s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:38:47 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d2503df5-f050-4c27-87a6-9dbed7a635c6 tempest-VolumesCloneTest-522778170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a1c5fc84-5171-48af-b674-3d404849ac2c {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:38:47 devstack sudo[93672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a1c5fc84-5171-48af-b674-3d404849ac2c Sep 18 21:38:47 devstack sudo[93672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:38:47 devstack sudo[93661]: pam_unix(sudo:session): session closed for user root Sep 18 21:38:47 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-dfb20e97-466d-4b66-83c4-d1dc0d9dd905 tempest-ServerRescueNegativeTestJSON-959409164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-094a1cd3-8a22-4204-95d4-3ddb93798f8d 1073741824" returned: 0 in 0.524s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:38:47 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-dfb20e97-466d-4b66-83c4-d1dc0d9dd905 tempest-ServerRescueNegativeTestJSON-959409164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-094a1cd3-8a22-4204-95d4-3ddb93798f8d {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:38:47 devstack sudo[93674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-094a1cd3-8a22-4204-95d4-3ddb93798f8d Sep 18 21:38:47 devstack sudo[93674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:38:47 devstack sudo[93672]: pam_unix(sudo:session): session closed for user root Sep 18 21:38:47 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d2503df5-f050-4c27-87a6-9dbed7a635c6 tempest-VolumesCloneTest-522778170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a1c5fc84-5171-48af-b674-3d404849ac2c" returned: 0 in 0.299s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:38:47 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d2503df5-f050-4c27-87a6-9dbed7a635c6 tempest-VolumesCloneTest-522778170 None] Lock "cinder-quobyte-a1c5fc84-5171-48af-b674-3d404849ac2c" released by "delete_volume" :: held 0.779s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:38:47 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-d2503df5-f050-4c27-87a6-9dbed7a635c6 tempest-VolumesCloneTest-522778170 None] Created reservations ['24ba0268-8c60-442e-a62f-9ac8900cdd41', '3b7ab2ea-b60a-4c20-9a47-b79a8ee06d59', '2892ff82-361f-48fc-9493-62c3cd6d27d7', '7df64092-fc51-4492-afa6-52d2401d3342'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:38:47 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-d2503df5-f050-4c27-87a6-9dbed7a635c6 tempest-VolumesCloneTest-522778170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:38:47 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-d2503df5-f050-4c27-87a6-9dbed7a635c6 tempest-VolumesCloneTest-522778170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:38:47 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-d2503df5-f050-4c27-87a6-9dbed7a635c6 tempest-VolumesCloneTest-522778170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:38:47 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-d2503df5-f050-4c27-87a6-9dbed7a635c6 tempest-VolumesCloneTest-522778170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:38:47 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-d2503df5-f050-4c27-87a6-9dbed7a635c6 tempest-VolumesCloneTest-522778170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:38:47 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d2503df5-f050-4c27-87a6-9dbed7a635c6 tempest-VolumesCloneTest-522778170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:38:48 devstack sudo[93674]: pam_unix(sudo:session): session closed for user root Sep 18 21:38:48 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-dfb20e97-466d-4b66-83c4-d1dc0d9dd905 tempest-ServerRescueNegativeTestJSON-959409164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-094a1cd3-8a22-4204-95d4-3ddb93798f8d" returned: 0 in 0.297s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:38:48 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-dfb20e97-466d-4b66-83c4-d1dc0d9dd905 tempest-ServerRescueNegativeTestJSON-959409164 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:38:48 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-dfb20e97-466d-4b66-83c4-d1dc0d9dd905 tempest-ServerRescueNegativeTestJSON-959409164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:38:48 devstack sudo[93678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:38:48 devstack sudo[93678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:38:48 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-dfb20e97-466d-4b66-83c4-d1dc0d9dd905 tempest-ServerRescueNegativeTestJSON-959409164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82cff375-13f0-405f-9481-8cb95da1ebc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-094a1cd3-8a22-4204-95d4-3ddb93798f8d', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:38:48 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-dfb20e97-466d-4b66-83c4-d1dc0d9dd905 tempest-ServerRescueNegativeTestJSON-959409164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9b031c8-c6e7-4442-86f5-a090d5902e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:38:48 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-dfb20e97-466d-4b66-83c4-d1dc0d9dd905 tempest-ServerRescueNegativeTestJSON-959409164 None] Volume volume-094a1cd3-8a22-4204-95d4-3ddb93798f8d (094a1cd3-8a22-4204-95d4-3ddb93798f8d): created successfully Sep 18 21:38:48 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-dfb20e97-466d-4b66-83c4-d1dc0d9dd905 tempest-ServerRescueNegativeTestJSON-959409164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9b031c8-c6e7-4442-86f5-a090d5902e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:38:48 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-dfb20e97-466d-4b66-83c4-d1dc0d9dd905 tempest-ServerRescueNegativeTestJSON-959409164 None] Flow 'volume_create_manager' (41d8a18d-d929-4f87-9d89-2b761b354172) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:38:48 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-dfb20e97-466d-4b66-83c4-d1dc0d9dd905 tempest-ServerRescueNegativeTestJSON-959409164 None] Created volume successfully. Sep 18 21:38:48 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-2be8e10d-e2f4-48d1-a657-442f2f374073 tempest-VolumesCloneTest-522778170 None] Acquiring lock "cinder-4bc0e2be-a83b-42ed-845c-83cf47207c47-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:38:48 devstack sudo[93678]: pam_unix(sudo:session): session closed for user root Sep 18 21:38:48 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d2503df5-f050-4c27-87a6-9dbed7a635c6 tempest-VolumesCloneTest-522778170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.358s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:38:48 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-d2503df5-f050-4c27-87a6-9dbed7a635c6 tempest-VolumesCloneTest-522778170 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:38:48 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-d2503df5-f050-4c27-87a6-9dbed7a635c6 tempest-VolumesCloneTest-522778170 None] Deleted volume successfully. Sep 18 21:38:48 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-2be8e10d-e2f4-48d1-a657-442f2f374073 tempest-VolumesCloneTest-522778170 None] Lock "cinder-4bc0e2be-a83b-42ed-845c-83cf47207c47-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:38:48 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d2503df5-f050-4c27-87a6-9dbed7a635c6 tempest-VolumesCloneTest-522778170 None] Lock "cinder-a1c5fc84-5171-48af-b674-3d404849ac2c-delete_volume" released by "delete_volume" :: held 1.435s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:38:48 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-2be8e10d-e2f4-48d1-a657-442f2f374073 tempest-VolumesCloneTest-522778170 None] Acquiring lock "cinder-quobyte-4bc0e2be-a83b-42ed-845c-83cf47207c47" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:38:48 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-2be8e10d-e2f4-48d1-a657-442f2f374073 tempest-VolumesCloneTest-522778170 None] Lock "cinder-quobyte-4bc0e2be-a83b-42ed-845c-83cf47207c47" acquired by "delete_volume" :: waited 0.025s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:38:48 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[6085ad93-8e41-446a-b1eb-760d53e00f89]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:38:48 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-2be8e10d-e2f4-48d1-a657-442f2f374073 tempest-VolumesCloneTest-522778170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4bc0e2be-a83b-42ed-845c-83cf47207c47 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:38:48 devstack sudo[93686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4bc0e2be-a83b-42ed-845c-83cf47207c47 Sep 18 21:38:48 devstack sudo[93686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:38:49 devstack sudo[93686]: pam_unix(sudo:session): session closed for user root Sep 18 21:38:49 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-2be8e10d-e2f4-48d1-a657-442f2f374073 tempest-VolumesCloneTest-522778170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4bc0e2be-a83b-42ed-845c-83cf47207c47" returned: 0 in 0.500s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:38:49 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-2be8e10d-e2f4-48d1-a657-442f2f374073 tempest-VolumesCloneTest-522778170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4bc0e2be-a83b-42ed-845c-83cf47207c47 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:38:49 devstack sudo[93691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4bc0e2be-a83b-42ed-845c-83cf47207c47 Sep 18 21:38:49 devstack sudo[93691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:38:49 devstack sudo[93691]: pam_unix(sudo:session): session closed for user root Sep 18 21:38:49 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-2be8e10d-e2f4-48d1-a657-442f2f374073 tempest-VolumesCloneTest-522778170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4bc0e2be-a83b-42ed-845c-83cf47207c47" returned: 0 in 0.413s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:38:49 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-2be8e10d-e2f4-48d1-a657-442f2f374073 tempest-VolumesCloneTest-522778170 None] Lock "cinder-quobyte-4bc0e2be-a83b-42ed-845c-83cf47207c47" released by "delete_volume" :: held 1.072s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:38:49 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-27c71c92-e07e-44f0-9d5a-a5f69d6ae10e req-aeb6f7b6-41bc-4a6b-a498-b2679f27d42f tempest-AttachVolumeTestJSON-1287281091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:38:49 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-27c71c92-e07e-44f0-9d5a-a5f69d6ae10e req-aeb6f7b6-41bc-4a6b-a498-b2679f27d42f tempest-AttachVolumeTestJSON-1287281091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:38:49 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-27c71c92-e07e-44f0-9d5a-a5f69d6ae10e req-aeb6f7b6-41bc-4a6b-a498-b2679f27d42f tempest-AttachVolumeTestJSON-1287281091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:38:49 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-2be8e10d-e2f4-48d1-a657-442f2f374073 tempest-VolumesCloneTest-522778170 None] Created reservations ['27e6af82-c934-42f2-a1d8-67d9f87741ab', 'b462a36d-29d0-476e-a800-63f9f9cbe7c2', '0a777bee-806b-4fc6-acdd-2629260f961c', 'ddbb8270-9012-4132-8051-46d0741e54b8'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:38:49 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [req-27c71c92-e07e-44f0-9d5a-a5f69d6ae10e req-aeb6f7b6-41bc-4a6b-a498-b2679f27d42f tempest-AttachVolumeTestJSON-1287281091 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff', 'name': 'volume-ce85900b-879a-44fb-997e-4758a0aab7f5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '126c4ac9-8c27-4ca3-acff-da474d9b197a', 'enforce_multipath': True} {{(pid=86136) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 18 21:38:49 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-2be8e10d-e2f4-48d1-a657-442f2f374073 tempest-VolumesCloneTest-522778170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:38:49 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-2be8e10d-e2f4-48d1-a657-442f2f374073 tempest-VolumesCloneTest-522778170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:38:49 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-2be8e10d-e2f4-48d1-a657-442f2f374073 tempest-VolumesCloneTest-522778170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:38:49 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-2be8e10d-e2f4-48d1-a657-442f2f374073 tempest-VolumesCloneTest-522778170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:38:49 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-2be8e10d-e2f4-48d1-a657-442f2f374073 tempest-VolumesCloneTest-522778170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:38:49 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-2be8e10d-e2f4-48d1-a657-442f2f374073 tempest-VolumesCloneTest-522778170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:38:49 devstack cinder-volume[86136]: INFO cinder.volume.manager [req-27c71c92-e07e-44f0-9d5a-a5f69d6ae10e req-aeb6f7b6-41bc-4a6b-a498-b2679f27d42f tempest-AttachVolumeTestJSON-1287281091 None] attachment_update completed successfully. Sep 18 21:38:49 devstack sudo[93706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:38:49 devstack sudo[93706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:38:50 devstack sudo[93706]: pam_unix(sudo:session): session closed for user root Sep 18 21:38:50 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-2be8e10d-e2f4-48d1-a657-442f2f374073 tempest-VolumesCloneTest-522778170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.418s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:38:50 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-2be8e10d-e2f4-48d1-a657-442f2f374073 tempest-VolumesCloneTest-522778170 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:38:50 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-2be8e10d-e2f4-48d1-a657-442f2f374073 tempest-VolumesCloneTest-522778170 None] Deleted volume successfully. Sep 18 21:38:50 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-2be8e10d-e2f4-48d1-a657-442f2f374073 tempest-VolumesCloneTest-522778170 None] Lock "cinder-4bc0e2be-a83b-42ed-845c-83cf47207c47-delete_volume" released by "delete_volume" :: held 1.955s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:38:52 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea96f579-3f22-4f2e-aeb6-0155ce0cc058 tempest-AttachVolumeTestJSON-1287281091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:38:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ea96f579-3f22-4f2e-aeb6-0155ce0cc058 tempest-AttachVolumeTestJSON-1287281091 None] Flow 'volume_create_manager' (b078e3a1-f64e-4931-993a-0351ceb6936b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:38:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ea96f579-3f22-4f2e-aeb6-0155ce0cc058 tempest-AttachVolumeTestJSON-1287281091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ba1745b-85ea-4f2e-be65-b03007ac0d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:38:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ea96f579-3f22-4f2e-aeb6-0155ce0cc058 tempest-AttachVolumeTestJSON-1287281091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ba1745b-85ea-4f2e-be65-b03007ac0d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:38:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-724619409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64a4f8af-e68f-49e0-85d3-4ab13e62d65a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79bcd1aa64ac4dff810185818cb31273',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:38:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:38:53Z,use_quota=True,user_id='d10943648fea4421b3587860331c232b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:38:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ea96f579-3f22-4f2e-aeb6-0155ce0cc058 tempest-AttachVolumeTestJSON-1287281091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd053b0b-7162-445b-9884-eddefd6cd461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:38:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ea96f579-3f22-4f2e-aeb6-0155ce0cc058 tempest-AttachVolumeTestJSON-1287281091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd053b0b-7162-445b-9884-eddefd6cd461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:38:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ea96f579-3f22-4f2e-aeb6-0155ce0cc058 tempest-AttachVolumeTestJSON-1287281091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4923127c-efa4-4e05-8bce-cd71a87c04fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:38:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ea96f579-3f22-4f2e-aeb6-0155ce0cc058 tempest-AttachVolumeTestJSON-1287281091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4923127c-efa4-4e05-8bce-cd71a87c04fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64a4f8af-e68f-49e0-85d3-4ab13e62d65a', 'volume_name': 'volume-64a4f8af-e68f-49e0-85d3-4ab13e62d65a', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:38:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ea96f579-3f22-4f2e-aeb6-0155ce0cc058 tempest-AttachVolumeTestJSON-1287281091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46c54758-eba2-4da1-b56f-3b1bee3f0858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:38:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ea96f579-3f22-4f2e-aeb6-0155ce0cc058 tempest-AttachVolumeTestJSON-1287281091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46c54758-eba2-4da1-b56f-3b1bee3f0858) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:38:53 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ea96f579-3f22-4f2e-aeb6-0155ce0cc058 tempest-AttachVolumeTestJSON-1287281091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7be89ba1-23b9-44b1-a574-31ae2b7c7048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:38:53 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-ea96f579-3f22-4f2e-aeb6-0155ce0cc058 tempest-AttachVolumeTestJSON-1287281091 None] Volume 64a4f8af-e68f-49e0-85d3-4ab13e62d65a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64a4f8af-e68f-49e0-85d3-4ab13e62d65a', 'volume_size': 1} Sep 18 21:38:53 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-ea96f579-3f22-4f2e-aeb6-0155ce0cc058 tempest-AttachVolumeTestJSON-1287281091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:38:53 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-ea96f579-3f22-4f2e-aeb6-0155ce0cc058 tempest-AttachVolumeTestJSON-1287281091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:38:53 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-ea96f579-3f22-4f2e-aeb6-0155ce0cc058 tempest-AttachVolumeTestJSON-1287281091 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:38:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-724619409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64a4f8af-e68f-49e0-85d3-4ab13e62d65a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79bcd1aa64ac4dff810185818cb31273',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:38:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:38:53Z,use_quota=True,user_id='d10943648fea4421b3587860331c232b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:38:53 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-ea96f579-3f22-4f2e-aeb6-0155ce0cc058 tempest-AttachVolumeTestJSON-1287281091 None] Creating volume 64a4f8af-e68f-49e0-85d3-4ab13e62d65a {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:38:53 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-ea96f579-3f22-4f2e-aeb6-0155ce0cc058 tempest-AttachVolumeTestJSON-1287281091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:38:53 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-ea96f579-3f22-4f2e-aeb6-0155ce0cc058 tempest-AttachVolumeTestJSON-1287281091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:38:53 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-ea96f579-3f22-4f2e-aeb6-0155ce0cc058 tempest-AttachVolumeTestJSON-1287281091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:38:53 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-ea96f579-3f22-4f2e-aeb6-0155ce0cc058 tempest-AttachVolumeTestJSON-1287281091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:38:53 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-ea96f579-3f22-4f2e-aeb6-0155ce0cc058 tempest-AttachVolumeTestJSON-1287281091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:38:53 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-ea96f579-3f22-4f2e-aeb6-0155ce0cc058 tempest-AttachVolumeTestJSON-1287281091 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:38:53 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-ea96f579-3f22-4f2e-aeb6-0155ce0cc058 tempest-AttachVolumeTestJSON-1287281091 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:38:53 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ea96f579-3f22-4f2e-aeb6-0155ce0cc058 tempest-AttachVolumeTestJSON-1287281091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-64a4f8af-e68f-49e0-85d3-4ab13e62d65a 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:38:53 devstack sudo[94156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-64a4f8af-e68f-49e0-85d3-4ab13e62d65a 1073741824 Sep 18 21:38:53 devstack sudo[94156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:38:54 devstack sudo[94156]: pam_unix(sudo:session): session closed for user root Sep 18 21:38:54 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ea96f579-3f22-4f2e-aeb6-0155ce0cc058 tempest-AttachVolumeTestJSON-1287281091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-64a4f8af-e68f-49e0-85d3-4ab13e62d65a 1073741824" returned: 0 in 1.336s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:38:54 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ea96f579-3f22-4f2e-aeb6-0155ce0cc058 tempest-AttachVolumeTestJSON-1287281091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-64a4f8af-e68f-49e0-85d3-4ab13e62d65a {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:38:54 devstack sudo[94164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-64a4f8af-e68f-49e0-85d3-4ab13e62d65a Sep 18 21:38:54 devstack sudo[94164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:38:55 devstack sudo[94164]: pam_unix(sudo:session): session closed for user root Sep 18 21:38:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ea96f579-3f22-4f2e-aeb6-0155ce0cc058 tempest-AttachVolumeTestJSON-1287281091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-64a4f8af-e68f-49e0-85d3-4ab13e62d65a" returned: 0 in 0.653s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:38:55 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-ea96f579-3f22-4f2e-aeb6-0155ce0cc058 tempest-AttachVolumeTestJSON-1287281091 None] <== create_volume: return (2128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:38:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-ea96f579-3f22-4f2e-aeb6-0155ce0cc058 tempest-AttachVolumeTestJSON-1287281091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.142s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:38:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ea96f579-3f22-4f2e-aeb6-0155ce0cc058 tempest-AttachVolumeTestJSON-1287281091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7be89ba1-23b9-44b1-a574-31ae2b7c7048) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64a4f8af-e68f-49e0-85d3-4ab13e62d65a', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:38:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ea96f579-3f22-4f2e-aeb6-0155ce0cc058 tempest-AttachVolumeTestJSON-1287281091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58b897cb-0538-43a8-b7c3-1935307cb81e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:38:55 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-ea96f579-3f22-4f2e-aeb6-0155ce0cc058 tempest-AttachVolumeTestJSON-1287281091 None] Volume volume-64a4f8af-e68f-49e0-85d3-4ab13e62d65a (64a4f8af-e68f-49e0-85d3-4ab13e62d65a): created successfully Sep 18 21:38:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ea96f579-3f22-4f2e-aeb6-0155ce0cc058 tempest-AttachVolumeTestJSON-1287281091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58b897cb-0538-43a8-b7c3-1935307cb81e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:38:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ea96f579-3f22-4f2e-aeb6-0155ce0cc058 tempest-AttachVolumeTestJSON-1287281091 None] Flow 'volume_create_manager' (b078e3a1-f64e-4931-993a-0351ceb6936b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:38:55 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-ea96f579-3f22-4f2e-aeb6-0155ce0cc058 tempest-AttachVolumeTestJSON-1287281091 None] Created volume successfully. Sep 18 21:38:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-e8fb1d30-ccbb-4846-9d4a-345caf27411c req-1b417f7f-aa5e-4aef-977d-3449bdbe35fb tempest-AttachVolumeTestJSON-1287281091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:38:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-e8fb1d30-ccbb-4846-9d4a-345caf27411c req-1b417f7f-aa5e-4aef-977d-3449bdbe35fb tempest-AttachVolumeTestJSON-1287281091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:38:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-e8fb1d30-ccbb-4846-9d4a-345caf27411c req-1b417f7f-aa5e-4aef-977d-3449bdbe35fb tempest-AttachVolumeTestJSON-1287281091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:38:57 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [req-e8fb1d30-ccbb-4846-9d4a-345caf27411c req-1b417f7f-aa5e-4aef-977d-3449bdbe35fb tempest-AttachVolumeTestJSON-1287281091 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff', 'name': 'volume-64a4f8af-e68f-49e0-85d3-4ab13e62d65a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a244c009-3048-4f4b-9315-9b04750d55d5', 'enforce_multipath': True} {{(pid=86136) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 18 21:38:57 devstack cinder-volume[86136]: INFO cinder.volume.manager [req-e8fb1d30-ccbb-4846-9d4a-345caf27411c req-1b417f7f-aa5e-4aef-977d-3449bdbe35fb tempest-AttachVolumeTestJSON-1287281091 None] attachment_update completed successfully. Sep 18 21:38:58 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d379dd18-0a87-4377-ba1d-091be2ef71cc tempest-ServerRescueNegativeTestJSON-959409164 None] Acquiring lock "cinder-094a1cd3-8a22-4204-95d4-3ddb93798f8d-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:38:58 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d379dd18-0a87-4377-ba1d-091be2ef71cc tempest-ServerRescueNegativeTestJSON-959409164 None] Lock "cinder-094a1cd3-8a22-4204-95d4-3ddb93798f8d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:38:58 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c63b386-5953-4739-9154-ae4a6311adfc tempest-VolumesExtendTest-507425859 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:38:58 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2c63b386-5953-4739-9154-ae4a6311adfc tempest-VolumesExtendTest-507425859 None] Flow 'volume_create_manager' (03dc72b9-7f66-4c5d-b689-ed09abb35880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:38:58 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2c63b386-5953-4739-9154-ae4a6311adfc tempest-VolumesExtendTest-507425859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42bc3336-5762-4580-92c4-ca4ad1c55afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:38:58 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2c63b386-5953-4739-9154-ae4a6311adfc tempest-VolumesExtendTest-507425859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42bc3336-5762-4580-92c4-ca4ad1c55afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:38:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-197792147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a07e1137-e3fb-482d-babd-436b60dde2a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d78f505a4ce4c3a99c2977bf74513d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:38:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:38:59Z,use_quota=True,user_id='5eac5fb75cf84aa69a8acf120715f2c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:38:58 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2c63b386-5953-4739-9154-ae4a6311adfc tempest-VolumesExtendTest-507425859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e455ef3-3870-40be-adb6-92028e49d1da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:38:58 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2c63b386-5953-4739-9154-ae4a6311adfc tempest-VolumesExtendTest-507425859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e455ef3-3870-40be-adb6-92028e49d1da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:38:58 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2c63b386-5953-4739-9154-ae4a6311adfc tempest-VolumesExtendTest-507425859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d5caaff-e79d-4d3d-961e-1bbe1ce94180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:38:58 devstack cinder-volume[86136]: DEBUG cinder.image.glance [None req-2c63b386-5953-4739-9154-ae4a6311adfc tempest-VolumesExtendTest-507425859 None] Creating Keystone auth plugin from conf {{(pid=86136) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 18 21:38:58 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d379dd18-0a87-4377-ba1d-091be2ef71cc tempest-ServerRescueNegativeTestJSON-959409164 None] Acquiring lock "cinder-quobyte-094a1cd3-8a22-4204-95d4-3ddb93798f8d" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:38:58 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d379dd18-0a87-4377-ba1d-091be2ef71cc tempest-ServerRescueNegativeTestJSON-959409164 None] Lock "cinder-quobyte-094a1cd3-8a22-4204-95d4-3ddb93798f8d" acquired by "delete_volume" :: waited 0.025s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:38:59 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92ec9fc-56e3-4405-873c-ab237908dbb9]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:38:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d379dd18-0a87-4377-ba1d-091be2ef71cc tempest-ServerRescueNegativeTestJSON-959409164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-094a1cd3-8a22-4204-95d4-3ddb93798f8d {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:38:59 devstack sudo[94239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-094a1cd3-8a22-4204-95d4-3ddb93798f8d Sep 18 21:38:59 devstack sudo[94239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:38:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2c63b386-5953-4739-9154-ae4a6311adfc tempest-VolumesExtendTest-507425859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d5caaff-e79d-4d3d-961e-1bbe1ce94180) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a07e1137-e3fb-482d-babd-436b60dde2a0', 'volume_name': 'volume-a07e1137-e3fb-482d-babd-436b60dde2a0', 'volume_size': 1, 'image_id': 'a7adbe6d-c72a-4ef2-82c6-e788c5101a2c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a7adbe6d-c72a-4ef2-82c6-e788c5101a2c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'eae9b2cfe4f146fb9d7ac38006d73cd9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a7adbe6d-c72a-4ef2-82c6-e788c5101a2c', 'created_at': datetime.datetime(2026, 9, 18, 19, 27, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 18, 19, 27, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a7adbe6d-c72a-4ef2-82c6-e788c5101a2c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:38:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2c63b386-5953-4739-9154-ae4a6311adfc tempest-VolumesExtendTest-507425859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bf08ca3-8e26-49fd-ba89-8d0a9772832c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:38:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2c63b386-5953-4739-9154-ae4a6311adfc tempest-VolumesExtendTest-507425859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bf08ca3-8e26-49fd-ba89-8d0a9772832c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:38:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2c63b386-5953-4739-9154-ae4a6311adfc tempest-VolumesExtendTest-507425859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5934ee6a-2377-4ede-b302-7b51b774ea84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:38:59 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-2c63b386-5953-4739-9154-ae4a6311adfc tempest-VolumesExtendTest-507425859 None] Volume a07e1137-e3fb-482d-babd-436b60dde2a0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a07e1137-e3fb-482d-babd-436b60dde2a0', 'volume_size': 1, 'image_id': 'a7adbe6d-c72a-4ef2-82c6-e788c5101a2c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a7adbe6d-c72a-4ef2-82c6-e788c5101a2c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'eae9b2cfe4f146fb9d7ac38006d73cd9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a7adbe6d-c72a-4ef2-82c6-e788c5101a2c', 'created_at': datetime.datetime(2026, 9, 18, 19, 27, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 18, 19, 27, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a7adbe6d-c72a-4ef2-82c6-e788c5101a2c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 18 21:38:59 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c63b386-5953-4739-9154-ae4a6311adfc tempest-VolumesExtendTest-507425859 None] Trying to clone a07e1137-e3fb-482d-babd-436b60dde2a0 from image a7adbe6d-c72a-4ef2-82c6-e788c5101a2c at location (None, [{'url': 'file:///opt/stack/data/glance/images/a7adbe6d-c72a-4ef2-82c6-e788c5101a2c', 'metadata': {}}]). {{(pid=86136) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 18 21:38:59 devstack sudo[94239]: pam_unix(sudo:session): session closed for user root Sep 18 21:38:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d379dd18-0a87-4377-ba1d-091be2ef71cc tempest-ServerRescueNegativeTestJSON-959409164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-094a1cd3-8a22-4204-95d4-3ddb93798f8d" returned: 0 in 0.678s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:38:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d379dd18-0a87-4377-ba1d-091be2ef71cc tempest-ServerRescueNegativeTestJSON-959409164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-094a1cd3-8a22-4204-95d4-3ddb93798f8d {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:38:59 devstack sudo[94246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-094a1cd3-8a22-4204-95d4-3ddb93798f8d Sep 18 21:38:59 devstack sudo[94246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:39:00 devstack cinder-volume[86136]: DEBUG cinder.image.image_utils [None req-2c63b386-5953-4739-9154-ae4a6311adfc tempest-VolumesExtendTest-507425859 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_d669fg91devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86136) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 18 21:39:00 devstack cinder-volume[86136]: INFO cinder.image.image_utils [None req-2c63b386-5953-4739-9154-ae4a6311adfc tempest-VolumesExtendTest-507425859 None] Image download 20.69 MB at 20.69 MB/s Sep 18 21:39:00 devstack sudo[94246]: pam_unix(sudo:session): session closed for user root Sep 18 21:39:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d379dd18-0a87-4377-ba1d-091be2ef71cc tempest-ServerRescueNegativeTestJSON-959409164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-094a1cd3-8a22-4204-95d4-3ddb93798f8d" returned: 0 in 0.515s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:39:00 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d379dd18-0a87-4377-ba1d-091be2ef71cc tempest-ServerRescueNegativeTestJSON-959409164 None] Lock "cinder-quobyte-094a1cd3-8a22-4204-95d4-3ddb93798f8d" released by "delete_volume" :: held 1.273s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:39:00 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a48091-ae08-4f38-a33a-2b54d1610705]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:39:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-2c63b386-5953-4739-9154-ae4a6311adfc tempest-VolumesExtendTest-507425859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_d669fg91devstack@QuobyteHD {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:39:00 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-d379dd18-0a87-4377-ba1d-091be2ef71cc tempest-ServerRescueNegativeTestJSON-959409164 None] Created reservations ['66ad195a-82d1-4935-b6d6-cc83cd7aa3b2', 'bb62aa87-adae-4a03-8c93-c439b91302d4', '3a369c4c-2438-4b9a-b14b-f6073965b8b3', 'c003508b-04ea-46ce-b441-8f3139e50c01'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:39:00 devstack sudo[94251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_d669fg91devstack@QuobyteHD Sep 18 21:39:00 devstack sudo[94251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:39:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-d379dd18-0a87-4377-ba1d-091be2ef71cc tempest-ServerRescueNegativeTestJSON-959409164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:39:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-d379dd18-0a87-4377-ba1d-091be2ef71cc tempest-ServerRescueNegativeTestJSON-959409164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:39:00 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-d379dd18-0a87-4377-ba1d-091be2ef71cc tempest-ServerRescueNegativeTestJSON-959409164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:39:00 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-d379dd18-0a87-4377-ba1d-091be2ef71cc tempest-ServerRescueNegativeTestJSON-959409164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:39:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-d379dd18-0a87-4377-ba1d-091be2ef71cc tempest-ServerRescueNegativeTestJSON-959409164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:39:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d379dd18-0a87-4377-ba1d-091be2ef71cc tempest-ServerRescueNegativeTestJSON-959409164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:39:00 devstack sudo[94254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:39:00 devstack sudo[94254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:39:00 devstack sudo[94254]: pam_unix(sudo:session): session closed for user root Sep 18 21:39:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d379dd18-0a87-4377-ba1d-091be2ef71cc tempest-ServerRescueNegativeTestJSON-959409164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.370s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:39:00 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-d379dd18-0a87-4377-ba1d-091be2ef71cc tempest-ServerRescueNegativeTestJSON-959409164 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:39:00 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-d379dd18-0a87-4377-ba1d-091be2ef71cc tempest-ServerRescueNegativeTestJSON-959409164 None] Deleted volume successfully. Sep 18 21:39:01 devstack cinder-volume[86136]: INFO cinder.volume.manager [req-27630777-6792-4ac9-9cb6-cf313b3c61f8 req-c6bc5757-b761-449b-8df8-2d833a9cb07e tempest-AttachVolumeTestJSON-1287281091 None] Terminate volume connection completed successfully. Sep 18 21:39:01 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [req-27630777-6792-4ac9-9cb6-cf313b3c61f8 req-c6bc5757-b761-449b-8df8-2d833a9cb07e tempest-AttachVolumeTestJSON-1287281091 None] Deleting attachment 126c4ac9-8c27-4ca3-acff-da474d9b197a. {{(pid=86136) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 18 21:39:01 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d379dd18-0a87-4377-ba1d-091be2ef71cc tempest-ServerRescueNegativeTestJSON-959409164 None] Lock "cinder-094a1cd3-8a22-4204-95d4-3ddb93798f8d-delete_volume" released by "delete_volume" :: held 2.237s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:39:01 devstack sudo[94251]: pam_unix(sudo:session): session closed for user root Sep 18 21:39:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-2c63b386-5953-4739-9154-ae4a6311adfc tempest-VolumesExtendTest-507425859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_d669fg91devstack@QuobyteHD" returned: 0 in 0.803s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:39:01 devstack cinder-volume[86136]: DEBUG cinder.image.image_utils [None req-2c63b386-5953-4739-9154-ae4a6311adfc tempest-VolumesExtendTest-507425859 None] Temporary image a7adbe6d-c72a-4ef2-82c6-e788c5101a2c is fetched for user 5eac5fb75cf84aa69a8acf120715f2c5. {{(pid=86136) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 18 21:39:01 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8804b2c-ec23-4e49-b445-825a9a09646e]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:39:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-2c63b386-5953-4739-9154-ae4a6311adfc tempest-VolumesExtendTest-507425859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_d669fg91devstack@QuobyteHD {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:39:01 devstack sudo[94262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_d669fg91devstack@QuobyteHD Sep 18 21:39:01 devstack sudo[94262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:39:01 devstack sudo[94262]: pam_unix(sudo:session): session closed for user root Sep 18 21:39:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-2c63b386-5953-4739-9154-ae4a6311adfc tempest-VolumesExtendTest-507425859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_d669fg91devstack@QuobyteHD" returned: 0 in 0.676s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:39:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-2c63b386-5953-4739-9154-ae4a6311adfc tempest-VolumesExtendTest-507425859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:39:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-2c63b386-5953-4739-9154-ae4a6311adfc tempest-VolumesExtendTest-507425859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:39:01 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-2c63b386-5953-4739-9154-ae4a6311adfc tempest-VolumesExtendTest-507425859 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:38:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-197792147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a07e1137-e3fb-482d-babd-436b60dde2a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d78f505a4ce4c3a99c2977bf74513d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:38:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:38:59Z,use_quota=True,user_id='5eac5fb75cf84aa69a8acf120715f2c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:39:01 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-2c63b386-5953-4739-9154-ae4a6311adfc tempest-VolumesExtendTest-507425859 None] Creating volume a07e1137-e3fb-482d-babd-436b60dde2a0 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:39:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-2c63b386-5953-4739-9154-ae4a6311adfc tempest-VolumesExtendTest-507425859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:39:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-2c63b386-5953-4739-9154-ae4a6311adfc tempest-VolumesExtendTest-507425859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:39:01 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-2c63b386-5953-4739-9154-ae4a6311adfc tempest-VolumesExtendTest-507425859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:39:01 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-2c63b386-5953-4739-9154-ae4a6311adfc tempest-VolumesExtendTest-507425859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:39:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-2c63b386-5953-4739-9154-ae4a6311adfc tempest-VolumesExtendTest-507425859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.069s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:39:01 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-2c63b386-5953-4739-9154-ae4a6311adfc tempest-VolumesExtendTest-507425859 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:39:02 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-2c63b386-5953-4739-9154-ae4a6311adfc tempest-VolumesExtendTest-507425859 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:39:02 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-2c63b386-5953-4739-9154-ae4a6311adfc tempest-VolumesExtendTest-507425859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a07e1137-e3fb-482d-babd-436b60dde2a0 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:39:02 devstack sudo[94284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a07e1137-e3fb-482d-babd-436b60dde2a0 1073741824 Sep 18 21:39:02 devstack sudo[94284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:39:03 devstack sudo[94284]: pam_unix(sudo:session): session closed for user root Sep 18 21:39:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-2c63b386-5953-4739-9154-ae4a6311adfc tempest-VolumesExtendTest-507425859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a07e1137-e3fb-482d-babd-436b60dde2a0 1073741824" returned: 0 in 1.069s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:39:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-2c63b386-5953-4739-9154-ae4a6311adfc tempest-VolumesExtendTest-507425859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a07e1137-e3fb-482d-babd-436b60dde2a0 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:39:03 devstack sudo[94328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a07e1137-e3fb-482d-babd-436b60dde2a0 Sep 18 21:39:03 devstack sudo[94328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:39:03 devstack cinder-volume[86136]: INFO cinder.volume.manager [req-3f18f9c7-a727-421e-b7e4-9ed81170b85e req-5f4d310d-b933-4df6-a981-8d86557fc7fc tempest-AttachVolumeTestJSON-1287281091 None] Terminate volume connection completed successfully. Sep 18 21:39:03 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [req-3f18f9c7-a727-421e-b7e4-9ed81170b85e req-5f4d310d-b933-4df6-a981-8d86557fc7fc tempest-AttachVolumeTestJSON-1287281091 None] Deleting attachment a244c009-3048-4f4b-9315-9b04750d55d5. {{(pid=86136) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 18 21:39:03 devstack sudo[94328]: pam_unix(sudo:session): session closed for user root Sep 18 21:39:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-2c63b386-5953-4739-9154-ae4a6311adfc tempest-VolumesExtendTest-507425859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a07e1137-e3fb-482d-babd-436b60dde2a0" returned: 0 in 0.517s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:39:03 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-2c63b386-5953-4739-9154-ae4a6311adfc tempest-VolumesExtendTest-507425859 None] <== create_volume: return (1761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:39:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-2c63b386-5953-4739-9154-ae4a6311adfc tempest-VolumesExtendTest-507425859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.776s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:39:03 devstack cinder-volume[86136]: DEBUG cinder.volume.volume_utils [None req-2c63b386-5953-4739-9154-ae4a6311adfc tempest-VolumesExtendTest-507425859 None] Attempting download of a7adbe6d-c72a-4ef2-82c6-e788c5101a2c ((None, [{'url': 'file:///opt/stack/data/glance/images/a7adbe6d-c72a-4ef2-82c6-e788c5101a2c', 'metadata': {}}])) to volume a07e1137-e3fb-482d-babd-436b60dde2a0. {{(pid=86136) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 18 21:39:03 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc99c2d5-17eb-4f12-bd40-0cef71a34a87]: (4, 'raw') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:39:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-2c63b386-5953-4739-9154-ae4a6311adfc tempest-VolumesExtendTest-507425859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_07cjx4zf {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:39:04 devstack sudo[94331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_07cjx4zf Sep 18 21:39:04 devstack sudo[94331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:39:04 devstack sudo[94331]: pam_unix(sudo:session): session closed for user root Sep 18 21:39:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-2c63b386-5953-4739-9154-ae4a6311adfc tempest-VolumesExtendTest-507425859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_07cjx4zf" returned: 0 in 0.675s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:39:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-2c63b386-5953-4739-9154-ae4a6311adfc tempest-VolumesExtendTest-507425859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_07cjx4zf {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:39:04 devstack sudo[94337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_07cjx4zf Sep 18 21:39:04 devstack sudo[94337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:39:05 devstack cinder-volume[86136]: DEBUG oslo_service.periodic_task [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86136) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 21:39:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:39:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:39:05 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:39:05 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:39:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:39:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:39:05 devstack sudo[94337]: pam_unix(sudo:session): session closed for user root Sep 18 21:39:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-2c63b386-5953-4739-9154-ae4a6311adfc tempest-VolumesExtendTest-507425859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_07cjx4zf" returned: 1 in 0.651s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:39:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-2c63b386-5953-4739-9154-ae4a6311adfc tempest-VolumesExtendTest-507425859 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_07cjx4zf' failed. Not Retrying. {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 18 21:39:05 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[e286f01b-78f6-4b76-a596-e9d950a3be29]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:39:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-2c63b386-5953-4739-9154-ae4a6311adfc tempest-VolumesExtendTest-507425859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_d669fg91devstack@QuobyteHD {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:39:05 devstack sudo[94342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:39:05 devstack sudo[94342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:39:05 devstack sudo[94344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_d669fg91devstack@QuobyteHD Sep 18 21:39:05 devstack sudo[94344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:39:05 devstack sudo[94342]: pam_unix(sudo:session): session closed for user root Sep 18 21:39:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.698s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:39:05 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:39:05 devstack cinder-volume[86136]: DEBUG oslo_service.periodic_task [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Running periodic task VolumeManager._thread_info {{(pid=86136) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 21:39:05 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] thread count: 28 {{(pid=86136) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 18 21:39:05 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] thread info: [<_MainThread(MainThread, started 138548347871360)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86136) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 18 21:39:06 devstack sudo[94344]: pam_unix(sudo:session): session closed for user root Sep 18 21:39:06 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-2c63b386-5953-4739-9154-ae4a6311adfc tempest-VolumesExtendTest-507425859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_d669fg91devstack@QuobyteHD" returned: 0 in 0.937s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:39:06 devstack cinder-volume[86136]: DEBUG cinder.image.image_utils [None req-2c63b386-5953-4739-9154-ae4a6311adfc tempest-VolumesExtendTest-507425859 None] a7adbe6d-c72a-4ef2-82c6-e788c5101a2c was qcow2, converting to qcow2 {{(pid=86136) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 18 21:39:06 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-2c63b386-5953-4739-9154-ae4a6311adfc tempest-VolumesExtendTest-507425859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_d669fg91devstack@QuobyteHD /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a07e1137-e3fb-482d-babd-436b60dde2a0 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:39:06 devstack sudo[94369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_d669fg91devstack@QuobyteHD /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a07e1137-e3fb-482d-babd-436b60dde2a0 Sep 18 21:39:06 devstack sudo[94369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:39:08 devstack sudo[94369]: pam_unix(sudo:session): session closed for user root Sep 18 21:39:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-2c63b386-5953-4739-9154-ae4a6311adfc tempest-VolumesExtendTest-507425859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_d669fg91devstack@QuobyteHD /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a07e1137-e3fb-482d-babd-436b60dde2a0" returned: 0 in 2.788s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:39:08 devstack cinder-volume[86136]: DEBUG cinder.image.image_utils [None req-2c63b386-5953-4739-9154-ae4a6311adfc tempest-VolumesExtendTest-507425859 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_d669fg91devstack@QuobyteHD, size 112.00 MB, duration 2.79 sec, destination /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a07e1137-e3fb-482d-babd-436b60dde2a0 {{(pid=86136) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 18 21:39:08 devstack cinder-volume[86136]: INFO cinder.image.image_utils [None req-2c63b386-5953-4739-9154-ae4a6311adfc tempest-VolumesExtendTest-507425859 None] Converted 112.00 MB image at 40.14 MB/s Sep 18 21:39:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-2c63b386-5953-4739-9154-ae4a6311adfc tempest-VolumesExtendTest-507425859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a07e1137-e3fb-482d-babd-436b60dde2a0 1G {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:39:08 devstack sudo[94399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a07e1137-e3fb-482d-babd-436b60dde2a0 1G Sep 18 21:39:08 devstack sudo[94399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:39:09 devstack sudo[94399]: pam_unix(sudo:session): session closed for user root Sep 18 21:39:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-2c63b386-5953-4739-9154-ae4a6311adfc tempest-VolumesExtendTest-507425859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a07e1137-e3fb-482d-babd-436b60dde2a0 1G" returned: 0 in 0.609s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:39:09 devstack cinder-volume[86136]: DEBUG cinder.volume.volume_utils [None req-2c63b386-5953-4739-9154-ae4a6311adfc tempest-VolumesExtendTest-507425859 None] Downloaded image a7adbe6d-c72a-4ef2-82c6-e788c5101a2c ((None, [{'url': 'file:///opt/stack/data/glance/images/a7adbe6d-c72a-4ef2-82c6-e788c5101a2c', 'metadata': {}}])) to volume a07e1137-e3fb-482d-babd-436b60dde2a0 successfully. {{(pid=86136) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 18 21:39:09 devstack cinder-volume[86136]: DEBUG cinder.image.image_utils [None req-2c63b386-5953-4739-9154-ae4a6311adfc tempest-VolumesExtendTest-507425859 None] Temporary image a7adbe6d-c72a-4ef2-82c6-e788c5101a2c for user 5eac5fb75cf84aa69a8acf120715f2c5 is deleted. {{(pid=86136) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 18 21:39:09 devstack cinder-volume[86136]: DEBUG cinder.volume.volume_utils [None req-2c63b386-5953-4739-9154-ae4a6311adfc tempest-VolumesExtendTest-507425859 None] Marking volume a07e1137-e3fb-482d-babd-436b60dde2a0 as bootable. {{(pid=86136) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 18 21:39:09 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c63b386-5953-4739-9154-ae4a6311adfc tempest-VolumesExtendTest-507425859 None] Copying metadata from image a7adbe6d-c72a-4ef2-82c6-e788c5101a2c to a07e1137-e3fb-482d-babd-436b60dde2a0. {{(pid=86136) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 18 21:39:09 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c63b386-5953-4739-9154-ae4a6311adfc tempest-VolumesExtendTest-507425859 None] Creating volume glance metadata for volume a07e1137-e3fb-482d-babd-436b60dde2a0 backed by image a7adbe6d-c72a-4ef2-82c6-e788c5101a2c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a7adbe6d-c72a-4ef2-82c6-e788c5101a2c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86136) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 18 21:39:09 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2c63b386-5953-4739-9154-ae4a6311adfc tempest-VolumesExtendTest-507425859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5934ee6a-2377-4ede-b302-7b51b774ea84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a07e1137-e3fb-482d-babd-436b60dde2a0', 'volume_size': 1, 'image_id': 'a7adbe6d-c72a-4ef2-82c6-e788c5101a2c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a7adbe6d-c72a-4ef2-82c6-e788c5101a2c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'eae9b2cfe4f146fb9d7ac38006d73cd9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a7adbe6d-c72a-4ef2-82c6-e788c5101a2c', 'created_at': datetime.datetime(2026, 9, 18, 19, 27, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 18, 19, 27, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a7adbe6d-c72a-4ef2-82c6-e788c5101a2c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:39:09 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2c63b386-5953-4739-9154-ae4a6311adfc tempest-VolumesExtendTest-507425859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18ad7581-7cbe-4ef3-b143-087e77856245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:39:09 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-2c63b386-5953-4739-9154-ae4a6311adfc tempest-VolumesExtendTest-507425859 None] Volume volume-a07e1137-e3fb-482d-babd-436b60dde2a0 (a07e1137-e3fb-482d-babd-436b60dde2a0): created successfully Sep 18 21:39:09 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2c63b386-5953-4739-9154-ae4a6311adfc tempest-VolumesExtendTest-507425859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18ad7581-7cbe-4ef3-b143-087e77856245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:39:09 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2c63b386-5953-4739-9154-ae4a6311adfc tempest-VolumesExtendTest-507425859 None] Flow 'volume_create_manager' (03dc72b9-7f66-4c5d-b689-ed09abb35880) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:39:09 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-2c63b386-5953-4739-9154-ae4a6311adfc tempest-VolumesExtendTest-507425859 None] Created volume successfully. Sep 18 21:39:10 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-5c3835d9-fd4f-4cf9-ae5d-6cb8c9fda0da tempest-VolumesExtendTest-507425859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:39:10 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-5c3835d9-fd4f-4cf9-ae5d-6cb8c9fda0da tempest-VolumesExtendTest-507425859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:39:10 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[b73dfb69-de66-476e-aeb6-957a81a1c9c3]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:39:10 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5c3835d9-fd4f-4cf9-ae5d-6cb8c9fda0da tempest-VolumesExtendTest-507425859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a07e1137-e3fb-482d-babd-436b60dde2a0 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:39:10 devstack sudo[94408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a07e1137-e3fb-482d-babd-436b60dde2a0 Sep 18 21:39:10 devstack sudo[94408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:39:10 devstack sudo[94408]: pam_unix(sudo:session): session closed for user root Sep 18 21:39:10 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5c3835d9-fd4f-4cf9-ae5d-6cb8c9fda0da tempest-VolumesExtendTest-507425859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a07e1137-e3fb-482d-babd-436b60dde2a0" returned: 0 in 0.544s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:39:10 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5c3835d9-fd4f-4cf9-ae5d-6cb8c9fda0da tempest-VolumesExtendTest-507425859 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a07e1137-e3fb-482d-babd-436b60dde2a0 2G {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:39:10 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5c3835d9-fd4f-4cf9-ae5d-6cb8c9fda0da tempest-VolumesExtendTest-507425859 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a07e1137-e3fb-482d-babd-436b60dde2a0 2G" returned: 0 in 0.127s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:39:10 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-5c3835d9-fd4f-4cf9-ae5d-6cb8c9fda0da tempest-VolumesExtendTest-507425859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.702s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:39:10 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-5c3835d9-fd4f-4cf9-ae5d-6cb8c9fda0da tempest-VolumesExtendTest-507425859 None] Extend volume completed successfully. Sep 18 21:39:11 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-568f3a7c-5a23-403f-9f98-c87723f84a3d tempest-AttachVolumeTestJSON-1287281091 None] Acquiring lock "cinder-64a4f8af-e68f-49e0-85d3-4ab13e62d65a-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:39:11 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-568f3a7c-5a23-403f-9f98-c87723f84a3d tempest-AttachVolumeTestJSON-1287281091 None] Lock "cinder-64a4f8af-e68f-49e0-85d3-4ab13e62d65a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:39:11 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-568f3a7c-5a23-403f-9f98-c87723f84a3d tempest-AttachVolumeTestJSON-1287281091 None] Acquiring lock "cinder-quobyte-64a4f8af-e68f-49e0-85d3-4ab13e62d65a" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:39:11 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-568f3a7c-5a23-403f-9f98-c87723f84a3d tempest-AttachVolumeTestJSON-1287281091 None] Lock "cinder-quobyte-64a4f8af-e68f-49e0-85d3-4ab13e62d65a" acquired by "delete_volume" :: waited 0.017s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:39:11 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a477475-cdb4-4b79-be78-0b6b48b2c3bc]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:39:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-568f3a7c-5a23-403f-9f98-c87723f84a3d tempest-AttachVolumeTestJSON-1287281091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-64a4f8af-e68f-49e0-85d3-4ab13e62d65a {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:39:11 devstack sudo[94416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-64a4f8af-e68f-49e0-85d3-4ab13e62d65a Sep 18 21:39:11 devstack sudo[94416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:39:11 devstack sudo[94416]: pam_unix(sudo:session): session closed for user root Sep 18 21:39:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-568f3a7c-5a23-403f-9f98-c87723f84a3d tempest-AttachVolumeTestJSON-1287281091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-64a4f8af-e68f-49e0-85d3-4ab13e62d65a" returned: 0 in 0.422s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:39:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-568f3a7c-5a23-403f-9f98-c87723f84a3d tempest-AttachVolumeTestJSON-1287281091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-64a4f8af-e68f-49e0-85d3-4ab13e62d65a {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:39:11 devstack sudo[94421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-64a4f8af-e68f-49e0-85d3-4ab13e62d65a Sep 18 21:39:11 devstack sudo[94421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:39:11 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-166ec396-0b90-4e38-99ff-de4f9d8a43b2 tempest-VolumesExtendTest-507425859 None] Acquiring lock "cinder-a07e1137-e3fb-482d-babd-436b60dde2a0-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:39:11 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-166ec396-0b90-4e38-99ff-de4f9d8a43b2 tempest-VolumesExtendTest-507425859 None] Lock "cinder-a07e1137-e3fb-482d-babd-436b60dde2a0-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:39:11 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-166ec396-0b90-4e38-99ff-de4f9d8a43b2 tempest-VolumesExtendTest-507425859 None] Acquiring lock "cinder-quobyte-a07e1137-e3fb-482d-babd-436b60dde2a0" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:39:11 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-166ec396-0b90-4e38-99ff-de4f9d8a43b2 tempest-VolumesExtendTest-507425859 None] Lock "cinder-quobyte-a07e1137-e3fb-482d-babd-436b60dde2a0" acquired by "delete_volume" :: waited 0.017s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:39:11 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddfd0ae8-cb07-46d8-9e7e-3948139ddc10]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:39:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-166ec396-0b90-4e38-99ff-de4f9d8a43b2 tempest-VolumesExtendTest-507425859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a07e1137-e3fb-482d-babd-436b60dde2a0 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:39:11 devstack sudo[94421]: pam_unix(sudo:session): session closed for user root Sep 18 21:39:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-568f3a7c-5a23-403f-9f98-c87723f84a3d tempest-AttachVolumeTestJSON-1287281091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-64a4f8af-e68f-49e0-85d3-4ab13e62d65a" returned: 0 in 0.369s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:39:11 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-568f3a7c-5a23-403f-9f98-c87723f84a3d tempest-AttachVolumeTestJSON-1287281091 None] Lock "cinder-quobyte-64a4f8af-e68f-49e0-85d3-4ab13e62d65a" released by "delete_volume" :: held 0.860s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:39:12 devstack sudo[94423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a07e1137-e3fb-482d-babd-436b60dde2a0 Sep 18 21:39:12 devstack sudo[94423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:39:12 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-568f3a7c-5a23-403f-9f98-c87723f84a3d tempest-AttachVolumeTestJSON-1287281091 None] Created reservations ['fa203668-c282-4a3f-9682-75f13430dd2d', '6d7c62e6-cd2b-4e29-99eb-679b1799f56c', 'ac8d5ef5-9f9c-4297-bf88-8124bcfb7865', 'c23e0ba8-3c8b-4038-afd4-86f70bd94bb5'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:39:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-568f3a7c-5a23-403f-9f98-c87723f84a3d tempest-AttachVolumeTestJSON-1287281091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:39:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-568f3a7c-5a23-403f-9f98-c87723f84a3d tempest-AttachVolumeTestJSON-1287281091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:39:12 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-568f3a7c-5a23-403f-9f98-c87723f84a3d tempest-AttachVolumeTestJSON-1287281091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:39:12 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-568f3a7c-5a23-403f-9f98-c87723f84a3d tempest-AttachVolumeTestJSON-1287281091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:39:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-568f3a7c-5a23-403f-9f98-c87723f84a3d tempest-AttachVolumeTestJSON-1287281091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:39:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-568f3a7c-5a23-403f-9f98-c87723f84a3d tempest-AttachVolumeTestJSON-1287281091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:39:12 devstack sudo[94426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:39:12 devstack sudo[94426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:39:12 devstack sudo[94423]: pam_unix(sudo:session): session closed for user root Sep 18 21:39:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-166ec396-0b90-4e38-99ff-de4f9d8a43b2 tempest-VolumesExtendTest-507425859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a07e1137-e3fb-482d-babd-436b60dde2a0" returned: 0 in 0.551s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:39:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-166ec396-0b90-4e38-99ff-de4f9d8a43b2 tempest-VolumesExtendTest-507425859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a07e1137-e3fb-482d-babd-436b60dde2a0 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:39:12 devstack sudo[94431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a07e1137-e3fb-482d-babd-436b60dde2a0 Sep 18 21:39:12 devstack sudo[94431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:39:12 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-3b8036c7-35d1-4db9-8657-3d89b8ca79e7 tempest-AttachVolumeTestJSON-1287281091 None] Acquiring lock "cinder-ce85900b-879a-44fb-997e-4758a0aab7f5-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:39:12 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-3b8036c7-35d1-4db9-8657-3d89b8ca79e7 tempest-AttachVolumeTestJSON-1287281091 None] Lock "cinder-ce85900b-879a-44fb-997e-4758a0aab7f5-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:39:12 devstack sudo[94426]: pam_unix(sudo:session): session closed for user root Sep 18 21:39:12 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-3b8036c7-35d1-4db9-8657-3d89b8ca79e7 tempest-AttachVolumeTestJSON-1287281091 None] Acquiring lock "cinder-quobyte-ce85900b-879a-44fb-997e-4758a0aab7f5" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:39:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-568f3a7c-5a23-403f-9f98-c87723f84a3d tempest-AttachVolumeTestJSON-1287281091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.455s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:39:12 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-568f3a7c-5a23-403f-9f98-c87723f84a3d tempest-AttachVolumeTestJSON-1287281091 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:39:12 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-568f3a7c-5a23-403f-9f98-c87723f84a3d tempest-AttachVolumeTestJSON-1287281091 None] Deleted volume successfully. Sep 18 21:39:12 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-3b8036c7-35d1-4db9-8657-3d89b8ca79e7 tempest-AttachVolumeTestJSON-1287281091 None] Lock "cinder-quobyte-ce85900b-879a-44fb-997e-4758a0aab7f5" acquired by "delete_volume" :: waited 0.023s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:39:12 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[c163d0fb-fafb-4985-a07e-b5340f542768]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:39:12 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-568f3a7c-5a23-403f-9f98-c87723f84a3d tempest-AttachVolumeTestJSON-1287281091 None] Lock "cinder-64a4f8af-e68f-49e0-85d3-4ab13e62d65a-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:39:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3b8036c7-35d1-4db9-8657-3d89b8ca79e7 tempest-AttachVolumeTestJSON-1287281091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ce85900b-879a-44fb-997e-4758a0aab7f5 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:39:12 devstack sudo[94431]: pam_unix(sudo:session): session closed for user root Sep 18 21:39:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-166ec396-0b90-4e38-99ff-de4f9d8a43b2 tempest-VolumesExtendTest-507425859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a07e1137-e3fb-482d-babd-436b60dde2a0" returned: 0 in 0.412s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:39:12 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-166ec396-0b90-4e38-99ff-de4f9d8a43b2 tempest-VolumesExtendTest-507425859 None] Lock "cinder-quobyte-a07e1137-e3fb-482d-babd-436b60dde2a0" released by "delete_volume" :: held 1.039s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:39:12 devstack sudo[94434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ce85900b-879a-44fb-997e-4758a0aab7f5 Sep 18 21:39:12 devstack sudo[94434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:39:12 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-166ec396-0b90-4e38-99ff-de4f9d8a43b2 tempest-VolumesExtendTest-507425859 None] Created reservations ['9085767b-292d-442c-a49c-3e6a3418791d', '2ef467bd-d56d-40c2-8b98-c07d2dba1cd9', 'b66db86c-7d00-42ce-9684-9a24e3e00d71', '9e66fa03-d6ca-466b-b770-26badcb709f3'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:39:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-166ec396-0b90-4e38-99ff-de4f9d8a43b2 tempest-VolumesExtendTest-507425859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:39:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-166ec396-0b90-4e38-99ff-de4f9d8a43b2 tempest-VolumesExtendTest-507425859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:39:12 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-166ec396-0b90-4e38-99ff-de4f9d8a43b2 tempest-VolumesExtendTest-507425859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:39:13 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-166ec396-0b90-4e38-99ff-de4f9d8a43b2 tempest-VolumesExtendTest-507425859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:39:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-166ec396-0b90-4e38-99ff-de4f9d8a43b2 tempest-VolumesExtendTest-507425859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:39:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-166ec396-0b90-4e38-99ff-de4f9d8a43b2 tempest-VolumesExtendTest-507425859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:39:13 devstack sudo[94437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:39:13 devstack sudo[94437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:39:13 devstack sudo[94434]: pam_unix(sudo:session): session closed for user root Sep 18 21:39:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3b8036c7-35d1-4db9-8657-3d89b8ca79e7 tempest-AttachVolumeTestJSON-1287281091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ce85900b-879a-44fb-997e-4758a0aab7f5" returned: 0 in 0.514s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:39:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3b8036c7-35d1-4db9-8657-3d89b8ca79e7 tempest-AttachVolumeTestJSON-1287281091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ce85900b-879a-44fb-997e-4758a0aab7f5 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:39:13 devstack sudo[94442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ce85900b-879a-44fb-997e-4758a0aab7f5 Sep 18 21:39:13 devstack sudo[94442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:39:13 devstack sudo[94437]: pam_unix(sudo:session): session closed for user root Sep 18 21:39:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-166ec396-0b90-4e38-99ff-de4f9d8a43b2 tempest-VolumesExtendTest-507425859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.279s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:39:13 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-166ec396-0b90-4e38-99ff-de4f9d8a43b2 tempest-VolumesExtendTest-507425859 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:39:13 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-166ec396-0b90-4e38-99ff-de4f9d8a43b2 tempest-VolumesExtendTest-507425859 None] Deleted volume successfully. Sep 18 21:39:13 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-166ec396-0b90-4e38-99ff-de4f9d8a43b2 tempest-VolumesExtendTest-507425859 None] Lock "cinder-a07e1137-e3fb-482d-babd-436b60dde2a0-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:39:13 devstack sudo[94442]: pam_unix(sudo:session): session closed for user root Sep 18 21:39:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3b8036c7-35d1-4db9-8657-3d89b8ca79e7 tempest-AttachVolumeTestJSON-1287281091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ce85900b-879a-44fb-997e-4758a0aab7f5" returned: 0 in 0.283s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:39:13 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-3b8036c7-35d1-4db9-8657-3d89b8ca79e7 tempest-AttachVolumeTestJSON-1287281091 None] Lock "cinder-quobyte-ce85900b-879a-44fb-997e-4758a0aab7f5" released by "delete_volume" :: held 0.865s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:39:13 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-3b8036c7-35d1-4db9-8657-3d89b8ca79e7 tempest-AttachVolumeTestJSON-1287281091 None] Created reservations ['b7cfb076-08c2-403f-b5d3-a767d07512ce', '12eb95b6-f9d7-4d13-b295-c5185cc6a4ff', 'a9f6070e-2107-4300-a0ae-19ae4b18b84e', 'af7ab5aa-bf1d-4994-90ce-9ed19982e57a'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:39:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-3b8036c7-35d1-4db9-8657-3d89b8ca79e7 tempest-AttachVolumeTestJSON-1287281091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:39:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-3b8036c7-35d1-4db9-8657-3d89b8ca79e7 tempest-AttachVolumeTestJSON-1287281091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:39:13 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-3b8036c7-35d1-4db9-8657-3d89b8ca79e7 tempest-AttachVolumeTestJSON-1287281091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:39:13 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-3b8036c7-35d1-4db9-8657-3d89b8ca79e7 tempest-AttachVolumeTestJSON-1287281091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:39:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-3b8036c7-35d1-4db9-8657-3d89b8ca79e7 tempest-AttachVolumeTestJSON-1287281091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:39:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3b8036c7-35d1-4db9-8657-3d89b8ca79e7 tempest-AttachVolumeTestJSON-1287281091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:39:13 devstack sudo[94447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:39:13 devstack sudo[94447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:39:14 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-8223c687-fa4e-4494-a00d-dbd534b75316 tempest-AttachVolumeTestJSON-1287281091 None] Acquiring lock "cinder-7bcfb86f-79cc-4079-abee-e264e5ada6bb-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:39:14 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-8223c687-fa4e-4494-a00d-dbd534b75316 tempest-AttachVolumeTestJSON-1287281091 None] Lock "cinder-7bcfb86f-79cc-4079-abee-e264e5ada6bb-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:39:14 devstack sudo[94447]: pam_unix(sudo:session): session closed for user root Sep 18 21:39:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3b8036c7-35d1-4db9-8657-3d89b8ca79e7 tempest-AttachVolumeTestJSON-1287281091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.475s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:39:14 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-3b8036c7-35d1-4db9-8657-3d89b8ca79e7 tempest-AttachVolumeTestJSON-1287281091 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:39:14 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-3b8036c7-35d1-4db9-8657-3d89b8ca79e7 tempest-AttachVolumeTestJSON-1287281091 None] Deleted volume successfully. Sep 18 21:39:14 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-8223c687-fa4e-4494-a00d-dbd534b75316 tempest-AttachVolumeTestJSON-1287281091 None] Acquiring lock "cinder-quobyte-7bcfb86f-79cc-4079-abee-e264e5ada6bb" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:39:14 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-3b8036c7-35d1-4db9-8657-3d89b8ca79e7 tempest-AttachVolumeTestJSON-1287281091 None] Lock "cinder-ce85900b-879a-44fb-997e-4758a0aab7f5-delete_volume" released by "delete_volume" :: held 1.728s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:39:14 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-8223c687-fa4e-4494-a00d-dbd534b75316 tempest-AttachVolumeTestJSON-1287281091 None] Lock "cinder-quobyte-7bcfb86f-79cc-4079-abee-e264e5ada6bb" acquired by "delete_volume" :: waited 0.026s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:39:14 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eaf4bfa-b6a2-4758-913a-3540bc2419ae]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:39:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-8223c687-fa4e-4494-a00d-dbd534b75316 tempest-AttachVolumeTestJSON-1287281091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7bcfb86f-79cc-4079-abee-e264e5ada6bb {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:39:14 devstack sudo[94450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7bcfb86f-79cc-4079-abee-e264e5ada6bb Sep 18 21:39:14 devstack sudo[94450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:39:14 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fe44372-d215-47f8-8625-4660f4125588 tempest-VolumesExtendTest-507425859 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:39:14 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-8fe44372-d215-47f8-8625-4660f4125588 tempest-VolumesExtendTest-507425859 None] Flow 'volume_create_manager' (75d137e3-bad7-409b-8133-6bdc38c1c279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:39:14 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-8fe44372-d215-47f8-8625-4660f4125588 tempest-VolumesExtendTest-507425859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28150fdb-f502-4d3e-8ae6-2b655ab9e029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:39:14 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-8fe44372-d215-47f8-8625-4660f4125588 tempest-VolumesExtendTest-507425859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28150fdb-f502-4d3e-8ae6-2b655ab9e029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:39:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1099366071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=254c6ec5-c576-4e14-9665-71978ff5e262,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d78f505a4ce4c3a99c2977bf74513d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:39:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:39:15Z,use_quota=True,user_id='5eac5fb75cf84aa69a8acf120715f2c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:39:14 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-8fe44372-d215-47f8-8625-4660f4125588 tempest-VolumesExtendTest-507425859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d8c7f0a-659d-466f-b9d4-59e406d85f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:39:14 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-8fe44372-d215-47f8-8625-4660f4125588 tempest-VolumesExtendTest-507425859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d8c7f0a-659d-466f-b9d4-59e406d85f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:39:14 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-8fe44372-d215-47f8-8625-4660f4125588 tempest-VolumesExtendTest-507425859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (530a0565-95fc-43e0-a1da-b2f4a5e76914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:39:14 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-8fe44372-d215-47f8-8625-4660f4125588 tempest-VolumesExtendTest-507425859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (530a0565-95fc-43e0-a1da-b2f4a5e76914) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '254c6ec5-c576-4e14-9665-71978ff5e262', 'volume_name': 'volume-254c6ec5-c576-4e14-9665-71978ff5e262', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:39:14 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-8fe44372-d215-47f8-8625-4660f4125588 tempest-VolumesExtendTest-507425859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fa27e19-d071-415e-8888-c25c05229319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:39:14 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-8fe44372-d215-47f8-8625-4660f4125588 tempest-VolumesExtendTest-507425859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fa27e19-d071-415e-8888-c25c05229319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:39:14 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-8fe44372-d215-47f8-8625-4660f4125588 tempest-VolumesExtendTest-507425859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cba0974-5b2c-409d-9f75-ba00ff2eff35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:39:14 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-8fe44372-d215-47f8-8625-4660f4125588 tempest-VolumesExtendTest-507425859 None] Volume 254c6ec5-c576-4e14-9665-71978ff5e262: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-254c6ec5-c576-4e14-9665-71978ff5e262', 'volume_size': 1} Sep 18 21:39:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-8fe44372-d215-47f8-8625-4660f4125588 tempest-VolumesExtendTest-507425859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:39:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-8fe44372-d215-47f8-8625-4660f4125588 tempest-VolumesExtendTest-507425859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:39:14 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-8fe44372-d215-47f8-8625-4660f4125588 tempest-VolumesExtendTest-507425859 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:39:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1099366071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=254c6ec5-c576-4e14-9665-71978ff5e262,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d78f505a4ce4c3a99c2977bf74513d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:39:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:39:15Z,use_quota=True,user_id='5eac5fb75cf84aa69a8acf120715f2c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:39:14 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-8fe44372-d215-47f8-8625-4660f4125588 tempest-VolumesExtendTest-507425859 None] Creating volume 254c6ec5-c576-4e14-9665-71978ff5e262 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:39:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-8fe44372-d215-47f8-8625-4660f4125588 tempest-VolumesExtendTest-507425859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:39:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-8fe44372-d215-47f8-8625-4660f4125588 tempest-VolumesExtendTest-507425859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:39:14 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-8fe44372-d215-47f8-8625-4660f4125588 tempest-VolumesExtendTest-507425859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:39:14 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-8fe44372-d215-47f8-8625-4660f4125588 tempest-VolumesExtendTest-507425859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:39:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-8fe44372-d215-47f8-8625-4660f4125588 tempest-VolumesExtendTest-507425859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:39:14 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-8fe44372-d215-47f8-8625-4660f4125588 tempest-VolumesExtendTest-507425859 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:39:14 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-8fe44372-d215-47f8-8625-4660f4125588 tempest-VolumesExtendTest-507425859 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:39:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-8fe44372-d215-47f8-8625-4660f4125588 tempest-VolumesExtendTest-507425859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-254c6ec5-c576-4e14-9665-71978ff5e262 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:39:14 devstack sudo[94450]: pam_unix(sudo:session): session closed for user root Sep 18 21:39:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-8223c687-fa4e-4494-a00d-dbd534b75316 tempest-AttachVolumeTestJSON-1287281091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7bcfb86f-79cc-4079-abee-e264e5ada6bb" returned: 0 in 0.562s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:39:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-8223c687-fa4e-4494-a00d-dbd534b75316 tempest-AttachVolumeTestJSON-1287281091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7bcfb86f-79cc-4079-abee-e264e5ada6bb {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:39:14 devstack sudo[94455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-254c6ec5-c576-4e14-9665-71978ff5e262 1073741824 Sep 18 21:39:14 devstack sudo[94455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:39:14 devstack sudo[94456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7bcfb86f-79cc-4079-abee-e264e5ada6bb Sep 18 21:39:14 devstack sudo[94456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:39:15 devstack sudo[94456]: pam_unix(sudo:session): session closed for user root Sep 18 21:39:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-8223c687-fa4e-4494-a00d-dbd534b75316 tempest-AttachVolumeTestJSON-1287281091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7bcfb86f-79cc-4079-abee-e264e5ada6bb" returned: 0 in 0.398s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:39:15 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-8223c687-fa4e-4494-a00d-dbd534b75316 tempest-AttachVolumeTestJSON-1287281091 None] Lock "cinder-quobyte-7bcfb86f-79cc-4079-abee-e264e5ada6bb" released by "delete_volume" :: held 1.029s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:39:15 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-8223c687-fa4e-4494-a00d-dbd534b75316 tempest-AttachVolumeTestJSON-1287281091 None] Created reservations ['2f1923d6-c9ab-4417-afc3-b00c4805c363', 'b5a2d8fe-bc8f-4218-b4a1-c497999f518e', '4a47fc24-0f88-47fa-a802-26c2b45bbdb9', '5539f393-23fc-434e-9f6d-71ee8acb6b7a'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:39:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-8223c687-fa4e-4494-a00d-dbd534b75316 tempest-AttachVolumeTestJSON-1287281091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:39:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-8223c687-fa4e-4494-a00d-dbd534b75316 tempest-AttachVolumeTestJSON-1287281091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:39:15 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-8223c687-fa4e-4494-a00d-dbd534b75316 tempest-AttachVolumeTestJSON-1287281091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:39:15 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-8223c687-fa4e-4494-a00d-dbd534b75316 tempest-AttachVolumeTestJSON-1287281091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:39:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-8223c687-fa4e-4494-a00d-dbd534b75316 tempest-AttachVolumeTestJSON-1287281091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:39:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-8223c687-fa4e-4494-a00d-dbd534b75316 tempest-AttachVolumeTestJSON-1287281091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:39:15 devstack sudo[94455]: pam_unix(sudo:session): session closed for user root Sep 18 21:39:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-8fe44372-d215-47f8-8625-4660f4125588 tempest-VolumesExtendTest-507425859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-254c6ec5-c576-4e14-9665-71978ff5e262 1073741824" returned: 0 in 0.698s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:39:15 devstack sudo[94479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:39:15 devstack sudo[94479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:39:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-8fe44372-d215-47f8-8625-4660f4125588 tempest-VolumesExtendTest-507425859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-254c6ec5-c576-4e14-9665-71978ff5e262 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:39:15 devstack sudo[94501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-254c6ec5-c576-4e14-9665-71978ff5e262 Sep 18 21:39:15 devstack sudo[94501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:39:15 devstack sudo[94479]: pam_unix(sudo:session): session closed for user root Sep 18 21:39:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-8223c687-fa4e-4494-a00d-dbd534b75316 tempest-AttachVolumeTestJSON-1287281091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.364s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:39:15 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-8223c687-fa4e-4494-a00d-dbd534b75316 tempest-AttachVolumeTestJSON-1287281091 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:39:15 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-8223c687-fa4e-4494-a00d-dbd534b75316 tempest-AttachVolumeTestJSON-1287281091 None] Deleted volume successfully. Sep 18 21:39:15 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-8223c687-fa4e-4494-a00d-dbd534b75316 tempest-AttachVolumeTestJSON-1287281091 None] Lock "cinder-7bcfb86f-79cc-4079-abee-e264e5ada6bb-delete_volume" released by "delete_volume" :: held 1.837s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:39:15 devstack sudo[94501]: pam_unix(sudo:session): session closed for user root Sep 18 21:39:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-8fe44372-d215-47f8-8625-4660f4125588 tempest-VolumesExtendTest-507425859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-254c6ec5-c576-4e14-9665-71978ff5e262" returned: 0 in 0.354s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:39:15 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-8fe44372-d215-47f8-8625-4660f4125588 tempest-VolumesExtendTest-507425859 None] <== create_volume: return (1128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:39:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-8fe44372-d215-47f8-8625-4660f4125588 tempest-VolumesExtendTest-507425859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.131s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:39:15 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-8fe44372-d215-47f8-8625-4660f4125588 tempest-VolumesExtendTest-507425859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cba0974-5b2c-409d-9f75-ba00ff2eff35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-254c6ec5-c576-4e14-9665-71978ff5e262', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:39:15 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-8fe44372-d215-47f8-8625-4660f4125588 tempest-VolumesExtendTest-507425859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54004df1-9a61-49f5-a5b1-11f4c2b19fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:39:16 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-8fe44372-d215-47f8-8625-4660f4125588 tempest-VolumesExtendTest-507425859 None] Volume volume-254c6ec5-c576-4e14-9665-71978ff5e262 (254c6ec5-c576-4e14-9665-71978ff5e262): created successfully Sep 18 21:39:16 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-8fe44372-d215-47f8-8625-4660f4125588 tempest-VolumesExtendTest-507425859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54004df1-9a61-49f5-a5b1-11f4c2b19fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:39:16 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-8fe44372-d215-47f8-8625-4660f4125588 tempest-VolumesExtendTest-507425859 None] Flow 'volume_create_manager' (75d137e3-bad7-409b-8133-6bdc38c1c279) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:39:16 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-8fe44372-d215-47f8-8625-4660f4125588 tempest-VolumesExtendTest-507425859 None] Created volume successfully. Sep 18 21:39:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-5fcbe8c7-73a6-4288-8c77-47dafc6c5d99 tempest-VolumesExtendTest-507425859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:39:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-5fcbe8c7-73a6-4288-8c77-47dafc6c5d99 tempest-VolumesExtendTest-507425859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:39:17 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-5fcbe8c7-73a6-4288-8c77-47dafc6c5d99 tempest-VolumesExtendTest-507425859 None] Creating offline snapshot fac325e0-56f3-407e-a291-a0bfc9d94422 of volume 254c6ec5-c576-4e14-9665-71978ff5e262 {{(pid=86136) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 21:39:17 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e00320-59b5-4ac5-a1e4-e9c17b2a5909]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:39:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5fcbe8c7-73a6-4288-8c77-47dafc6c5d99 tempest-VolumesExtendTest-507425859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-254c6ec5-c576-4e14-9665-71978ff5e262 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:39:17 devstack sudo[94508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-254c6ec5-c576-4e14-9665-71978ff5e262 Sep 18 21:39:17 devstack sudo[94508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:39:17 devstack sudo[94508]: pam_unix(sudo:session): session closed for user root Sep 18 21:39:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5fcbe8c7-73a6-4288-8c77-47dafc6c5d99 tempest-VolumesExtendTest-507425859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-254c6ec5-c576-4e14-9665-71978ff5e262" returned: 0 in 0.388s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:39:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5fcbe8c7-73a6-4288-8c77-47dafc6c5d99 tempest-VolumesExtendTest-507425859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-254c6ec5-c576-4e14-9665-71978ff5e262,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-254c6ec5-c576-4e14-9665-71978ff5e262.fac325e0-56f3-407e-a291-a0bfc9d94422 1G {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:39:17 devstack sudo[94514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-254c6ec5-c576-4e14-9665-71978ff5e262,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-254c6ec5-c576-4e14-9665-71978ff5e262.fac325e0-56f3-407e-a291-a0bfc9d94422 1G Sep 18 21:39:17 devstack sudo[94514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:39:17 devstack sudo[94514]: pam_unix(sudo:session): session closed for user root Sep 18 21:39:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5fcbe8c7-73a6-4288-8c77-47dafc6c5d99 tempest-VolumesExtendTest-507425859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-254c6ec5-c576-4e14-9665-71978ff5e262,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-254c6ec5-c576-4e14-9665-71978ff5e262.fac325e0-56f3-407e-a291-a0bfc9d94422 1G" returned: 0 in 0.541s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:39:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5fcbe8c7-73a6-4288-8c77-47dafc6c5d99 tempest-VolumesExtendTest-507425859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-254c6ec5-c576-4e14-9665-71978ff5e262 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-254c6ec5-c576-4e14-9665-71978ff5e262.fac325e0-56f3-407e-a291-a0bfc9d94422 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:39:18 devstack sudo[94520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-254c6ec5-c576-4e14-9665-71978ff5e262 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-254c6ec5-c576-4e14-9665-71978ff5e262.fac325e0-56f3-407e-a291-a0bfc9d94422 Sep 18 21:39:18 devstack sudo[94520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:39:18 devstack sudo[94520]: pam_unix(sudo:session): session closed for user root Sep 18 21:39:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5fcbe8c7-73a6-4288-8c77-47dafc6c5d99 tempest-VolumesExtendTest-507425859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-254c6ec5-c576-4e14-9665-71978ff5e262 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-254c6ec5-c576-4e14-9665-71978ff5e262.fac325e0-56f3-407e-a291-a0bfc9d94422" returned: 0 in 0.372s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:39:18 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-5fcbe8c7-73a6-4288-8c77-47dafc6c5d99 tempest-VolumesExtendTest-507425859 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-254c6ec5-c576-4e14-9665-71978ff5e262.fac325e0-56f3-407e-a291-a0bfc9d94422 is being set with open permissions: ugo+rw Sep 18 21:39:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5fcbe8c7-73a6-4288-8c77-47dafc6c5d99 tempest-VolumesExtendTest-507425859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-254c6ec5-c576-4e14-9665-71978ff5e262.fac325e0-56f3-407e-a291-a0bfc9d94422 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:39:18 devstack sudo[94526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-254c6ec5-c576-4e14-9665-71978ff5e262.fac325e0-56f3-407e-a291-a0bfc9d94422 Sep 18 21:39:18 devstack sudo[94526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:39:18 devstack sudo[94526]: pam_unix(sudo:session): session closed for user root Sep 18 21:39:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5fcbe8c7-73a6-4288-8c77-47dafc6c5d99 tempest-VolumesExtendTest-507425859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-254c6ec5-c576-4e14-9665-71978ff5e262.fac325e0-56f3-407e-a291-a0bfc9d94422" returned: 0 in 0.287s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:39:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5fcbe8c7-73a6-4288-8c77-47dafc6c5d99 tempest-VolumesExtendTest-507425859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-254c6ec5-c576-4e14-9665-71978ff5e262.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:39:18 devstack sudo[94529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-254c6ec5-c576-4e14-9665-71978ff5e262.info Sep 18 21:39:18 devstack sudo[94529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:39:19 devstack sudo[94529]: pam_unix(sudo:session): session closed for user root Sep 18 21:39:19 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5fcbe8c7-73a6-4288-8c77-47dafc6c5d99 tempest-VolumesExtendTest-507425859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-254c6ec5-c576-4e14-9665-71978ff5e262.info" returned: 0 in 0.345s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:39:19 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-5fcbe8c7-73a6-4288-8c77-47dafc6c5d99 tempest-VolumesExtendTest-507425859 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-254c6ec5-c576-4e14-9665-71978ff5e262.info is being set with open permissions: ugo+rw Sep 18 21:39:19 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5fcbe8c7-73a6-4288-8c77-47dafc6c5d99 tempest-VolumesExtendTest-507425859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-254c6ec5-c576-4e14-9665-71978ff5e262.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:39:19 devstack sudo[94533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-254c6ec5-c576-4e14-9665-71978ff5e262.info Sep 18 21:39:19 devstack sudo[94533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:39:19 devstack sudo[94533]: pam_unix(sudo:session): session closed for user root Sep 18 21:39:19 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5fcbe8c7-73a6-4288-8c77-47dafc6c5d99 tempest-VolumesExtendTest-507425859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-254c6ec5-c576-4e14-9665-71978ff5e262.info" returned: 0 in 0.310s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:39:19 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-5fcbe8c7-73a6-4288-8c77-47dafc6c5d99 tempest-VolumesExtendTest-507425859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.382s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:39:19 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-5fcbe8c7-73a6-4288-8c77-47dafc6c5d99 tempest-VolumesExtendTest-507425859 None] Create snapshot completed successfully Sep 18 21:39:20 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-1ecf6ea6-96b4-49c7-ad21-aa0826bc4d77 tempest-VolumesExtendTest-507425859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:39:20 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-1ecf6ea6-96b4-49c7-ad21-aa0826bc4d77 tempest-VolumesExtendTest-507425859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:39:20 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1d6128-aae4-41d7-80b2-a209121c0f83]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:39:20 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1ecf6ea6-96b4-49c7-ad21-aa0826bc4d77 tempest-VolumesExtendTest-507425859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-254c6ec5-c576-4e14-9665-71978ff5e262 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:39:20 devstack sudo[94537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-254c6ec5-c576-4e14-9665-71978ff5e262 Sep 18 21:39:20 devstack sudo[94537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:39:20 devstack sudo[94537]: pam_unix(sudo:session): session closed for user root Sep 18 21:39:20 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1ecf6ea6-96b4-49c7-ad21-aa0826bc4d77 tempest-VolumesExtendTest-507425859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-254c6ec5-c576-4e14-9665-71978ff5e262" returned: 0 in 0.448s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:39:20 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1ecf6ea6-96b4-49c7-ad21-aa0826bc4d77 tempest-VolumesExtendTest-507425859 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-254c6ec5-c576-4e14-9665-71978ff5e262.fac325e0-56f3-407e-a291-a0bfc9d94422 2G {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:39:20 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1ecf6ea6-96b4-49c7-ad21-aa0826bc4d77 tempest-VolumesExtendTest-507425859 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-254c6ec5-c576-4e14-9665-71978ff5e262.fac325e0-56f3-407e-a291-a0bfc9d94422 2G" returned: 0 in 0.170s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:39:20 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-1ecf6ea6-96b4-49c7-ad21-aa0826bc4d77 tempest-VolumesExtendTest-507425859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.667s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:39:21 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-1ecf6ea6-96b4-49c7-ad21-aa0826bc4d77 tempest-VolumesExtendTest-507425859 None] Extend volume completed successfully. Sep 18 21:39:21 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-c818ae40-0ef3-427c-8a0a-f89ff73475ad tempest-VolumesExtendTest-507425859 None] Acquiring lock "cinder-fac325e0-56f3-407e-a291-a0bfc9d94422-delete_snapshot" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:39:21 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-c818ae40-0ef3-427c-8a0a-f89ff73475ad tempest-VolumesExtendTest-507425859 None] Lock "cinder-fac325e0-56f3-407e-a291-a0bfc9d94422-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:39:21 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-c818ae40-0ef3-427c-8a0a-f89ff73475ad tempest-VolumesExtendTest-507425859 None] Acquiring lock "cinder-quobyte-254c6ec5-c576-4e14-9665-71978ff5e262" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:39:21 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-c818ae40-0ef3-427c-8a0a-f89ff73475ad tempest-VolumesExtendTest-507425859 None] Lock "cinder-quobyte-254c6ec5-c576-4e14-9665-71978ff5e262" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:39:21 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-c818ae40-0ef3-427c-8a0a-f89ff73475ad tempest-VolumesExtendTest-507425859 None] Acquiring lock "cinder-quobyte-fac325e0-56f3-407e-a291-a0bfc9d94422" by "_delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:39:21 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-c818ae40-0ef3-427c-8a0a-f89ff73475ad tempest-VolumesExtendTest-507425859 None] Lock "cinder-quobyte-fac325e0-56f3-407e-a291-a0bfc9d94422" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:39:21 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-c818ae40-0ef3-427c-8a0a-f89ff73475ad tempest-VolumesExtendTest-507425859 None] Deleting offline snapshot fac325e0-56f3-407e-a291-a0bfc9d94422 of volume 254c6ec5-c576-4e14-9665-71978ff5e262 {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 21:39:21 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-c818ae40-0ef3-427c-8a0a-f89ff73475ad tempest-VolumesExtendTest-507425859 None] snapshot_file for this snap is: volume-254c6ec5-c576-4e14-9665-71978ff5e262.fac325e0-56f3-407e-a291-a0bfc9d94422 {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 21:39:21 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bcf566f-0d52-4b85-8c6f-519fc50f0ec6]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:39:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c818ae40-0ef3-427c-8a0a-f89ff73475ad tempest-VolumesExtendTest-507425859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-254c6ec5-c576-4e14-9665-71978ff5e262.fac325e0-56f3-407e-a291-a0bfc9d94422 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:39:22 devstack sudo[94547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-254c6ec5-c576-4e14-9665-71978ff5e262.fac325e0-56f3-407e-a291-a0bfc9d94422 Sep 18 21:39:22 devstack sudo[94547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:39:22 devstack sudo[94547]: pam_unix(sudo:session): session closed for user root Sep 18 21:39:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c818ae40-0ef3-427c-8a0a-f89ff73475ad tempest-VolumesExtendTest-507425859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-254c6ec5-c576-4e14-9665-71978ff5e262.fac325e0-56f3-407e-a291-a0bfc9d94422" returned: 0 in 0.571s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:39:22 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-c818ae40-0ef3-427c-8a0a-f89ff73475ad tempest-VolumesExtendTest-507425859 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-254c6ec5-c576-4e14-9665-71978ff5e262(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86136) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 21:39:22 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[e01bd45e-0da5-4052-ac1d-68b3330a926b]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:39:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c818ae40-0ef3-427c-8a0a-f89ff73475ad tempest-VolumesExtendTest-507425859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-254c6ec5-c576-4e14-9665-71978ff5e262 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:39:22 devstack sudo[94555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-254c6ec5-c576-4e14-9665-71978ff5e262 Sep 18 21:39:22 devstack sudo[94555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:39:22 devstack sudo[94555]: pam_unix(sudo:session): session closed for user root Sep 18 21:39:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c818ae40-0ef3-427c-8a0a-f89ff73475ad tempest-VolumesExtendTest-507425859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-254c6ec5-c576-4e14-9665-71978ff5e262" returned: 0 in 0.530s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:39:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c818ae40-0ef3-427c-8a0a-f89ff73475ad tempest-VolumesExtendTest-507425859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-254c6ec5-c576-4e14-9665-71978ff5e262.fac325e0-56f3-407e-a291-a0bfc9d94422 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:39:23 devstack sudo[94561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-254c6ec5-c576-4e14-9665-71978ff5e262.fac325e0-56f3-407e-a291-a0bfc9d94422 Sep 18 21:39:23 devstack sudo[94561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:39:23 devstack sudo[94561]: pam_unix(sudo:session): session closed for user root Sep 18 21:39:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c818ae40-0ef3-427c-8a0a-f89ff73475ad tempest-VolumesExtendTest-507425859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-254c6ec5-c576-4e14-9665-71978ff5e262.fac325e0-56f3-407e-a291-a0bfc9d94422" returned: 0 in 0.511s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:39:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c818ae40-0ef3-427c-8a0a-f89ff73475ad tempest-VolumesExtendTest-507425859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-254c6ec5-c576-4e14-9665-71978ff5e262.fac325e0-56f3-407e-a291-a0bfc9d94422 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:39:23 devstack sudo[94566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-254c6ec5-c576-4e14-9665-71978ff5e262.fac325e0-56f3-407e-a291-a0bfc9d94422 Sep 18 21:39:23 devstack sudo[94566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:39:23 devstack sudo[94566]: pam_unix(sudo:session): session closed for user root Sep 18 21:39:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c818ae40-0ef3-427c-8a0a-f89ff73475ad tempest-VolumesExtendTest-507425859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-254c6ec5-c576-4e14-9665-71978ff5e262.fac325e0-56f3-407e-a291-a0bfc9d94422" returned: 0 in 0.305s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:39:23 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-c818ae40-0ef3-427c-8a0a-f89ff73475ad tempest-VolumesExtendTest-507425859 None] Lock "cinder-quobyte-fac325e0-56f3-407e-a291-a0bfc9d94422" released by "_delete_snapshot" :: held 2.095s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:39:23 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-c818ae40-0ef3-427c-8a0a-f89ff73475ad tempest-VolumesExtendTest-507425859 None] Lock "cinder-quobyte-254c6ec5-c576-4e14-9665-71978ff5e262" released by "delete_snapshot" :: held 2.119s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:39:23 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-c818ae40-0ef3-427c-8a0a-f89ff73475ad tempest-VolumesExtendTest-507425859 None] Created reservations ['2d741208-89d8-419e-8ae6-b3952eb73113', '2682ca75-29a5-47d1-b933-4baab6bdb2fb', 'd141f857-d8f7-4215-893b-fdc56881d6b4', '5a76251f-9a7f-468a-9d76-3d4639edf7f4'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:39:24 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-c818ae40-0ef3-427c-8a0a-f89ff73475ad tempest-VolumesExtendTest-507425859 None] Delete snapshot completed successfully. Sep 18 21:39:24 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-c818ae40-0ef3-427c-8a0a-f89ff73475ad tempest-VolumesExtendTest-507425859 None] Lock "cinder-fac325e0-56f3-407e-a291-a0bfc9d94422-delete_snapshot" released by "delete_snapshot" :: held 2.345s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:39:25 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-5452a89a-1802-4e82-bf60-42c39f244ab6 tempest-VolumesExtendTest-507425859 None] Acquiring lock "cinder-254c6ec5-c576-4e14-9665-71978ff5e262-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:39:25 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-5452a89a-1802-4e82-bf60-42c39f244ab6 tempest-VolumesExtendTest-507425859 None] Lock "cinder-254c6ec5-c576-4e14-9665-71978ff5e262-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:39:25 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-5452a89a-1802-4e82-bf60-42c39f244ab6 tempest-VolumesExtendTest-507425859 None] Acquiring lock "cinder-quobyte-254c6ec5-c576-4e14-9665-71978ff5e262" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:39:25 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-5452a89a-1802-4e82-bf60-42c39f244ab6 tempest-VolumesExtendTest-507425859 None] Lock "cinder-quobyte-254c6ec5-c576-4e14-9665-71978ff5e262" acquired by "delete_volume" :: waited 0.023s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:39:25 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[c38a70cc-9ef2-419d-a47c-7533af0cd728]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:39:25 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5452a89a-1802-4e82-bf60-42c39f244ab6 tempest-VolumesExtendTest-507425859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-254c6ec5-c576-4e14-9665-71978ff5e262 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:39:25 devstack sudo[94569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-254c6ec5-c576-4e14-9665-71978ff5e262 Sep 18 21:39:25 devstack sudo[94569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:39:25 devstack sudo[94569]: pam_unix(sudo:session): session closed for user root Sep 18 21:39:25 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5452a89a-1802-4e82-bf60-42c39f244ab6 tempest-VolumesExtendTest-507425859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-254c6ec5-c576-4e14-9665-71978ff5e262" returned: 0 in 0.481s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:39:25 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5452a89a-1802-4e82-bf60-42c39f244ab6 tempest-VolumesExtendTest-507425859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-254c6ec5-c576-4e14-9665-71978ff5e262 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:39:25 devstack sudo[94574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-254c6ec5-c576-4e14-9665-71978ff5e262 Sep 18 21:39:25 devstack sudo[94574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:39:25 devstack sudo[94574]: pam_unix(sudo:session): session closed for user root Sep 18 21:39:25 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5452a89a-1802-4e82-bf60-42c39f244ab6 tempest-VolumesExtendTest-507425859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-254c6ec5-c576-4e14-9665-71978ff5e262" returned: 0 in 0.292s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:39:26 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-5452a89a-1802-4e82-bf60-42c39f244ab6 tempest-VolumesExtendTest-507425859 None] Lock "cinder-quobyte-254c6ec5-c576-4e14-9665-71978ff5e262" released by "delete_volume" :: held 0.877s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:39:26 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-5452a89a-1802-4e82-bf60-42c39f244ab6 tempest-VolumesExtendTest-507425859 None] Created reservations ['a1c11dd3-c07e-441b-abcd-43e706d95747', 'cdab1530-0abb-4b08-bf06-b4c1ffaba849', '01efe17e-0747-4d50-b5fd-6e50b2579e56', 'baee4557-6ae7-4ea2-8f63-b0505307db37'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:39:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-5452a89a-1802-4e82-bf60-42c39f244ab6 tempest-VolumesExtendTest-507425859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:39:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-5452a89a-1802-4e82-bf60-42c39f244ab6 tempest-VolumesExtendTest-507425859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:39:26 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-5452a89a-1802-4e82-bf60-42c39f244ab6 tempest-VolumesExtendTest-507425859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:39:26 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-5452a89a-1802-4e82-bf60-42c39f244ab6 tempest-VolumesExtendTest-507425859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:39:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-5452a89a-1802-4e82-bf60-42c39f244ab6 tempest-VolumesExtendTest-507425859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:39:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5452a89a-1802-4e82-bf60-42c39f244ab6 tempest-VolumesExtendTest-507425859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:39:26 devstack sudo[94583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:39:26 devstack sudo[94583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:39:26 devstack sudo[94583]: pam_unix(sudo:session): session closed for user root Sep 18 21:39:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5452a89a-1802-4e82-bf60-42c39f244ab6 tempest-VolumesExtendTest-507425859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.405s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:39:26 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-5452a89a-1802-4e82-bf60-42c39f244ab6 tempest-VolumesExtendTest-507425859 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:39:26 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-5452a89a-1802-4e82-bf60-42c39f244ab6 tempest-VolumesExtendTest-507425859 None] Deleted volume successfully. Sep 18 21:39:26 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-5452a89a-1802-4e82-bf60-42c39f244ab6 tempest-VolumesExtendTest-507425859 None] Lock "cinder-254c6ec5-c576-4e14-9665-71978ff5e262-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:39:27 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [req-8203e5e1-bcc3-405b-aa39-4ebf01564be3 req-4c83ecfa-2372-47b7-b6dd-e47e74f0fec4 tempest-VolumesSnapshotsTestJSON-426396050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:39:27 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [req-8203e5e1-bcc3-405b-aa39-4ebf01564be3 req-4c83ecfa-2372-47b7-b6dd-e47e74f0fec4 tempest-VolumesSnapshotsTestJSON-426396050 None] Flow 'volume_create_manager' (c61485ef-6a8b-4b2c-9acc-6698ba3f11ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:39:27 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [req-8203e5e1-bcc3-405b-aa39-4ebf01564be3 req-4c83ecfa-2372-47b7-b6dd-e47e74f0fec4 tempest-VolumesSnapshotsTestJSON-426396050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3c4b8cf-b763-4bc1-8daa-6cfe4a2c047b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:39:27 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [req-8203e5e1-bcc3-405b-aa39-4ebf01564be3 req-4c83ecfa-2372-47b7-b6dd-e47e74f0fec4 tempest-VolumesSnapshotsTestJSON-426396050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3c4b8cf-b763-4bc1-8daa-6cfe4a2c047b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:39:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-97066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5f3a72c-6c81-47b7-9642-781eac6c2479,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cf7e34ebf1b4543bb6786fb26a06119',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:39:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:39:28Z,use_quota=True,user_id='da9c67d6a7314183a6d36b32ac352bb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:39:27 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [req-8203e5e1-bcc3-405b-aa39-4ebf01564be3 req-4c83ecfa-2372-47b7-b6dd-e47e74f0fec4 tempest-VolumesSnapshotsTestJSON-426396050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abd537db-0e5c-4d9c-8bc2-a6c5dc974b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:39:27 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [req-8203e5e1-bcc3-405b-aa39-4ebf01564be3 req-4c83ecfa-2372-47b7-b6dd-e47e74f0fec4 tempest-VolumesSnapshotsTestJSON-426396050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abd537db-0e5c-4d9c-8bc2-a6c5dc974b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:39:27 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [req-8203e5e1-bcc3-405b-aa39-4ebf01564be3 req-4c83ecfa-2372-47b7-b6dd-e47e74f0fec4 tempest-VolumesSnapshotsTestJSON-426396050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d02fa40a-9047-498f-95b8-18132f720a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:39:27 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [req-8203e5e1-bcc3-405b-aa39-4ebf01564be3 req-4c83ecfa-2372-47b7-b6dd-e47e74f0fec4 tempest-VolumesSnapshotsTestJSON-426396050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d02fa40a-9047-498f-95b8-18132f720a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5f3a72c-6c81-47b7-9642-781eac6c2479', 'volume_name': 'volume-a5f3a72c-6c81-47b7-9642-781eac6c2479', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:39:27 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [req-8203e5e1-bcc3-405b-aa39-4ebf01564be3 req-4c83ecfa-2372-47b7-b6dd-e47e74f0fec4 tempest-VolumesSnapshotsTestJSON-426396050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (600df0ae-4dfe-47e2-9a5d-86d6f182d71d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:39:27 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [req-8203e5e1-bcc3-405b-aa39-4ebf01564be3 req-4c83ecfa-2372-47b7-b6dd-e47e74f0fec4 tempest-VolumesSnapshotsTestJSON-426396050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (600df0ae-4dfe-47e2-9a5d-86d6f182d71d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:39:27 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [req-8203e5e1-bcc3-405b-aa39-4ebf01564be3 req-4c83ecfa-2372-47b7-b6dd-e47e74f0fec4 tempest-VolumesSnapshotsTestJSON-426396050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a1a3bde-15e5-4e6b-b28b-3adc7090da71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:39:27 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [req-8203e5e1-bcc3-405b-aa39-4ebf01564be3 req-4c83ecfa-2372-47b7-b6dd-e47e74f0fec4 tempest-VolumesSnapshotsTestJSON-426396050 None] Volume a5f3a72c-6c81-47b7-9642-781eac6c2479: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5f3a72c-6c81-47b7-9642-781eac6c2479', 'volume_size': 1} Sep 18 21:39:27 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-8203e5e1-bcc3-405b-aa39-4ebf01564be3 req-4c83ecfa-2372-47b7-b6dd-e47e74f0fec4 tempest-VolumesSnapshotsTestJSON-426396050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:39:27 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-8203e5e1-bcc3-405b-aa39-4ebf01564be3 req-4c83ecfa-2372-47b7-b6dd-e47e74f0fec4 tempest-VolumesSnapshotsTestJSON-426396050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:39:27 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [req-8203e5e1-bcc3-405b-aa39-4ebf01564be3 req-4c83ecfa-2372-47b7-b6dd-e47e74f0fec4 tempest-VolumesSnapshotsTestJSON-426396050 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:39:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-97066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5f3a72c-6c81-47b7-9642-781eac6c2479,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cf7e34ebf1b4543bb6786fb26a06119',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:39:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:39:28Z,use_quota=True,user_id='da9c67d6a7314183a6d36b32ac352bb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:39:27 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [req-8203e5e1-bcc3-405b-aa39-4ebf01564be3 req-4c83ecfa-2372-47b7-b6dd-e47e74f0fec4 tempest-VolumesSnapshotsTestJSON-426396050 None] Creating volume a5f3a72c-6c81-47b7-9642-781eac6c2479 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:39:27 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-8203e5e1-bcc3-405b-aa39-4ebf01564be3 req-4c83ecfa-2372-47b7-b6dd-e47e74f0fec4 tempest-VolumesSnapshotsTestJSON-426396050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:39:27 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-8203e5e1-bcc3-405b-aa39-4ebf01564be3 req-4c83ecfa-2372-47b7-b6dd-e47e74f0fec4 tempest-VolumesSnapshotsTestJSON-426396050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:39:27 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [req-8203e5e1-bcc3-405b-aa39-4ebf01564be3 req-4c83ecfa-2372-47b7-b6dd-e47e74f0fec4 tempest-VolumesSnapshotsTestJSON-426396050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:39:27 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [req-8203e5e1-bcc3-405b-aa39-4ebf01564be3 req-4c83ecfa-2372-47b7-b6dd-e47e74f0fec4 tempest-VolumesSnapshotsTestJSON-426396050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:39:27 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-8203e5e1-bcc3-405b-aa39-4ebf01564be3 req-4c83ecfa-2372-47b7-b6dd-e47e74f0fec4 tempest-VolumesSnapshotsTestJSON-426396050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:39:27 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [req-8203e5e1-bcc3-405b-aa39-4ebf01564be3 req-4c83ecfa-2372-47b7-b6dd-e47e74f0fec4 tempest-VolumesSnapshotsTestJSON-426396050 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:39:27 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [req-8203e5e1-bcc3-405b-aa39-4ebf01564be3 req-4c83ecfa-2372-47b7-b6dd-e47e74f0fec4 tempest-VolumesSnapshotsTestJSON-426396050 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:39:27 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [req-8203e5e1-bcc3-405b-aa39-4ebf01564be3 req-4c83ecfa-2372-47b7-b6dd-e47e74f0fec4 tempest-VolumesSnapshotsTestJSON-426396050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5f3a72c-6c81-47b7-9642-781eac6c2479 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:39:27 devstack sudo[94586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5f3a72c-6c81-47b7-9642-781eac6c2479 1073741824 Sep 18 21:39:27 devstack sudo[94586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:39:28 devstack sudo[94586]: pam_unix(sudo:session): session closed for user root Sep 18 21:39:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [req-8203e5e1-bcc3-405b-aa39-4ebf01564be3 req-4c83ecfa-2372-47b7-b6dd-e47e74f0fec4 tempest-VolumesSnapshotsTestJSON-426396050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5f3a72c-6c81-47b7-9642-781eac6c2479 1073741824" returned: 0 in 0.538s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:39:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [req-8203e5e1-bcc3-405b-aa39-4ebf01564be3 req-4c83ecfa-2372-47b7-b6dd-e47e74f0fec4 tempest-VolumesSnapshotsTestJSON-426396050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5f3a72c-6c81-47b7-9642-781eac6c2479 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:39:28 devstack sudo[94592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5f3a72c-6c81-47b7-9642-781eac6c2479 Sep 18 21:39:28 devstack sudo[94592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:39:28 devstack sudo[94592]: pam_unix(sudo:session): session closed for user root Sep 18 21:39:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [req-8203e5e1-bcc3-405b-aa39-4ebf01564be3 req-4c83ecfa-2372-47b7-b6dd-e47e74f0fec4 tempest-VolumesSnapshotsTestJSON-426396050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5f3a72c-6c81-47b7-9642-781eac6c2479" returned: 0 in 0.374s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:39:28 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [req-8203e5e1-bcc3-405b-aa39-4ebf01564be3 req-4c83ecfa-2372-47b7-b6dd-e47e74f0fec4 tempest-VolumesSnapshotsTestJSON-426396050 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:39:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-8203e5e1-bcc3-405b-aa39-4ebf01564be3 req-4c83ecfa-2372-47b7-b6dd-e47e74f0fec4 tempest-VolumesSnapshotsTestJSON-426396050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:39:28 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [req-8203e5e1-bcc3-405b-aa39-4ebf01564be3 req-4c83ecfa-2372-47b7-b6dd-e47e74f0fec4 tempest-VolumesSnapshotsTestJSON-426396050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a1a3bde-15e5-4e6b-b28b-3adc7090da71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5f3a72c-6c81-47b7-9642-781eac6c2479', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:39:28 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [req-8203e5e1-bcc3-405b-aa39-4ebf01564be3 req-4c83ecfa-2372-47b7-b6dd-e47e74f0fec4 tempest-VolumesSnapshotsTestJSON-426396050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (125a117f-330d-49e4-9ee8-11f5df1b4909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:39:28 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [req-8203e5e1-bcc3-405b-aa39-4ebf01564be3 req-4c83ecfa-2372-47b7-b6dd-e47e74f0fec4 tempest-VolumesSnapshotsTestJSON-426396050 None] Volume volume-a5f3a72c-6c81-47b7-9642-781eac6c2479 (a5f3a72c-6c81-47b7-9642-781eac6c2479): created successfully Sep 18 21:39:28 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [req-8203e5e1-bcc3-405b-aa39-4ebf01564be3 req-4c83ecfa-2372-47b7-b6dd-e47e74f0fec4 tempest-VolumesSnapshotsTestJSON-426396050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (125a117f-330d-49e4-9ee8-11f5df1b4909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:39:28 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [req-8203e5e1-bcc3-405b-aa39-4ebf01564be3 req-4c83ecfa-2372-47b7-b6dd-e47e74f0fec4 tempest-VolumesSnapshotsTestJSON-426396050 None] Flow 'volume_create_manager' (c61485ef-6a8b-4b2c-9acc-6698ba3f11ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:39:28 devstack cinder-volume[86136]: INFO cinder.volume.manager [req-8203e5e1-bcc3-405b-aa39-4ebf01564be3 req-4c83ecfa-2372-47b7-b6dd-e47e74f0fec4 tempest-VolumesSnapshotsTestJSON-426396050 None] Created volume successfully. Sep 18 21:39:30 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-53a39bbd-77d4-4c76-9dff-821ca1149ffd req-eb21a68c-7906-4a7f-ac69-c0aca5cdc052 tempest-VolumesSnapshotsTestJSON-426396050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:39:30 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-53a39bbd-77d4-4c76-9dff-821ca1149ffd req-eb21a68c-7906-4a7f-ac69-c0aca5cdc052 tempest-VolumesSnapshotsTestJSON-426396050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:39:30 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [req-53a39bbd-77d4-4c76-9dff-821ca1149ffd req-eb21a68c-7906-4a7f-ac69-c0aca5cdc052 tempest-VolumesSnapshotsTestJSON-426396050 None] Creating offline snapshot f682e665-4237-4e98-99bc-92cb2a1a51df of volume a5f3a72c-6c81-47b7-9642-781eac6c2479 {{(pid=86136) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 21:39:30 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[955ba30c-69cd-49ad-8591-9f9ec71c684e]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:39:30 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [req-53a39bbd-77d4-4c76-9dff-821ca1149ffd req-eb21a68c-7906-4a7f-ac69-c0aca5cdc052 tempest-VolumesSnapshotsTestJSON-426396050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5f3a72c-6c81-47b7-9642-781eac6c2479 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:39:30 devstack sudo[94596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5f3a72c-6c81-47b7-9642-781eac6c2479 Sep 18 21:39:30 devstack sudo[94596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:39:30 devstack sudo[94596]: pam_unix(sudo:session): session closed for user root Sep 18 21:39:30 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [req-53a39bbd-77d4-4c76-9dff-821ca1149ffd req-eb21a68c-7906-4a7f-ac69-c0aca5cdc052 tempest-VolumesSnapshotsTestJSON-426396050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5f3a72c-6c81-47b7-9642-781eac6c2479" returned: 0 in 0.609s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:39:30 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [req-53a39bbd-77d4-4c76-9dff-821ca1149ffd req-eb21a68c-7906-4a7f-ac69-c0aca5cdc052 tempest-VolumesSnapshotsTestJSON-426396050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5f3a72c-6c81-47b7-9642-781eac6c2479,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5f3a72c-6c81-47b7-9642-781eac6c2479.f682e665-4237-4e98-99bc-92cb2a1a51df 1G {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:39:30 devstack sudo[94601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5f3a72c-6c81-47b7-9642-781eac6c2479,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5f3a72c-6c81-47b7-9642-781eac6c2479.f682e665-4237-4e98-99bc-92cb2a1a51df 1G Sep 18 21:39:30 devstack sudo[94601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:39:31 devstack sudo[94601]: pam_unix(sudo:session): session closed for user root Sep 18 21:39:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [req-53a39bbd-77d4-4c76-9dff-821ca1149ffd req-eb21a68c-7906-4a7f-ac69-c0aca5cdc052 tempest-VolumesSnapshotsTestJSON-426396050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5f3a72c-6c81-47b7-9642-781eac6c2479,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5f3a72c-6c81-47b7-9642-781eac6c2479.f682e665-4237-4e98-99bc-92cb2a1a51df 1G" returned: 0 in 0.565s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:39:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [req-53a39bbd-77d4-4c76-9dff-821ca1149ffd req-eb21a68c-7906-4a7f-ac69-c0aca5cdc052 tempest-VolumesSnapshotsTestJSON-426396050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5f3a72c-6c81-47b7-9642-781eac6c2479 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5f3a72c-6c81-47b7-9642-781eac6c2479.f682e665-4237-4e98-99bc-92cb2a1a51df {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:39:31 devstack sudo[94607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5f3a72c-6c81-47b7-9642-781eac6c2479 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5f3a72c-6c81-47b7-9642-781eac6c2479.f682e665-4237-4e98-99bc-92cb2a1a51df Sep 18 21:39:31 devstack sudo[94607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:39:31 devstack sudo[94607]: pam_unix(sudo:session): session closed for user root Sep 18 21:39:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [req-53a39bbd-77d4-4c76-9dff-821ca1149ffd req-eb21a68c-7906-4a7f-ac69-c0aca5cdc052 tempest-VolumesSnapshotsTestJSON-426396050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5f3a72c-6c81-47b7-9642-781eac6c2479 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5f3a72c-6c81-47b7-9642-781eac6c2479.f682e665-4237-4e98-99bc-92cb2a1a51df" returned: 0 in 0.363s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:39:31 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [req-53a39bbd-77d4-4c76-9dff-821ca1149ffd req-eb21a68c-7906-4a7f-ac69-c0aca5cdc052 tempest-VolumesSnapshotsTestJSON-426396050 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5f3a72c-6c81-47b7-9642-781eac6c2479.f682e665-4237-4e98-99bc-92cb2a1a51df is being set with open permissions: ugo+rw Sep 18 21:39:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [req-53a39bbd-77d4-4c76-9dff-821ca1149ffd req-eb21a68c-7906-4a7f-ac69-c0aca5cdc052 tempest-VolumesSnapshotsTestJSON-426396050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5f3a72c-6c81-47b7-9642-781eac6c2479.f682e665-4237-4e98-99bc-92cb2a1a51df {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:39:31 devstack sudo[94617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5f3a72c-6c81-47b7-9642-781eac6c2479.f682e665-4237-4e98-99bc-92cb2a1a51df Sep 18 21:39:31 devstack sudo[94617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:39:32 devstack sudo[94617]: pam_unix(sudo:session): session closed for user root Sep 18 21:39:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [req-53a39bbd-77d4-4c76-9dff-821ca1149ffd req-eb21a68c-7906-4a7f-ac69-c0aca5cdc052 tempest-VolumesSnapshotsTestJSON-426396050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5f3a72c-6c81-47b7-9642-781eac6c2479.f682e665-4237-4e98-99bc-92cb2a1a51df" returned: 0 in 0.296s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:39:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [req-53a39bbd-77d4-4c76-9dff-821ca1149ffd req-eb21a68c-7906-4a7f-ac69-c0aca5cdc052 tempest-VolumesSnapshotsTestJSON-426396050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5f3a72c-6c81-47b7-9642-781eac6c2479.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:39:32 devstack sudo[94620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5f3a72c-6c81-47b7-9642-781eac6c2479.info Sep 18 21:39:32 devstack sudo[94620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:39:32 devstack sudo[94620]: pam_unix(sudo:session): session closed for user root Sep 18 21:39:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [req-53a39bbd-77d4-4c76-9dff-821ca1149ffd req-eb21a68c-7906-4a7f-ac69-c0aca5cdc052 tempest-VolumesSnapshotsTestJSON-426396050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5f3a72c-6c81-47b7-9642-781eac6c2479.info" returned: 0 in 0.285s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:39:32 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [req-53a39bbd-77d4-4c76-9dff-821ca1149ffd req-eb21a68c-7906-4a7f-ac69-c0aca5cdc052 tempest-VolumesSnapshotsTestJSON-426396050 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5f3a72c-6c81-47b7-9642-781eac6c2479.info is being set with open permissions: ugo+rw Sep 18 21:39:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [req-53a39bbd-77d4-4c76-9dff-821ca1149ffd req-eb21a68c-7906-4a7f-ac69-c0aca5cdc052 tempest-VolumesSnapshotsTestJSON-426396050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5f3a72c-6c81-47b7-9642-781eac6c2479.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:39:32 devstack sudo[94623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5f3a72c-6c81-47b7-9642-781eac6c2479.info Sep 18 21:39:32 devstack sudo[94623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:39:32 devstack sudo[94623]: pam_unix(sudo:session): session closed for user root Sep 18 21:39:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [req-53a39bbd-77d4-4c76-9dff-821ca1149ffd req-eb21a68c-7906-4a7f-ac69-c0aca5cdc052 tempest-VolumesSnapshotsTestJSON-426396050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5f3a72c-6c81-47b7-9642-781eac6c2479.info" returned: 0 in 0.409s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:39:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-53a39bbd-77d4-4c76-9dff-821ca1149ffd req-eb21a68c-7906-4a7f-ac69-c0aca5cdc052 tempest-VolumesSnapshotsTestJSON-426396050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.676s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:39:32 devstack cinder-volume[86136]: INFO cinder.volume.manager [req-53a39bbd-77d4-4c76-9dff-821ca1149ffd req-eb21a68c-7906-4a7f-ac69-c0aca5cdc052 tempest-VolumesSnapshotsTestJSON-426396050 None] Create snapshot completed successfully Sep 18 21:39:34 devstack cinder-volume[86136]: DEBUG cinder.coordination [req-6c5dd173-096f-414a-b171-60433264b810 req-4d9d6b36-36e0-4212-85b7-9bac200f2dd5 tempest-VolumesSnapshotsTestJSON-426396050 None] Acquiring lock "cinder-f682e665-4237-4e98-99bc-92cb2a1a51df-delete_snapshot" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:39:34 devstack cinder-volume[86136]: DEBUG cinder.coordination [req-6c5dd173-096f-414a-b171-60433264b810 req-4d9d6b36-36e0-4212-85b7-9bac200f2dd5 tempest-VolumesSnapshotsTestJSON-426396050 None] Lock "cinder-f682e665-4237-4e98-99bc-92cb2a1a51df-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:39:34 devstack cinder-volume[86136]: DEBUG cinder.coordination [req-6c5dd173-096f-414a-b171-60433264b810 req-4d9d6b36-36e0-4212-85b7-9bac200f2dd5 tempest-VolumesSnapshotsTestJSON-426396050 None] Acquiring lock "cinder-quobyte-a5f3a72c-6c81-47b7-9642-781eac6c2479" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:39:34 devstack cinder-volume[86136]: DEBUG cinder.coordination [req-6c5dd173-096f-414a-b171-60433264b810 req-4d9d6b36-36e0-4212-85b7-9bac200f2dd5 tempest-VolumesSnapshotsTestJSON-426396050 None] Lock "cinder-quobyte-a5f3a72c-6c81-47b7-9642-781eac6c2479" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:39:34 devstack cinder-volume[86136]: DEBUG cinder.coordination [req-6c5dd173-096f-414a-b171-60433264b810 req-4d9d6b36-36e0-4212-85b7-9bac200f2dd5 tempest-VolumesSnapshotsTestJSON-426396050 None] Acquiring lock "cinder-quobyte-f682e665-4237-4e98-99bc-92cb2a1a51df" by "_delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:39:34 devstack cinder-volume[86136]: DEBUG cinder.coordination [req-6c5dd173-096f-414a-b171-60433264b810 req-4d9d6b36-36e0-4212-85b7-9bac200f2dd5 tempest-VolumesSnapshotsTestJSON-426396050 None] Lock "cinder-quobyte-f682e665-4237-4e98-99bc-92cb2a1a51df" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:39:34 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [req-6c5dd173-096f-414a-b171-60433264b810 req-4d9d6b36-36e0-4212-85b7-9bac200f2dd5 tempest-VolumesSnapshotsTestJSON-426396050 None] Deleting offline snapshot f682e665-4237-4e98-99bc-92cb2a1a51df of volume a5f3a72c-6c81-47b7-9642-781eac6c2479 {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 21:39:34 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [req-6c5dd173-096f-414a-b171-60433264b810 req-4d9d6b36-36e0-4212-85b7-9bac200f2dd5 tempest-VolumesSnapshotsTestJSON-426396050 None] snapshot_file for this snap is: volume-a5f3a72c-6c81-47b7-9642-781eac6c2479.f682e665-4237-4e98-99bc-92cb2a1a51df {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 21:39:34 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5cc93e9-03d0-43e2-afae-ff64b7aa2cd0]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:39:34 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [req-6c5dd173-096f-414a-b171-60433264b810 req-4d9d6b36-36e0-4212-85b7-9bac200f2dd5 tempest-VolumesSnapshotsTestJSON-426396050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5f3a72c-6c81-47b7-9642-781eac6c2479.f682e665-4237-4e98-99bc-92cb2a1a51df {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:39:34 devstack sudo[94626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5f3a72c-6c81-47b7-9642-781eac6c2479.f682e665-4237-4e98-99bc-92cb2a1a51df Sep 18 21:39:34 devstack sudo[94626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:39:34 devstack sudo[94626]: pam_unix(sudo:session): session closed for user root Sep 18 21:39:34 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [req-6c5dd173-096f-414a-b171-60433264b810 req-4d9d6b36-36e0-4212-85b7-9bac200f2dd5 tempest-VolumesSnapshotsTestJSON-426396050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5f3a72c-6c81-47b7-9642-781eac6c2479.f682e665-4237-4e98-99bc-92cb2a1a51df" returned: 0 in 0.462s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:39:34 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [req-6c5dd173-096f-414a-b171-60433264b810 req-4d9d6b36-36e0-4212-85b7-9bac200f2dd5 tempest-VolumesSnapshotsTestJSON-426396050 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5f3a72c-6c81-47b7-9642-781eac6c2479(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86136) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 21:39:34 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b4b156-1f9a-44a0-bbc4-76b78fae847a]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:39:34 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [req-6c5dd173-096f-414a-b171-60433264b810 req-4d9d6b36-36e0-4212-85b7-9bac200f2dd5 tempest-VolumesSnapshotsTestJSON-426396050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5f3a72c-6c81-47b7-9642-781eac6c2479 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:39:34 devstack sudo[94631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5f3a72c-6c81-47b7-9642-781eac6c2479 Sep 18 21:39:34 devstack sudo[94631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:39:35 devstack sudo[94631]: pam_unix(sudo:session): session closed for user root Sep 18 21:39:35 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [req-6c5dd173-096f-414a-b171-60433264b810 req-4d9d6b36-36e0-4212-85b7-9bac200f2dd5 tempest-VolumesSnapshotsTestJSON-426396050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5f3a72c-6c81-47b7-9642-781eac6c2479" returned: 0 in 0.434s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:39:35 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [req-6c5dd173-096f-414a-b171-60433264b810 req-4d9d6b36-36e0-4212-85b7-9bac200f2dd5 tempest-VolumesSnapshotsTestJSON-426396050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5f3a72c-6c81-47b7-9642-781eac6c2479.f682e665-4237-4e98-99bc-92cb2a1a51df {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:39:35 devstack sudo[94636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5f3a72c-6c81-47b7-9642-781eac6c2479.f682e665-4237-4e98-99bc-92cb2a1a51df Sep 18 21:39:35 devstack sudo[94636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:39:35 devstack sudo[94636]: pam_unix(sudo:session): session closed for user root Sep 18 21:39:35 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [req-6c5dd173-096f-414a-b171-60433264b810 req-4d9d6b36-36e0-4212-85b7-9bac200f2dd5 tempest-VolumesSnapshotsTestJSON-426396050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5f3a72c-6c81-47b7-9642-781eac6c2479.f682e665-4237-4e98-99bc-92cb2a1a51df" returned: 0 in 0.481s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:39:35 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [req-6c5dd173-096f-414a-b171-60433264b810 req-4d9d6b36-36e0-4212-85b7-9bac200f2dd5 tempest-VolumesSnapshotsTestJSON-426396050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5f3a72c-6c81-47b7-9642-781eac6c2479.f682e665-4237-4e98-99bc-92cb2a1a51df {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:39:35 devstack sudo[94642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5f3a72c-6c81-47b7-9642-781eac6c2479.f682e665-4237-4e98-99bc-92cb2a1a51df Sep 18 21:39:35 devstack sudo[94642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:39:35 devstack sudo[94642]: pam_unix(sudo:session): session closed for user root Sep 18 21:39:35 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [req-6c5dd173-096f-414a-b171-60433264b810 req-4d9d6b36-36e0-4212-85b7-9bac200f2dd5 tempest-VolumesSnapshotsTestJSON-426396050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5f3a72c-6c81-47b7-9642-781eac6c2479.f682e665-4237-4e98-99bc-92cb2a1a51df" returned: 0 in 0.317s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:39:35 devstack cinder-volume[86136]: DEBUG cinder.coordination [req-6c5dd173-096f-414a-b171-60433264b810 req-4d9d6b36-36e0-4212-85b7-9bac200f2dd5 tempest-VolumesSnapshotsTestJSON-426396050 None] Lock "cinder-quobyte-f682e665-4237-4e98-99bc-92cb2a1a51df" released by "_delete_snapshot" :: held 1.880s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:39:35 devstack cinder-volume[86136]: DEBUG cinder.coordination [req-6c5dd173-096f-414a-b171-60433264b810 req-4d9d6b36-36e0-4212-85b7-9bac200f2dd5 tempest-VolumesSnapshotsTestJSON-426396050 None] Lock "cinder-quobyte-a5f3a72c-6c81-47b7-9642-781eac6c2479" released by "delete_snapshot" :: held 1.917s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:39:36 devstack cinder-volume[86136]: DEBUG cinder.quota [req-6c5dd173-096f-414a-b171-60433264b810 req-4d9d6b36-36e0-4212-85b7-9bac200f2dd5 tempest-VolumesSnapshotsTestJSON-426396050 None] Created reservations ['f3a9adf7-0f78-4704-9911-fd0736618e69', 'c426b10f-f0c1-4232-9b87-3976f6e2e621', '02bc9374-cd36-4b63-b352-7f962ce1b89e', '7e10e9ce-8173-4be1-be56-fc2e0a6df496'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:39:36 devstack cinder-volume[86136]: INFO cinder.volume.manager [req-6c5dd173-096f-414a-b171-60433264b810 req-4d9d6b36-36e0-4212-85b7-9bac200f2dd5 tempest-VolumesSnapshotsTestJSON-426396050 None] Delete snapshot completed successfully. Sep 18 21:39:36 devstack cinder-volume[86136]: DEBUG cinder.coordination [req-6c5dd173-096f-414a-b171-60433264b810 req-4d9d6b36-36e0-4212-85b7-9bac200f2dd5 tempest-VolumesSnapshotsTestJSON-426396050 None] Lock "cinder-f682e665-4237-4e98-99bc-92cb2a1a51df-delete_snapshot" released by "delete_snapshot" :: held 2.134s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:39:36 devstack cinder-volume[86136]: DEBUG cinder.coordination [req-1465e3b7-d048-46dc-b190-918c1dfc3c85 req-b4b56bc6-d313-4f56-b6ee-394d1ac392a3 tempest-VolumesSnapshotsTestJSON-426396050 None] Acquiring lock "cinder-a5f3a72c-6c81-47b7-9642-781eac6c2479-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:39:36 devstack cinder-volume[86136]: DEBUG cinder.coordination [req-1465e3b7-d048-46dc-b190-918c1dfc3c85 req-b4b56bc6-d313-4f56-b6ee-394d1ac392a3 tempest-VolumesSnapshotsTestJSON-426396050 None] Lock "cinder-a5f3a72c-6c81-47b7-9642-781eac6c2479-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:39:36 devstack cinder-volume[86136]: DEBUG cinder.coordination [req-1465e3b7-d048-46dc-b190-918c1dfc3c85 req-b4b56bc6-d313-4f56-b6ee-394d1ac392a3 tempest-VolumesSnapshotsTestJSON-426396050 None] Acquiring lock "cinder-quobyte-a5f3a72c-6c81-47b7-9642-781eac6c2479" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:39:36 devstack cinder-volume[86136]: DEBUG cinder.coordination [req-1465e3b7-d048-46dc-b190-918c1dfc3c85 req-b4b56bc6-d313-4f56-b6ee-394d1ac392a3 tempest-VolumesSnapshotsTestJSON-426396050 None] Lock "cinder-quobyte-a5f3a72c-6c81-47b7-9642-781eac6c2479" acquired by "delete_volume" :: waited 0.031s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:39:36 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d93f48d-e8f7-47ab-93c4-f0ff6c479043]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:39:36 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [req-1465e3b7-d048-46dc-b190-918c1dfc3c85 req-b4b56bc6-d313-4f56-b6ee-394d1ac392a3 tempest-VolumesSnapshotsTestJSON-426396050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5f3a72c-6c81-47b7-9642-781eac6c2479 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:39:36 devstack sudo[94645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5f3a72c-6c81-47b7-9642-781eac6c2479 Sep 18 21:39:36 devstack sudo[94645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:39:37 devstack sudo[94645]: pam_unix(sudo:session): session closed for user root Sep 18 21:39:37 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [req-1465e3b7-d048-46dc-b190-918c1dfc3c85 req-b4b56bc6-d313-4f56-b6ee-394d1ac392a3 tempest-VolumesSnapshotsTestJSON-426396050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5f3a72c-6c81-47b7-9642-781eac6c2479" returned: 0 in 0.509s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:39:37 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [req-1465e3b7-d048-46dc-b190-918c1dfc3c85 req-b4b56bc6-d313-4f56-b6ee-394d1ac392a3 tempest-VolumesSnapshotsTestJSON-426396050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5f3a72c-6c81-47b7-9642-781eac6c2479 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:39:37 devstack sudo[94650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5f3a72c-6c81-47b7-9642-781eac6c2479 Sep 18 21:39:37 devstack sudo[94650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:39:37 devstack sudo[94650]: pam_unix(sudo:session): session closed for user root Sep 18 21:39:37 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [req-1465e3b7-d048-46dc-b190-918c1dfc3c85 req-b4b56bc6-d313-4f56-b6ee-394d1ac392a3 tempest-VolumesSnapshotsTestJSON-426396050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5f3a72c-6c81-47b7-9642-781eac6c2479" returned: 0 in 0.307s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:39:37 devstack cinder-volume[86136]: DEBUG cinder.coordination [req-1465e3b7-d048-46dc-b190-918c1dfc3c85 req-b4b56bc6-d313-4f56-b6ee-394d1ac392a3 tempest-VolumesSnapshotsTestJSON-426396050 None] Lock "cinder-quobyte-a5f3a72c-6c81-47b7-9642-781eac6c2479" released by "delete_volume" :: held 0.954s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:39:37 devstack cinder-volume[86136]: DEBUG cinder.quota [req-1465e3b7-d048-46dc-b190-918c1dfc3c85 req-b4b56bc6-d313-4f56-b6ee-394d1ac392a3 tempest-VolumesSnapshotsTestJSON-426396050 None] Created reservations ['adf3a011-f445-4115-b9c5-c9cae78e11c8', '6f3ce8b9-ddd7-46f8-bfcd-a87129a7bfb7', '80bca7e8-3759-46d7-abaa-c659a827f46e', '4a08043d-fc03-4639-bc68-822a47828981'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:39:37 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-1465e3b7-d048-46dc-b190-918c1dfc3c85 req-b4b56bc6-d313-4f56-b6ee-394d1ac392a3 tempest-VolumesSnapshotsTestJSON-426396050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:39:37 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-1465e3b7-d048-46dc-b190-918c1dfc3c85 req-b4b56bc6-d313-4f56-b6ee-394d1ac392a3 tempest-VolumesSnapshotsTestJSON-426396050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:39:37 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [req-1465e3b7-d048-46dc-b190-918c1dfc3c85 req-b4b56bc6-d313-4f56-b6ee-394d1ac392a3 tempest-VolumesSnapshotsTestJSON-426396050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:39:37 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [req-1465e3b7-d048-46dc-b190-918c1dfc3c85 req-b4b56bc6-d313-4f56-b6ee-394d1ac392a3 tempest-VolumesSnapshotsTestJSON-426396050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:39:37 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-1465e3b7-d048-46dc-b190-918c1dfc3c85 req-b4b56bc6-d313-4f56-b6ee-394d1ac392a3 tempest-VolumesSnapshotsTestJSON-426396050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:39:37 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [req-1465e3b7-d048-46dc-b190-918c1dfc3c85 req-b4b56bc6-d313-4f56-b6ee-394d1ac392a3 tempest-VolumesSnapshotsTestJSON-426396050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:39:37 devstack sudo[94653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:39:37 devstack sudo[94653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:39:37 devstack sudo[94653]: pam_unix(sudo:session): session closed for user root Sep 18 21:39:37 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [req-1465e3b7-d048-46dc-b190-918c1dfc3c85 req-b4b56bc6-d313-4f56-b6ee-394d1ac392a3 tempest-VolumesSnapshotsTestJSON-426396050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.358s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:39:37 devstack cinder-volume[86136]: DEBUG cinder.manager [req-1465e3b7-d048-46dc-b190-918c1dfc3c85 req-b4b56bc6-d313-4f56-b6ee-394d1ac392a3 tempest-VolumesSnapshotsTestJSON-426396050 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:39:38 devstack cinder-volume[86136]: INFO cinder.volume.manager [req-1465e3b7-d048-46dc-b190-918c1dfc3c85 req-b4b56bc6-d313-4f56-b6ee-394d1ac392a3 tempest-VolumesSnapshotsTestJSON-426396050 None] Deleted volume successfully. Sep 18 21:39:38 devstack cinder-volume[86136]: DEBUG cinder.coordination [req-1465e3b7-d048-46dc-b190-918c1dfc3c85 req-b4b56bc6-d313-4f56-b6ee-394d1ac392a3 tempest-VolumesSnapshotsTestJSON-426396050 None] Lock "cinder-a5f3a72c-6c81-47b7-9642-781eac6c2479-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:39:47 devstack cinder-volume[86136]: DEBUG dbcounter [-] [86136] Writing DB stats cinder:UPDATE=113,cinder:SELECT=101,cinder:INSERT=31,cinder:DELETE=5 {{(pid=86136) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 21:39:48 devstack cinder-volume[86136]: DEBUG dbcounter [-] [86136] Writing DB stats cinder:UPDATE=119,cinder:SELECT=98,cinder:DELETE=13,cinder:INSERT=35 {{(pid=86136) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 21:39:56 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-18b33607-7189-46f2-9a1a-b50bfaca317d tempest-VolumesActionsTest-1824150770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:39:56 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-18b33607-7189-46f2-9a1a-b50bfaca317d tempest-VolumesActionsTest-1824150770 None] Flow 'volume_create_manager' (b17bfb94-4963-44cd-a62d-8e6102611350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:39:56 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-18b33607-7189-46f2-9a1a-b50bfaca317d tempest-VolumesActionsTest-1824150770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bcc3388-3382-4a5e-86ec-dcfb8384ca9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:39:56 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-18b33607-7189-46f2-9a1a-b50bfaca317d tempest-VolumesActionsTest-1824150770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bcc3388-3382-4a5e-86ec-dcfb8384ca9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:39:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1645665036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63bf5fd9-95fd-4397-b540-f4bf5b34b295,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c77e6178bbf42ffa1eb7b0d3d137f70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:39:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:39:56Z,use_quota=True,user_id='03c4af1aa0bf4ab08b382ef23a425901',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:39:56 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-18b33607-7189-46f2-9a1a-b50bfaca317d tempest-VolumesActionsTest-1824150770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f375b1ea-c30d-4453-a99d-9048b3df4c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:39:56 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-18b33607-7189-46f2-9a1a-b50bfaca317d tempest-VolumesActionsTest-1824150770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f375b1ea-c30d-4453-a99d-9048b3df4c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:39:56 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-18b33607-7189-46f2-9a1a-b50bfaca317d tempest-VolumesActionsTest-1824150770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3dd85ef-336e-4b92-bbc3-d9aa6a231317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:39:56 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-18b33607-7189-46f2-9a1a-b50bfaca317d tempest-VolumesActionsTest-1824150770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3dd85ef-336e-4b92-bbc3-d9aa6a231317) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63bf5fd9-95fd-4397-b540-f4bf5b34b295', 'volume_name': 'volume-63bf5fd9-95fd-4397-b540-f4bf5b34b295', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:39:56 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-18b33607-7189-46f2-9a1a-b50bfaca317d tempest-VolumesActionsTest-1824150770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (180f6443-e144-4045-9ae3-0eb341cd7ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:39:56 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-18b33607-7189-46f2-9a1a-b50bfaca317d tempest-VolumesActionsTest-1824150770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (180f6443-e144-4045-9ae3-0eb341cd7ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:39:56 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-18b33607-7189-46f2-9a1a-b50bfaca317d tempest-VolumesActionsTest-1824150770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (098480b4-2952-4038-b96e-28f62b173ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:39:56 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-18b33607-7189-46f2-9a1a-b50bfaca317d tempest-VolumesActionsTest-1824150770 None] Volume 63bf5fd9-95fd-4397-b540-f4bf5b34b295: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63bf5fd9-95fd-4397-b540-f4bf5b34b295', 'volume_size': 1} Sep 18 21:39:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-18b33607-7189-46f2-9a1a-b50bfaca317d tempest-VolumesActionsTest-1824150770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:39:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-18b33607-7189-46f2-9a1a-b50bfaca317d tempest-VolumesActionsTest-1824150770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:39:56 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-18b33607-7189-46f2-9a1a-b50bfaca317d tempest-VolumesActionsTest-1824150770 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:39:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1645665036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63bf5fd9-95fd-4397-b540-f4bf5b34b295,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c77e6178bbf42ffa1eb7b0d3d137f70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:39:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:39:56Z,use_quota=True,user_id='03c4af1aa0bf4ab08b382ef23a425901',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:39:56 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-18b33607-7189-46f2-9a1a-b50bfaca317d tempest-VolumesActionsTest-1824150770 None] Creating volume 63bf5fd9-95fd-4397-b540-f4bf5b34b295 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:39:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-18b33607-7189-46f2-9a1a-b50bfaca317d tempest-VolumesActionsTest-1824150770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:39:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-18b33607-7189-46f2-9a1a-b50bfaca317d tempest-VolumesActionsTest-1824150770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:39:56 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-18b33607-7189-46f2-9a1a-b50bfaca317d tempest-VolumesActionsTest-1824150770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:39:56 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-18b33607-7189-46f2-9a1a-b50bfaca317d tempest-VolumesActionsTest-1824150770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:39:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-18b33607-7189-46f2-9a1a-b50bfaca317d tempest-VolumesActionsTest-1824150770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:39:56 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-18b33607-7189-46f2-9a1a-b50bfaca317d tempest-VolumesActionsTest-1824150770 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:39:56 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-18b33607-7189-46f2-9a1a-b50bfaca317d tempest-VolumesActionsTest-1824150770 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:39:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-18b33607-7189-46f2-9a1a-b50bfaca317d tempest-VolumesActionsTest-1824150770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-63bf5fd9-95fd-4397-b540-f4bf5b34b295 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:39:56 devstack sudo[94782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-63bf5fd9-95fd-4397-b540-f4bf5b34b295 1073741824 Sep 18 21:39:56 devstack sudo[94782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:39:57 devstack sudo[94782]: pam_unix(sudo:session): session closed for user root Sep 18 21:39:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-18b33607-7189-46f2-9a1a-b50bfaca317d tempest-VolumesActionsTest-1824150770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-63bf5fd9-95fd-4397-b540-f4bf5b34b295 1073741824" returned: 0 in 0.712s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:39:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-18b33607-7189-46f2-9a1a-b50bfaca317d tempest-VolumesActionsTest-1824150770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-63bf5fd9-95fd-4397-b540-f4bf5b34b295 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:39:57 devstack sudo[94788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-63bf5fd9-95fd-4397-b540-f4bf5b34b295 Sep 18 21:39:57 devstack sudo[94788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:39:57 devstack sudo[94788]: pam_unix(sudo:session): session closed for user root Sep 18 21:39:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-18b33607-7189-46f2-9a1a-b50bfaca317d tempest-VolumesActionsTest-1824150770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-63bf5fd9-95fd-4397-b540-f4bf5b34b295" returned: 0 in 0.356s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:39:57 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-18b33607-7189-46f2-9a1a-b50bfaca317d tempest-VolumesActionsTest-1824150770 None] <== create_volume: return (1127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:39:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-18b33607-7189-46f2-9a1a-b50bfaca317d tempest-VolumesActionsTest-1824150770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.131s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:39:57 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-18b33607-7189-46f2-9a1a-b50bfaca317d tempest-VolumesActionsTest-1824150770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (098480b4-2952-4038-b96e-28f62b173ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63bf5fd9-95fd-4397-b540-f4bf5b34b295', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:39:57 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-18b33607-7189-46f2-9a1a-b50bfaca317d tempest-VolumesActionsTest-1824150770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adff0705-17a2-454b-a0ad-1e9a09f47f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:39:57 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-18b33607-7189-46f2-9a1a-b50bfaca317d tempest-VolumesActionsTest-1824150770 None] Volume volume-63bf5fd9-95fd-4397-b540-f4bf5b34b295 (63bf5fd9-95fd-4397-b540-f4bf5b34b295): created successfully Sep 18 21:39:57 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-18b33607-7189-46f2-9a1a-b50bfaca317d tempest-VolumesActionsTest-1824150770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adff0705-17a2-454b-a0ad-1e9a09f47f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:39:57 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-18b33607-7189-46f2-9a1a-b50bfaca317d tempest-VolumesActionsTest-1824150770 None] Flow 'volume_create_manager' (b17bfb94-4963-44cd-a62d-8e6102611350) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:39:57 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-18b33607-7189-46f2-9a1a-b50bfaca317d tempest-VolumesActionsTest-1824150770 None] Created volume successfully. Sep 18 21:39:58 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-b266c8a7-0079-44cb-bf3b-57c889562948 tempest-VolumesActionsTest-1824150770 None] Acquiring lock "cinder-63bf5fd9-95fd-4397-b540-f4bf5b34b295" by "attach_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:39:58 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-b266c8a7-0079-44cb-bf3b-57c889562948 tempest-VolumesActionsTest-1824150770 None] Lock "cinder-63bf5fd9-95fd-4397-b540-f4bf5b34b295" acquired by "attach_volume" :: waited 0.037s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:39:58 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-b266c8a7-0079-44cb-bf3b-57c889562948 tempest-VolumesActionsTest-1824150770 None] Attaching volume 63bf5fd9-95fd-4397-b540-f4bf5b34b295 to instance c08133b9-b748-4db2-8833-ccc651088b06 at mountpoint /dev/vdb on host None. Sep 18 21:39:58 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-b266c8a7-0079-44cb-bf3b-57c889562948 tempest-VolumesActionsTest-1824150770 None] Attach volume completed successfully. Sep 18 21:39:58 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-b266c8a7-0079-44cb-bf3b-57c889562948 tempest-VolumesActionsTest-1824150770 None] Lock "cinder-63bf5fd9-95fd-4397-b540-f4bf5b34b295" released by "attach_volume" :: held 0.249s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:39:59 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-9195188e-7f6a-409e-9d14-33f32eec4102 tempest-VolumesActionsTest-2054380204 None] Terminate volume connection completed successfully. Sep 18 21:40:00 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-9195188e-7f6a-409e-9d14-33f32eec4102 tempest-VolumesActionsTest-2054380204 None] Acquiring lock "cinder-63bf5fd9-95fd-4397-b540-f4bf5b34b295-detach_volume" by "detach_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:40:00 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-9195188e-7f6a-409e-9d14-33f32eec4102 tempest-VolumesActionsTest-2054380204 None] Lock "cinder-63bf5fd9-95fd-4397-b540-f4bf5b34b295-detach_volume" acquired by "detach_volume" :: waited 0.090s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:40:00 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-9195188e-7f6a-409e-9d14-33f32eec4102 tempest-VolumesActionsTest-2054380204 None] Detaching volume 63bf5fd9-95fd-4397-b540-f4bf5b34b295 from instance c08133b9-b748-4db2-8833-ccc651088b06. Sep 18 21:40:00 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-9195188e-7f6a-409e-9d14-33f32eec4102 tempest-VolumesActionsTest-2054380204 None] Detach volume completed successfully. Sep 18 21:40:00 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-9195188e-7f6a-409e-9d14-33f32eec4102 tempest-VolumesActionsTest-2054380204 None] Lock "cinder-63bf5fd9-95fd-4397-b540-f4bf5b34b295-detach_volume" released by "detach_volume" :: held 0.304s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:40:01 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-e5dbd05e-7394-402b-907d-9049eba9801c tempest-VolumesActionsTest-1824150770 None] Acquiring lock "cinder-63bf5fd9-95fd-4397-b540-f4bf5b34b295-detach_volume" by "detach_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:40:01 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-e5dbd05e-7394-402b-907d-9049eba9801c tempest-VolumesActionsTest-1824150770 None] Lock "cinder-63bf5fd9-95fd-4397-b540-f4bf5b34b295-detach_volume" acquired by "detach_volume" :: waited 0.056s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:40:01 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-e5dbd05e-7394-402b-907d-9049eba9801c tempest-VolumesActionsTest-1824150770 None] Volume detach called, but volume not attached. Sep 18 21:40:01 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-e5dbd05e-7394-402b-907d-9049eba9801c tempest-VolumesActionsTest-1824150770 None] Lock "cinder-63bf5fd9-95fd-4397-b540-f4bf5b34b295-detach_volume" released by "detach_volume" :: held 0.070s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:40:01 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-fedece64-9773-45a1-87aa-9a8fecbe7a3d tempest-VolumesActionsTest-1824150770 None] Acquiring lock "cinder-63bf5fd9-95fd-4397-b540-f4bf5b34b295-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:40:01 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-fedece64-9773-45a1-87aa-9a8fecbe7a3d tempest-VolumesActionsTest-1824150770 None] Lock "cinder-63bf5fd9-95fd-4397-b540-f4bf5b34b295-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:40:01 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-fedece64-9773-45a1-87aa-9a8fecbe7a3d tempest-VolumesActionsTest-1824150770 None] Acquiring lock "cinder-quobyte-63bf5fd9-95fd-4397-b540-f4bf5b34b295" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:40:01 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-fedece64-9773-45a1-87aa-9a8fecbe7a3d tempest-VolumesActionsTest-1824150770 None] Lock "cinder-quobyte-63bf5fd9-95fd-4397-b540-f4bf5b34b295" acquired by "delete_volume" :: waited 0.026s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:40:01 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dcd759e-435f-4e61-a138-d7853db7c056]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:40:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-fedece64-9773-45a1-87aa-9a8fecbe7a3d tempest-VolumesActionsTest-1824150770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-63bf5fd9-95fd-4397-b540-f4bf5b34b295 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:40:02 devstack sudo[94859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-63bf5fd9-95fd-4397-b540-f4bf5b34b295 Sep 18 21:40:02 devstack sudo[94859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:40:02 devstack sudo[94859]: pam_unix(sudo:session): session closed for user root Sep 18 21:40:02 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-fedece64-9773-45a1-87aa-9a8fecbe7a3d tempest-VolumesActionsTest-1824150770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-63bf5fd9-95fd-4397-b540-f4bf5b34b295" returned: 0 in 0.684s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:40:02 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-fedece64-9773-45a1-87aa-9a8fecbe7a3d tempest-VolumesActionsTest-1824150770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-63bf5fd9-95fd-4397-b540-f4bf5b34b295 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:40:02 devstack sudo[94864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-63bf5fd9-95fd-4397-b540-f4bf5b34b295 Sep 18 21:40:02 devstack sudo[94864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:40:03 devstack sudo[94864]: pam_unix(sudo:session): session closed for user root Sep 18 21:40:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-fedece64-9773-45a1-87aa-9a8fecbe7a3d tempest-VolumesActionsTest-1824150770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-63bf5fd9-95fd-4397-b540-f4bf5b34b295" returned: 0 in 0.413s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:40:03 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-fedece64-9773-45a1-87aa-9a8fecbe7a3d tempest-VolumesActionsTest-1824150770 None] Lock "cinder-quobyte-63bf5fd9-95fd-4397-b540-f4bf5b34b295" released by "delete_volume" :: held 1.199s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:40:03 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-fedece64-9773-45a1-87aa-9a8fecbe7a3d tempest-VolumesActionsTest-1824150770 None] Created reservations ['be0ea985-d359-42ea-8991-a53ee8bc449a', '2dd09a25-ccae-48f1-bac5-319d0af00333', '4d5700a0-783c-44ce-a4fd-70bc16e2adba', '0c86fb3d-dc4e-4539-ae52-d8204b2b82c2'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:40:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-fedece64-9773-45a1-87aa-9a8fecbe7a3d tempest-VolumesActionsTest-1824150770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:40:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-fedece64-9773-45a1-87aa-9a8fecbe7a3d tempest-VolumesActionsTest-1824150770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:40:03 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-fedece64-9773-45a1-87aa-9a8fecbe7a3d tempest-VolumesActionsTest-1824150770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:40:03 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-fedece64-9773-45a1-87aa-9a8fecbe7a3d tempest-VolumesActionsTest-1824150770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:40:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-fedece64-9773-45a1-87aa-9a8fecbe7a3d tempest-VolumesActionsTest-1824150770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:40:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-fedece64-9773-45a1-87aa-9a8fecbe7a3d tempest-VolumesActionsTest-1824150770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:40:03 devstack sudo[94867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:40:03 devstack sudo[94867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:40:03 devstack sudo[94867]: pam_unix(sudo:session): session closed for user root Sep 18 21:40:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-fedece64-9773-45a1-87aa-9a8fecbe7a3d tempest-VolumesActionsTest-1824150770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.440s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:40:03 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-fedece64-9773-45a1-87aa-9a8fecbe7a3d tempest-VolumesActionsTest-1824150770 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:40:03 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-fedece64-9773-45a1-87aa-9a8fecbe7a3d tempest-VolumesActionsTest-1824150770 None] Deleted volume successfully. Sep 18 21:40:03 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-fedece64-9773-45a1-87aa-9a8fecbe7a3d tempest-VolumesActionsTest-1824150770 None] Lock "cinder-63bf5fd9-95fd-4397-b540-f4bf5b34b295-delete_volume" released by "delete_volume" :: held 2.056s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:40:05 devstack cinder-volume[86136]: DEBUG oslo_service.periodic_task [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86136) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 21:40:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:40:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:40:05 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:40:05 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:40:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:40:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:40:05 devstack sudo[94892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:40:05 devstack sudo[94892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:40:05 devstack sudo[94892]: pam_unix(sudo:session): session closed for user root Sep 18 21:40:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.346s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:40:05 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:40:05 devstack cinder-volume[86136]: DEBUG oslo_service.periodic_task [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Running periodic task VolumeManager._thread_info {{(pid=86136) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 21:40:05 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] thread count: 28 {{(pid=86136) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 18 21:40:05 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] thread info: [<_MainThread(MainThread, started 138548347871360)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86136) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 18 21:40:09 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-40408760-af76-4664-af9a-3739a2f1aa88 tempest-VolumesActionsTest-1824150770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:40:09 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-40408760-af76-4664-af9a-3739a2f1aa88 tempest-VolumesActionsTest-1824150770 None] Flow 'volume_create_manager' (ed5184a1-0d5e-434a-897e-27c8fb933648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:40:09 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-40408760-af76-4664-af9a-3739a2f1aa88 tempest-VolumesActionsTest-1824150770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58bb1aea-ecc3-486d-8c95-0df37a024937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:40:09 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-40408760-af76-4664-af9a-3739a2f1aa88 tempest-VolumesActionsTest-1824150770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58bb1aea-ecc3-486d-8c95-0df37a024937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:40:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-527415191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=722eda22-9132-4aab-abfe-596e01625315,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c77e6178bbf42ffa1eb7b0d3d137f70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:40:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:40:10Z,use_quota=True,user_id='03c4af1aa0bf4ab08b382ef23a425901',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:40:09 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-40408760-af76-4664-af9a-3739a2f1aa88 tempest-VolumesActionsTest-1824150770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00655f52-80ca-4b08-9508-7e63858bdfa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:40:09 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-40408760-af76-4664-af9a-3739a2f1aa88 tempest-VolumesActionsTest-1824150770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00655f52-80ca-4b08-9508-7e63858bdfa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:40:09 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-40408760-af76-4664-af9a-3739a2f1aa88 tempest-VolumesActionsTest-1824150770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d3e23fd-3599-47cf-83ea-72b8299a43af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:40:09 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-40408760-af76-4664-af9a-3739a2f1aa88 tempest-VolumesActionsTest-1824150770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d3e23fd-3599-47cf-83ea-72b8299a43af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '722eda22-9132-4aab-abfe-596e01625315', 'volume_name': 'volume-722eda22-9132-4aab-abfe-596e01625315', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:40:09 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-40408760-af76-4664-af9a-3739a2f1aa88 tempest-VolumesActionsTest-1824150770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6121e02e-74fb-4b3a-9719-47c8a1766725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:40:09 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-40408760-af76-4664-af9a-3739a2f1aa88 tempest-VolumesActionsTest-1824150770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6121e02e-74fb-4b3a-9719-47c8a1766725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:40:09 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-40408760-af76-4664-af9a-3739a2f1aa88 tempest-VolumesActionsTest-1824150770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44627574-5dab-43d8-9de4-88add7b78494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:40:09 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-40408760-af76-4664-af9a-3739a2f1aa88 tempest-VolumesActionsTest-1824150770 None] Volume 722eda22-9132-4aab-abfe-596e01625315: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-722eda22-9132-4aab-abfe-596e01625315', 'volume_size': 1} Sep 18 21:40:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-40408760-af76-4664-af9a-3739a2f1aa88 tempest-VolumesActionsTest-1824150770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:40:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-40408760-af76-4664-af9a-3739a2f1aa88 tempest-VolumesActionsTest-1824150770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:40:09 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-40408760-af76-4664-af9a-3739a2f1aa88 tempest-VolumesActionsTest-1824150770 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:40:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-527415191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=722eda22-9132-4aab-abfe-596e01625315,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c77e6178bbf42ffa1eb7b0d3d137f70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:40:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:40:10Z,use_quota=True,user_id='03c4af1aa0bf4ab08b382ef23a425901',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:40:09 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-40408760-af76-4664-af9a-3739a2f1aa88 tempest-VolumesActionsTest-1824150770 None] Creating volume 722eda22-9132-4aab-abfe-596e01625315 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:40:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-40408760-af76-4664-af9a-3739a2f1aa88 tempest-VolumesActionsTest-1824150770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:40:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-40408760-af76-4664-af9a-3739a2f1aa88 tempest-VolumesActionsTest-1824150770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:40:09 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-40408760-af76-4664-af9a-3739a2f1aa88 tempest-VolumesActionsTest-1824150770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:40:09 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-40408760-af76-4664-af9a-3739a2f1aa88 tempest-VolumesActionsTest-1824150770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:40:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-40408760-af76-4664-af9a-3739a2f1aa88 tempest-VolumesActionsTest-1824150770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:40:09 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-40408760-af76-4664-af9a-3739a2f1aa88 tempest-VolumesActionsTest-1824150770 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:40:09 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-40408760-af76-4664-af9a-3739a2f1aa88 tempest-VolumesActionsTest-1824150770 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:40:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-40408760-af76-4664-af9a-3739a2f1aa88 tempest-VolumesActionsTest-1824150770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-722eda22-9132-4aab-abfe-596e01625315 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:40:09 devstack sudo[94901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-722eda22-9132-4aab-abfe-596e01625315 1073741824 Sep 18 21:40:09 devstack sudo[94901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:40:10 devstack sudo[94901]: pam_unix(sudo:session): session closed for user root Sep 18 21:40:10 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-40408760-af76-4664-af9a-3739a2f1aa88 tempest-VolumesActionsTest-1824150770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-722eda22-9132-4aab-abfe-596e01625315 1073741824" returned: 0 in 0.720s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:40:10 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-40408760-af76-4664-af9a-3739a2f1aa88 tempest-VolumesActionsTest-1824150770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-722eda22-9132-4aab-abfe-596e01625315 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:40:10 devstack sudo[94909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-722eda22-9132-4aab-abfe-596e01625315 Sep 18 21:40:10 devstack sudo[94909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:40:10 devstack sudo[94909]: pam_unix(sudo:session): session closed for user root Sep 18 21:40:10 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-40408760-af76-4664-af9a-3739a2f1aa88 tempest-VolumesActionsTest-1824150770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-722eda22-9132-4aab-abfe-596e01625315" returned: 0 in 0.390s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:40:10 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-40408760-af76-4664-af9a-3739a2f1aa88 tempest-VolumesActionsTest-1824150770 None] <== create_volume: return (1247ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:40:10 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-40408760-af76-4664-af9a-3739a2f1aa88 tempest-VolumesActionsTest-1824150770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.250s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:40:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-40408760-af76-4664-af9a-3739a2f1aa88 tempest-VolumesActionsTest-1824150770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44627574-5dab-43d8-9de4-88add7b78494) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-722eda22-9132-4aab-abfe-596e01625315', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:40:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-40408760-af76-4664-af9a-3739a2f1aa88 tempest-VolumesActionsTest-1824150770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae110167-b1b5-469c-a3ad-480d23d76191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:40:11 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-40408760-af76-4664-af9a-3739a2f1aa88 tempest-VolumesActionsTest-1824150770 None] Volume volume-722eda22-9132-4aab-abfe-596e01625315 (722eda22-9132-4aab-abfe-596e01625315): created successfully Sep 18 21:40:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-40408760-af76-4664-af9a-3739a2f1aa88 tempest-VolumesActionsTest-1824150770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae110167-b1b5-469c-a3ad-480d23d76191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:40:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-40408760-af76-4664-af9a-3739a2f1aa88 tempest-VolumesActionsTest-1824150770 None] Flow 'volume_create_manager' (ed5184a1-0d5e-434a-897e-27c8fb933648) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:40:11 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-40408760-af76-4664-af9a-3739a2f1aa88 tempest-VolumesActionsTest-1824150770 None] Created volume successfully. Sep 18 21:40:11 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-081975bb-739d-44ef-85af-2f305509c293 tempest-VolumesActionsTest-2054380204 None] Acquiring lock "cinder-722eda22-9132-4aab-abfe-596e01625315-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:40:11 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-081975bb-739d-44ef-85af-2f305509c293 tempest-VolumesActionsTest-2054380204 None] Lock "cinder-722eda22-9132-4aab-abfe-596e01625315-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:40:12 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-081975bb-739d-44ef-85af-2f305509c293 tempest-VolumesActionsTest-2054380204 None] Acquiring lock "cinder-quobyte-722eda22-9132-4aab-abfe-596e01625315" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:40:12 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-081975bb-739d-44ef-85af-2f305509c293 tempest-VolumesActionsTest-2054380204 None] Lock "cinder-quobyte-722eda22-9132-4aab-abfe-596e01625315" acquired by "delete_volume" :: waited 0.031s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:40:12 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[abdb69f2-faf5-4dec-98c9-a3afbde9fd8f]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:40:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-081975bb-739d-44ef-85af-2f305509c293 tempest-VolumesActionsTest-2054380204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-722eda22-9132-4aab-abfe-596e01625315 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:40:12 devstack sudo[94912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-722eda22-9132-4aab-abfe-596e01625315 Sep 18 21:40:12 devstack sudo[94912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:40:12 devstack sudo[94912]: pam_unix(sudo:session): session closed for user root Sep 18 21:40:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-081975bb-739d-44ef-85af-2f305509c293 tempest-VolumesActionsTest-2054380204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-722eda22-9132-4aab-abfe-596e01625315" returned: 0 in 0.509s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:40:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-081975bb-739d-44ef-85af-2f305509c293 tempest-VolumesActionsTest-2054380204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-722eda22-9132-4aab-abfe-596e01625315 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:40:12 devstack sudo[94917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-722eda22-9132-4aab-abfe-596e01625315 Sep 18 21:40:12 devstack sudo[94917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:40:13 devstack sudo[94917]: pam_unix(sudo:session): session closed for user root Sep 18 21:40:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-081975bb-739d-44ef-85af-2f305509c293 tempest-VolumesActionsTest-2054380204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-722eda22-9132-4aab-abfe-596e01625315" returned: 0 in 0.527s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:40:13 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-081975bb-739d-44ef-85af-2f305509c293 tempest-VolumesActionsTest-2054380204 None] Lock "cinder-quobyte-722eda22-9132-4aab-abfe-596e01625315" released by "delete_volume" :: held 1.124s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:40:13 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-081975bb-739d-44ef-85af-2f305509c293 tempest-VolumesActionsTest-2054380204 None] Created reservations ['b032d580-556e-4819-923f-26159542eca0', 'cd3b702e-0621-4bf2-a09d-c34514c55ab3', '66d99e73-5596-4d9f-9e1a-56b1bbc54b18', 'a21c511f-28ed-495b-bc5b-69905d871f53'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:40:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-081975bb-739d-44ef-85af-2f305509c293 tempest-VolumesActionsTest-2054380204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:40:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-081975bb-739d-44ef-85af-2f305509c293 tempest-VolumesActionsTest-2054380204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:40:13 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-081975bb-739d-44ef-85af-2f305509c293 tempest-VolumesActionsTest-2054380204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:40:13 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-081975bb-739d-44ef-85af-2f305509c293 tempest-VolumesActionsTest-2054380204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:40:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-081975bb-739d-44ef-85af-2f305509c293 tempest-VolumesActionsTest-2054380204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:40:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-081975bb-739d-44ef-85af-2f305509c293 tempest-VolumesActionsTest-2054380204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:40:13 devstack sudo[94920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:40:13 devstack sudo[94920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:40:13 devstack sudo[94920]: pam_unix(sudo:session): session closed for user root Sep 18 21:40:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-081975bb-739d-44ef-85af-2f305509c293 tempest-VolumesActionsTest-2054380204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.283s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:40:13 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-081975bb-739d-44ef-85af-2f305509c293 tempest-VolumesActionsTest-2054380204 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:40:13 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-081975bb-739d-44ef-85af-2f305509c293 tempest-VolumesActionsTest-2054380204 None] Deleted volume successfully. Sep 18 21:40:13 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-081975bb-739d-44ef-85af-2f305509c293 tempest-VolumesActionsTest-2054380204 None] Lock "cinder-722eda22-9132-4aab-abfe-596e01625315-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:40:15 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-97d46703-b969-4566-a998-98bd795c1136 tempest-VolumesActionsTest-1824150770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:40:15 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-97d46703-b969-4566-a998-98bd795c1136 tempest-VolumesActionsTest-1824150770 None] Flow 'volume_create_manager' (bfed3ded-d187-4cd4-9dca-87241cdf349d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:40:15 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-97d46703-b969-4566-a998-98bd795c1136 tempest-VolumesActionsTest-1824150770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85a3a8fa-3c75-4a04-971e-c1a523a457a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:40:15 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-97d46703-b969-4566-a998-98bd795c1136 tempest-VolumesActionsTest-1824150770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85a3a8fa-3c75-4a04-971e-c1a523a457a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:40:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-17037563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79990cf9-9c22-484f-8569-06884e2242c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c77e6178bbf42ffa1eb7b0d3d137f70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:40:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:40:15Z,use_quota=True,user_id='03c4af1aa0bf4ab08b382ef23a425901',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:40:15 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-97d46703-b969-4566-a998-98bd795c1136 tempest-VolumesActionsTest-1824150770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92503029-20d2-4432-ab36-63c035e51eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:40:15 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-97d46703-b969-4566-a998-98bd795c1136 tempest-VolumesActionsTest-1824150770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92503029-20d2-4432-ab36-63c035e51eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:40:15 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-97d46703-b969-4566-a998-98bd795c1136 tempest-VolumesActionsTest-1824150770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58a248a7-0fe0-4134-b261-be3cc131dd88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:40:15 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-97d46703-b969-4566-a998-98bd795c1136 tempest-VolumesActionsTest-1824150770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58a248a7-0fe0-4134-b261-be3cc131dd88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79990cf9-9c22-484f-8569-06884e2242c7', 'volume_name': 'volume-79990cf9-9c22-484f-8569-06884e2242c7', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:40:15 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-97d46703-b969-4566-a998-98bd795c1136 tempest-VolumesActionsTest-1824150770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61334dc8-a27f-4044-8a10-1d68f3bf4cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:40:15 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-97d46703-b969-4566-a998-98bd795c1136 tempest-VolumesActionsTest-1824150770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61334dc8-a27f-4044-8a10-1d68f3bf4cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:40:15 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-97d46703-b969-4566-a998-98bd795c1136 tempest-VolumesActionsTest-1824150770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88739e0c-d6d8-4860-9230-1232e62ab4cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:40:15 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-97d46703-b969-4566-a998-98bd795c1136 tempest-VolumesActionsTest-1824150770 None] Volume 79990cf9-9c22-484f-8569-06884e2242c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79990cf9-9c22-484f-8569-06884e2242c7', 'volume_size': 1} Sep 18 21:40:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-97d46703-b969-4566-a998-98bd795c1136 tempest-VolumesActionsTest-1824150770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:40:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-97d46703-b969-4566-a998-98bd795c1136 tempest-VolumesActionsTest-1824150770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:40:15 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-97d46703-b969-4566-a998-98bd795c1136 tempest-VolumesActionsTest-1824150770 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:40:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-17037563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79990cf9-9c22-484f-8569-06884e2242c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c77e6178bbf42ffa1eb7b0d3d137f70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:40:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:40:15Z,use_quota=True,user_id='03c4af1aa0bf4ab08b382ef23a425901',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:40:15 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-97d46703-b969-4566-a998-98bd795c1136 tempest-VolumesActionsTest-1824150770 None] Creating volume 79990cf9-9c22-484f-8569-06884e2242c7 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:40:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-97d46703-b969-4566-a998-98bd795c1136 tempest-VolumesActionsTest-1824150770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:40:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-97d46703-b969-4566-a998-98bd795c1136 tempest-VolumesActionsTest-1824150770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:40:15 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-97d46703-b969-4566-a998-98bd795c1136 tempest-VolumesActionsTest-1824150770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:40:15 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-97d46703-b969-4566-a998-98bd795c1136 tempest-VolumesActionsTest-1824150770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:40:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-97d46703-b969-4566-a998-98bd795c1136 tempest-VolumesActionsTest-1824150770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:40:15 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-97d46703-b969-4566-a998-98bd795c1136 tempest-VolumesActionsTest-1824150770 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:40:15 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-97d46703-b969-4566-a998-98bd795c1136 tempest-VolumesActionsTest-1824150770 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:40:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-97d46703-b969-4566-a998-98bd795c1136 tempest-VolumesActionsTest-1824150770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-79990cf9-9c22-484f-8569-06884e2242c7 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:40:15 devstack sudo[94923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-79990cf9-9c22-484f-8569-06884e2242c7 1073741824 Sep 18 21:40:15 devstack sudo[94923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:40:15 devstack sudo[94923]: pam_unix(sudo:session): session closed for user root Sep 18 21:40:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-97d46703-b969-4566-a998-98bd795c1136 tempest-VolumesActionsTest-1824150770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-79990cf9-9c22-484f-8569-06884e2242c7 1073741824" returned: 0 in 0.659s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:40:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-97d46703-b969-4566-a998-98bd795c1136 tempest-VolumesActionsTest-1824150770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-79990cf9-9c22-484f-8569-06884e2242c7 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:40:16 devstack sudo[94931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-79990cf9-9c22-484f-8569-06884e2242c7 Sep 18 21:40:16 devstack sudo[94931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:40:16 devstack sudo[94931]: pam_unix(sudo:session): session closed for user root Sep 18 21:40:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-97d46703-b969-4566-a998-98bd795c1136 tempest-VolumesActionsTest-1824150770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-79990cf9-9c22-484f-8569-06884e2242c7" returned: 0 in 0.403s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:40:16 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-97d46703-b969-4566-a998-98bd795c1136 tempest-VolumesActionsTest-1824150770 None] <== create_volume: return (1127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:40:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-97d46703-b969-4566-a998-98bd795c1136 tempest-VolumesActionsTest-1824150770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.131s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:40:16 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-97d46703-b969-4566-a998-98bd795c1136 tempest-VolumesActionsTest-1824150770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88739e0c-d6d8-4860-9230-1232e62ab4cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79990cf9-9c22-484f-8569-06884e2242c7', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:40:16 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-97d46703-b969-4566-a998-98bd795c1136 tempest-VolumesActionsTest-1824150770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f31cc94f-20bd-4cb8-a77d-5cda6758376e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:40:16 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-97d46703-b969-4566-a998-98bd795c1136 tempest-VolumesActionsTest-1824150770 None] Volume volume-79990cf9-9c22-484f-8569-06884e2242c7 (79990cf9-9c22-484f-8569-06884e2242c7): created successfully Sep 18 21:40:16 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-97d46703-b969-4566-a998-98bd795c1136 tempest-VolumesActionsTest-1824150770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f31cc94f-20bd-4cb8-a77d-5cda6758376e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:40:16 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-97d46703-b969-4566-a998-98bd795c1136 tempest-VolumesActionsTest-1824150770 None] Flow 'volume_create_manager' (bfed3ded-d187-4cd4-9dca-87241cdf349d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:40:16 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-97d46703-b969-4566-a998-98bd795c1136 tempest-VolumesActionsTest-1824150770 None] Created volume successfully. Sep 18 21:40:17 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-484006c8-5228-40bf-a5ec-8da3ac5cbf82 tempest-VolumesActionsTest-2054380204 None] Acquiring lock "cinder-79990cf9-9c22-484f-8569-06884e2242c7-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:40:17 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-484006c8-5228-40bf-a5ec-8da3ac5cbf82 tempest-VolumesActionsTest-2054380204 None] Lock "cinder-79990cf9-9c22-484f-8569-06884e2242c7-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:40:17 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-484006c8-5228-40bf-a5ec-8da3ac5cbf82 tempest-VolumesActionsTest-2054380204 None] Acquiring lock "cinder-quobyte-79990cf9-9c22-484f-8569-06884e2242c7" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:40:17 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-484006c8-5228-40bf-a5ec-8da3ac5cbf82 tempest-VolumesActionsTest-2054380204 None] Lock "cinder-quobyte-79990cf9-9c22-484f-8569-06884e2242c7" acquired by "delete_volume" :: waited 0.026s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:40:17 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[9620c8b3-721d-4662-93d5-e294b064c2a0]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:40:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-484006c8-5228-40bf-a5ec-8da3ac5cbf82 tempest-VolumesActionsTest-2054380204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-79990cf9-9c22-484f-8569-06884e2242c7 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:40:17 devstack sudo[94973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-79990cf9-9c22-484f-8569-06884e2242c7 Sep 18 21:40:17 devstack sudo[94973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:40:18 devstack sudo[94973]: pam_unix(sudo:session): session closed for user root Sep 18 21:40:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-484006c8-5228-40bf-a5ec-8da3ac5cbf82 tempest-VolumesActionsTest-2054380204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-79990cf9-9c22-484f-8569-06884e2242c7" returned: 0 in 0.503s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:40:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-484006c8-5228-40bf-a5ec-8da3ac5cbf82 tempest-VolumesActionsTest-2054380204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-79990cf9-9c22-484f-8569-06884e2242c7 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:40:18 devstack sudo[94979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-79990cf9-9c22-484f-8569-06884e2242c7 Sep 18 21:40:18 devstack sudo[94979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:40:18 devstack sudo[94979]: pam_unix(sudo:session): session closed for user root Sep 18 21:40:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-484006c8-5228-40bf-a5ec-8da3ac5cbf82 tempest-VolumesActionsTest-2054380204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-79990cf9-9c22-484f-8569-06884e2242c7" returned: 0 in 0.396s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:40:18 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-484006c8-5228-40bf-a5ec-8da3ac5cbf82 tempest-VolumesActionsTest-2054380204 None] Lock "cinder-quobyte-79990cf9-9c22-484f-8569-06884e2242c7" released by "delete_volume" :: held 1.005s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:40:18 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-484006c8-5228-40bf-a5ec-8da3ac5cbf82 tempest-VolumesActionsTest-2054380204 None] Created reservations ['9d1fa5ce-156b-418f-9995-3ed0f95e6115', 'e0cb1c32-adfe-4fdb-beed-389abbfdcf2d', 'c81735e8-977e-4318-9119-9bb1de8f4321', '7f9f006d-6f68-44fc-9b07-06ba2e8e8b23'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:40:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-484006c8-5228-40bf-a5ec-8da3ac5cbf82 tempest-VolumesActionsTest-2054380204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:40:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-484006c8-5228-40bf-a5ec-8da3ac5cbf82 tempest-VolumesActionsTest-2054380204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:40:18 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-484006c8-5228-40bf-a5ec-8da3ac5cbf82 tempest-VolumesActionsTest-2054380204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:40:18 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-484006c8-5228-40bf-a5ec-8da3ac5cbf82 tempest-VolumesActionsTest-2054380204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:40:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-484006c8-5228-40bf-a5ec-8da3ac5cbf82 tempest-VolumesActionsTest-2054380204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:40:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-484006c8-5228-40bf-a5ec-8da3ac5cbf82 tempest-VolumesActionsTest-2054380204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:40:18 devstack sudo[94982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:40:18 devstack sudo[94982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:40:19 devstack sudo[94982]: pam_unix(sudo:session): session closed for user root Sep 18 21:40:19 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-484006c8-5228-40bf-a5ec-8da3ac5cbf82 tempest-VolumesActionsTest-2054380204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.382s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:40:19 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-484006c8-5228-40bf-a5ec-8da3ac5cbf82 tempest-VolumesActionsTest-2054380204 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:40:19 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-484006c8-5228-40bf-a5ec-8da3ac5cbf82 tempest-VolumesActionsTest-2054380204 None] Deleted volume successfully. Sep 18 21:40:19 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-484006c8-5228-40bf-a5ec-8da3ac5cbf82 tempest-VolumesActionsTest-2054380204 None] Lock "cinder-79990cf9-9c22-484f-8569-06884e2242c7-delete_volume" released by "delete_volume" :: held 1.763s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:40:20 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-70b7412e-e8e6-406e-82e2-31547a30c6c8 tempest-VolumesActionsTest-1824150770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:40:20 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-70b7412e-e8e6-406e-82e2-31547a30c6c8 tempest-VolumesActionsTest-1824150770 None] Flow 'volume_create_manager' (17e165ea-ee23-46fa-843c-20fe3170bb5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:40:20 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-70b7412e-e8e6-406e-82e2-31547a30c6c8 tempest-VolumesActionsTest-1824150770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91330f09-6128-4309-8716-dcad72dd3948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:40:20 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-70b7412e-e8e6-406e-82e2-31547a30c6c8 tempest-VolumesActionsTest-1824150770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91330f09-6128-4309-8716-dcad72dd3948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:40:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-708749689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afcaddd7-3af0-4c26-beba-e438bb6c08ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c77e6178bbf42ffa1eb7b0d3d137f70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:40:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:40:20Z,use_quota=True,user_id='03c4af1aa0bf4ab08b382ef23a425901',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:40:20 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-70b7412e-e8e6-406e-82e2-31547a30c6c8 tempest-VolumesActionsTest-1824150770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21a35bf8-31c1-44a4-aa7b-ea6f0c2894b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:40:20 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-70b7412e-e8e6-406e-82e2-31547a30c6c8 tempest-VolumesActionsTest-1824150770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21a35bf8-31c1-44a4-aa7b-ea6f0c2894b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:40:20 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-70b7412e-e8e6-406e-82e2-31547a30c6c8 tempest-VolumesActionsTest-1824150770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e02a293-b3bd-4dc5-8a9c-bbcd890f56a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:40:20 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-70b7412e-e8e6-406e-82e2-31547a30c6c8 tempest-VolumesActionsTest-1824150770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e02a293-b3bd-4dc5-8a9c-bbcd890f56a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afcaddd7-3af0-4c26-beba-e438bb6c08ee', 'volume_name': 'volume-afcaddd7-3af0-4c26-beba-e438bb6c08ee', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:40:20 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-70b7412e-e8e6-406e-82e2-31547a30c6c8 tempest-VolumesActionsTest-1824150770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ec3791a-3421-4742-a015-074fed2b23fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:40:20 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-70b7412e-e8e6-406e-82e2-31547a30c6c8 tempest-VolumesActionsTest-1824150770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ec3791a-3421-4742-a015-074fed2b23fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:40:20 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-70b7412e-e8e6-406e-82e2-31547a30c6c8 tempest-VolumesActionsTest-1824150770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68eb200b-97e8-4078-af09-4005ec2e9dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:40:20 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-70b7412e-e8e6-406e-82e2-31547a30c6c8 tempest-VolumesActionsTest-1824150770 None] Volume afcaddd7-3af0-4c26-beba-e438bb6c08ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afcaddd7-3af0-4c26-beba-e438bb6c08ee', 'volume_size': 1} Sep 18 21:40:20 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-70b7412e-e8e6-406e-82e2-31547a30c6c8 tempest-VolumesActionsTest-1824150770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:40:20 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-70b7412e-e8e6-406e-82e2-31547a30c6c8 tempest-VolumesActionsTest-1824150770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:40:20 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-70b7412e-e8e6-406e-82e2-31547a30c6c8 tempest-VolumesActionsTest-1824150770 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:40:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-708749689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afcaddd7-3af0-4c26-beba-e438bb6c08ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c77e6178bbf42ffa1eb7b0d3d137f70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:40:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:40:20Z,use_quota=True,user_id='03c4af1aa0bf4ab08b382ef23a425901',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:40:20 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-70b7412e-e8e6-406e-82e2-31547a30c6c8 tempest-VolumesActionsTest-1824150770 None] Creating volume afcaddd7-3af0-4c26-beba-e438bb6c08ee {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:40:20 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-70b7412e-e8e6-406e-82e2-31547a30c6c8 tempest-VolumesActionsTest-1824150770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:40:20 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-70b7412e-e8e6-406e-82e2-31547a30c6c8 tempest-VolumesActionsTest-1824150770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:40:20 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-70b7412e-e8e6-406e-82e2-31547a30c6c8 tempest-VolumesActionsTest-1824150770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:40:20 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-70b7412e-e8e6-406e-82e2-31547a30c6c8 tempest-VolumesActionsTest-1824150770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:40:20 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-70b7412e-e8e6-406e-82e2-31547a30c6c8 tempest-VolumesActionsTest-1824150770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:40:20 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-70b7412e-e8e6-406e-82e2-31547a30c6c8 tempest-VolumesActionsTest-1824150770 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:40:20 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-70b7412e-e8e6-406e-82e2-31547a30c6c8 tempest-VolumesActionsTest-1824150770 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:40:20 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-70b7412e-e8e6-406e-82e2-31547a30c6c8 tempest-VolumesActionsTest-1824150770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-afcaddd7-3af0-4c26-beba-e438bb6c08ee 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:40:20 devstack sudo[95014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-afcaddd7-3af0-4c26-beba-e438bb6c08ee 1073741824 Sep 18 21:40:20 devstack sudo[95014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:40:21 devstack sudo[95014]: pam_unix(sudo:session): session closed for user root Sep 18 21:40:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-70b7412e-e8e6-406e-82e2-31547a30c6c8 tempest-VolumesActionsTest-1824150770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-afcaddd7-3af0-4c26-beba-e438bb6c08ee 1073741824" returned: 0 in 0.534s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:40:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-70b7412e-e8e6-406e-82e2-31547a30c6c8 tempest-VolumesActionsTest-1824150770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-afcaddd7-3af0-4c26-beba-e438bb6c08ee {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:40:21 devstack sudo[95020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-afcaddd7-3af0-4c26-beba-e438bb6c08ee Sep 18 21:40:21 devstack sudo[95020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:40:21 devstack sudo[95020]: pam_unix(sudo:session): session closed for user root Sep 18 21:40:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-70b7412e-e8e6-406e-82e2-31547a30c6c8 tempest-VolumesActionsTest-1824150770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-afcaddd7-3af0-4c26-beba-e438bb6c08ee" returned: 0 in 0.277s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:40:21 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-70b7412e-e8e6-406e-82e2-31547a30c6c8 tempest-VolumesActionsTest-1824150770 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:40:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-70b7412e-e8e6-406e-82e2-31547a30c6c8 tempest-VolumesActionsTest-1824150770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:40:21 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-70b7412e-e8e6-406e-82e2-31547a30c6c8 tempest-VolumesActionsTest-1824150770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68eb200b-97e8-4078-af09-4005ec2e9dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afcaddd7-3af0-4c26-beba-e438bb6c08ee', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:40:21 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-70b7412e-e8e6-406e-82e2-31547a30c6c8 tempest-VolumesActionsTest-1824150770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36a38f09-dddf-4294-8a02-92ee16c65f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:40:21 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-70b7412e-e8e6-406e-82e2-31547a30c6c8 tempest-VolumesActionsTest-1824150770 None] Volume volume-afcaddd7-3af0-4c26-beba-e438bb6c08ee (afcaddd7-3af0-4c26-beba-e438bb6c08ee): created successfully Sep 18 21:40:21 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-70b7412e-e8e6-406e-82e2-31547a30c6c8 tempest-VolumesActionsTest-1824150770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36a38f09-dddf-4294-8a02-92ee16c65f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:40:21 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-70b7412e-e8e6-406e-82e2-31547a30c6c8 tempest-VolumesActionsTest-1824150770 None] Flow 'volume_create_manager' (17e165ea-ee23-46fa-843c-20fe3170bb5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:40:21 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-70b7412e-e8e6-406e-82e2-31547a30c6c8 tempest-VolumesActionsTest-1824150770 None] Created volume successfully. Sep 18 21:40:23 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-0f5f02ed-c0fa-4935-bfbb-bdf8dd1e14e2 tempest-VolumesActionsTest-2054380204 None] Acquiring lock "cinder-afcaddd7-3af0-4c26-beba-e438bb6c08ee-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:40:23 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-0f5f02ed-c0fa-4935-bfbb-bdf8dd1e14e2 tempest-VolumesActionsTest-2054380204 None] Lock "cinder-afcaddd7-3af0-4c26-beba-e438bb6c08ee-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:40:23 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-0f5f02ed-c0fa-4935-bfbb-bdf8dd1e14e2 tempest-VolumesActionsTest-2054380204 None] Acquiring lock "cinder-quobyte-afcaddd7-3af0-4c26-beba-e438bb6c08ee" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:40:23 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-0f5f02ed-c0fa-4935-bfbb-bdf8dd1e14e2 tempest-VolumesActionsTest-2054380204 None] Lock "cinder-quobyte-afcaddd7-3af0-4c26-beba-e438bb6c08ee" acquired by "delete_volume" :: waited 0.017s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:40:23 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec624cb-8644-4df4-b460-d38367a3618e]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:40:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0f5f02ed-c0fa-4935-bfbb-bdf8dd1e14e2 tempest-VolumesActionsTest-2054380204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-afcaddd7-3af0-4c26-beba-e438bb6c08ee {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:40:23 devstack sudo[95087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-afcaddd7-3af0-4c26-beba-e438bb6c08ee Sep 18 21:40:23 devstack sudo[95087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:40:23 devstack sudo[95087]: pam_unix(sudo:session): session closed for user root Sep 18 21:40:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0f5f02ed-c0fa-4935-bfbb-bdf8dd1e14e2 tempest-VolumesActionsTest-2054380204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-afcaddd7-3af0-4c26-beba-e438bb6c08ee" returned: 0 in 0.524s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:40:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0f5f02ed-c0fa-4935-bfbb-bdf8dd1e14e2 tempest-VolumesActionsTest-2054380204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-afcaddd7-3af0-4c26-beba-e438bb6c08ee {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:40:23 devstack sudo[95096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-afcaddd7-3af0-4c26-beba-e438bb6c08ee Sep 18 21:40:23 devstack sudo[95096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:40:24 devstack sudo[95096]: pam_unix(sudo:session): session closed for user root Sep 18 21:40:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0f5f02ed-c0fa-4935-bfbb-bdf8dd1e14e2 tempest-VolumesActionsTest-2054380204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-afcaddd7-3af0-4c26-beba-e438bb6c08ee" returned: 0 in 0.386s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:40:24 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-0f5f02ed-c0fa-4935-bfbb-bdf8dd1e14e2 tempest-VolumesActionsTest-2054380204 None] Lock "cinder-quobyte-afcaddd7-3af0-4c26-beba-e438bb6c08ee" released by "delete_volume" :: held 1.048s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:40:24 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-0f5f02ed-c0fa-4935-bfbb-bdf8dd1e14e2 tempest-VolumesActionsTest-2054380204 None] Created reservations ['57347c29-27d5-4ed1-b8db-6ee4102d17d1', '8771c8e7-4a95-4875-87ca-703306d9c9cb', 'a9a01051-1ef1-4ab1-be32-9a32edf5b6fe', '3466c173-a0c8-405f-ac3a-cd662082aaaf'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:40:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-0f5f02ed-c0fa-4935-bfbb-bdf8dd1e14e2 tempest-VolumesActionsTest-2054380204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:40:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-0f5f02ed-c0fa-4935-bfbb-bdf8dd1e14e2 tempest-VolumesActionsTest-2054380204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:40:24 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-0f5f02ed-c0fa-4935-bfbb-bdf8dd1e14e2 tempest-VolumesActionsTest-2054380204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:40:24 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-0f5f02ed-c0fa-4935-bfbb-bdf8dd1e14e2 tempest-VolumesActionsTest-2054380204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:40:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-0f5f02ed-c0fa-4935-bfbb-bdf8dd1e14e2 tempest-VolumesActionsTest-2054380204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:40:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0f5f02ed-c0fa-4935-bfbb-bdf8dd1e14e2 tempest-VolumesActionsTest-2054380204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:40:24 devstack sudo[95101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:40:24 devstack sudo[95101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:40:24 devstack sudo[95101]: pam_unix(sudo:session): session closed for user root Sep 18 21:40:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0f5f02ed-c0fa-4935-bfbb-bdf8dd1e14e2 tempest-VolumesActionsTest-2054380204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.341s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:40:24 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-0f5f02ed-c0fa-4935-bfbb-bdf8dd1e14e2 tempest-VolumesActionsTest-2054380204 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:40:24 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-0f5f02ed-c0fa-4935-bfbb-bdf8dd1e14e2 tempest-VolumesActionsTest-2054380204 None] Deleted volume successfully. Sep 18 21:40:24 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-0f5f02ed-c0fa-4935-bfbb-bdf8dd1e14e2 tempest-VolumesActionsTest-2054380204 None] Lock "cinder-afcaddd7-3af0-4c26-beba-e438bb6c08ee-delete_volume" released by "delete_volume" :: held 1.782s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:40:26 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-654d07e8-0e4e-47a3-9988-38b78b59154e tempest-VolumesActionsTest-1824150770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:40:26 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-654d07e8-0e4e-47a3-9988-38b78b59154e tempest-VolumesActionsTest-1824150770 None] Flow 'volume_create_manager' (d4c7ef45-5d02-419d-a977-f963b2080289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:40:26 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-654d07e8-0e4e-47a3-9988-38b78b59154e tempest-VolumesActionsTest-1824150770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e006bcee-dd08-4c4a-abf8-e6fc2d4868a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:40:26 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-654d07e8-0e4e-47a3-9988-38b78b59154e tempest-VolumesActionsTest-1824150770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e006bcee-dd08-4c4a-abf8-e6fc2d4868a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:40:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-347924075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f71bbf7b-37f7-4a9d-ad4e-eedcc67a9acd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c77e6178bbf42ffa1eb7b0d3d137f70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:40:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:40:26Z,use_quota=True,user_id='03c4af1aa0bf4ab08b382ef23a425901',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:40:26 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-654d07e8-0e4e-47a3-9988-38b78b59154e tempest-VolumesActionsTest-1824150770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b668684e-124d-4fab-b2ce-ca5be404898c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:40:26 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-654d07e8-0e4e-47a3-9988-38b78b59154e tempest-VolumesActionsTest-1824150770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b668684e-124d-4fab-b2ce-ca5be404898c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:40:26 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-654d07e8-0e4e-47a3-9988-38b78b59154e tempest-VolumesActionsTest-1824150770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ba0ac2b-feb8-4b21-8552-8c866e8b70e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:40:26 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-654d07e8-0e4e-47a3-9988-38b78b59154e tempest-VolumesActionsTest-1824150770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ba0ac2b-feb8-4b21-8552-8c866e8b70e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f71bbf7b-37f7-4a9d-ad4e-eedcc67a9acd', 'volume_name': 'volume-f71bbf7b-37f7-4a9d-ad4e-eedcc67a9acd', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:40:26 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-654d07e8-0e4e-47a3-9988-38b78b59154e tempest-VolumesActionsTest-1824150770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (599e8907-81e1-44a4-ae51-97e31c255dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:40:26 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-654d07e8-0e4e-47a3-9988-38b78b59154e tempest-VolumesActionsTest-1824150770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (599e8907-81e1-44a4-ae51-97e31c255dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:40:26 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-654d07e8-0e4e-47a3-9988-38b78b59154e tempest-VolumesActionsTest-1824150770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b16c836-6372-4277-92b7-1c4abc7a4a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:40:26 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-654d07e8-0e4e-47a3-9988-38b78b59154e tempest-VolumesActionsTest-1824150770 None] Volume f71bbf7b-37f7-4a9d-ad4e-eedcc67a9acd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f71bbf7b-37f7-4a9d-ad4e-eedcc67a9acd', 'volume_size': 1} Sep 18 21:40:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-654d07e8-0e4e-47a3-9988-38b78b59154e tempest-VolumesActionsTest-1824150770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:40:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-654d07e8-0e4e-47a3-9988-38b78b59154e tempest-VolumesActionsTest-1824150770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:40:26 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-654d07e8-0e4e-47a3-9988-38b78b59154e tempest-VolumesActionsTest-1824150770 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:40:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-347924075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f71bbf7b-37f7-4a9d-ad4e-eedcc67a9acd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c77e6178bbf42ffa1eb7b0d3d137f70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:40:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:40:26Z,use_quota=True,user_id='03c4af1aa0bf4ab08b382ef23a425901',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:40:26 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-654d07e8-0e4e-47a3-9988-38b78b59154e tempest-VolumesActionsTest-1824150770 None] Creating volume f71bbf7b-37f7-4a9d-ad4e-eedcc67a9acd {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:40:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-654d07e8-0e4e-47a3-9988-38b78b59154e tempest-VolumesActionsTest-1824150770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:40:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-654d07e8-0e4e-47a3-9988-38b78b59154e tempest-VolumesActionsTest-1824150770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:40:26 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-654d07e8-0e4e-47a3-9988-38b78b59154e tempest-VolumesActionsTest-1824150770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:40:26 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-654d07e8-0e4e-47a3-9988-38b78b59154e tempest-VolumesActionsTest-1824150770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:40:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-654d07e8-0e4e-47a3-9988-38b78b59154e tempest-VolumesActionsTest-1824150770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:40:26 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-654d07e8-0e4e-47a3-9988-38b78b59154e tempest-VolumesActionsTest-1824150770 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:40:26 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-654d07e8-0e4e-47a3-9988-38b78b59154e tempest-VolumesActionsTest-1824150770 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:40:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-654d07e8-0e4e-47a3-9988-38b78b59154e tempest-VolumesActionsTest-1824150770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f71bbf7b-37f7-4a9d-ad4e-eedcc67a9acd 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:40:26 devstack sudo[95110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f71bbf7b-37f7-4a9d-ad4e-eedcc67a9acd 1073741824 Sep 18 21:40:26 devstack sudo[95110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:40:27 devstack sudo[95110]: pam_unix(sudo:session): session closed for user root Sep 18 21:40:27 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-654d07e8-0e4e-47a3-9988-38b78b59154e tempest-VolumesActionsTest-1824150770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f71bbf7b-37f7-4a9d-ad4e-eedcc67a9acd 1073741824" returned: 0 in 0.725s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:40:27 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-654d07e8-0e4e-47a3-9988-38b78b59154e tempest-VolumesActionsTest-1824150770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f71bbf7b-37f7-4a9d-ad4e-eedcc67a9acd {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:40:27 devstack sudo[95117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f71bbf7b-37f7-4a9d-ad4e-eedcc67a9acd Sep 18 21:40:27 devstack sudo[95117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:40:27 devstack sudo[95117]: pam_unix(sudo:session): session closed for user root Sep 18 21:40:27 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-654d07e8-0e4e-47a3-9988-38b78b59154e tempest-VolumesActionsTest-1824150770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f71bbf7b-37f7-4a9d-ad4e-eedcc67a9acd" returned: 0 in 0.513s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:40:27 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-654d07e8-0e4e-47a3-9988-38b78b59154e tempest-VolumesActionsTest-1824150770 None] <== create_volume: return (1325ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:40:27 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-654d07e8-0e4e-47a3-9988-38b78b59154e tempest-VolumesActionsTest-1824150770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.329s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:40:27 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-654d07e8-0e4e-47a3-9988-38b78b59154e tempest-VolumesActionsTest-1824150770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b16c836-6372-4277-92b7-1c4abc7a4a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f71bbf7b-37f7-4a9d-ad4e-eedcc67a9acd', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:40:27 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-654d07e8-0e4e-47a3-9988-38b78b59154e tempest-VolumesActionsTest-1824150770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aca2768-b33e-4a94-ba92-23202e817525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:40:27 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-654d07e8-0e4e-47a3-9988-38b78b59154e tempest-VolumesActionsTest-1824150770 None] Volume volume-f71bbf7b-37f7-4a9d-ad4e-eedcc67a9acd (f71bbf7b-37f7-4a9d-ad4e-eedcc67a9acd): created successfully Sep 18 21:40:27 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-654d07e8-0e4e-47a3-9988-38b78b59154e tempest-VolumesActionsTest-1824150770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aca2768-b33e-4a94-ba92-23202e817525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:40:27 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-654d07e8-0e4e-47a3-9988-38b78b59154e tempest-VolumesActionsTest-1824150770 None] Flow 'volume_create_manager' (d4c7ef45-5d02-419d-a977-f963b2080289) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:40:27 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-654d07e8-0e4e-47a3-9988-38b78b59154e tempest-VolumesActionsTest-1824150770 None] Created volume successfully. Sep 18 21:40:28 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-6bc7ea33-993c-4a17-ba7e-7fe6bb876aba tempest-VolumesActionsTest-2054380204 None] Acquiring lock "cinder-f71bbf7b-37f7-4a9d-ad4e-eedcc67a9acd-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:40:28 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-6bc7ea33-993c-4a17-ba7e-7fe6bb876aba tempest-VolumesActionsTest-2054380204 None] Lock "cinder-f71bbf7b-37f7-4a9d-ad4e-eedcc67a9acd-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:40:28 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-6bc7ea33-993c-4a17-ba7e-7fe6bb876aba tempest-VolumesActionsTest-2054380204 None] Acquiring lock "cinder-quobyte-f71bbf7b-37f7-4a9d-ad4e-eedcc67a9acd" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:40:28 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-6bc7ea33-993c-4a17-ba7e-7fe6bb876aba tempest-VolumesActionsTest-2054380204 None] Lock "cinder-quobyte-f71bbf7b-37f7-4a9d-ad4e-eedcc67a9acd" acquired by "delete_volume" :: waited 0.018s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:40:28 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53bd7d6-582a-4ee9-b5a0-0ada0cfdb738]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:40:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6bc7ea33-993c-4a17-ba7e-7fe6bb876aba tempest-VolumesActionsTest-2054380204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f71bbf7b-37f7-4a9d-ad4e-eedcc67a9acd {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:40:29 devstack sudo[95121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f71bbf7b-37f7-4a9d-ad4e-eedcc67a9acd Sep 18 21:40:29 devstack sudo[95121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:40:29 devstack sudo[95121]: pam_unix(sudo:session): session closed for user root Sep 18 21:40:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6bc7ea33-993c-4a17-ba7e-7fe6bb876aba tempest-VolumesActionsTest-2054380204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f71bbf7b-37f7-4a9d-ad4e-eedcc67a9acd" returned: 0 in 0.444s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:40:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6bc7ea33-993c-4a17-ba7e-7fe6bb876aba tempest-VolumesActionsTest-2054380204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f71bbf7b-37f7-4a9d-ad4e-eedcc67a9acd {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:40:29 devstack sudo[95128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f71bbf7b-37f7-4a9d-ad4e-eedcc67a9acd Sep 18 21:40:29 devstack sudo[95128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:40:29 devstack sudo[95128]: pam_unix(sudo:session): session closed for user root Sep 18 21:40:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6bc7ea33-993c-4a17-ba7e-7fe6bb876aba tempest-VolumesActionsTest-2054380204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f71bbf7b-37f7-4a9d-ad4e-eedcc67a9acd" returned: 0 in 0.276s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:40:29 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-6bc7ea33-993c-4a17-ba7e-7fe6bb876aba tempest-VolumesActionsTest-2054380204 None] Lock "cinder-quobyte-f71bbf7b-37f7-4a9d-ad4e-eedcc67a9acd" released by "delete_volume" :: held 0.788s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:40:29 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-6bc7ea33-993c-4a17-ba7e-7fe6bb876aba tempest-VolumesActionsTest-2054380204 None] Created reservations ['3fe6133f-427f-4021-8027-26ba845d53ba', 'eea783a5-3a1d-4a18-8c4b-3f2dae2df96b', '0801f6d7-2a93-445f-b81b-67b471204646', '67f44487-68f5-42f3-a4b4-30ac078c07a7'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:40:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6bc7ea33-993c-4a17-ba7e-7fe6bb876aba tempest-VolumesActionsTest-2054380204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:40:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6bc7ea33-993c-4a17-ba7e-7fe6bb876aba tempest-VolumesActionsTest-2054380204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:40:29 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-6bc7ea33-993c-4a17-ba7e-7fe6bb876aba tempest-VolumesActionsTest-2054380204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:40:29 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-6bc7ea33-993c-4a17-ba7e-7fe6bb876aba tempest-VolumesActionsTest-2054380204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:40:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6bc7ea33-993c-4a17-ba7e-7fe6bb876aba tempest-VolumesActionsTest-2054380204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:40:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6bc7ea33-993c-4a17-ba7e-7fe6bb876aba tempest-VolumesActionsTest-2054380204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:40:29 devstack sudo[95131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:40:29 devstack sudo[95131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:40:30 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ca10b8f-9fec-42ed-af3e-e5efe72ece49 tempest-AttachVolumeNegativeTest-605821046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:40:30 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-0ca10b8f-9fec-42ed-af3e-e5efe72ece49 tempest-AttachVolumeNegativeTest-605821046 None] Flow 'volume_create_manager' (45f21dfa-0eb5-46b5-b6f2-cd375eb05f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:40:30 devstack sudo[95131]: pam_unix(sudo:session): session closed for user root Sep 18 21:40:30 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-0ca10b8f-9fec-42ed-af3e-e5efe72ece49 tempest-AttachVolumeNegativeTest-605821046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e76de7f4-85f6-4788-a2a8-69e0c89ed8fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:40:30 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6bc7ea33-993c-4a17-ba7e-7fe6bb876aba tempest-VolumesActionsTest-2054380204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.568s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:40:30 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-6bc7ea33-993c-4a17-ba7e-7fe6bb876aba tempest-VolumesActionsTest-2054380204 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:40:30 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-0ca10b8f-9fec-42ed-af3e-e5efe72ece49 tempest-AttachVolumeNegativeTest-605821046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e76de7f4-85f6-4788-a2a8-69e0c89ed8fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:40:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-967837742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a1be3b5-70fb-44ba-9551-fb7c7861bfbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30df0b9dab9e41068c0b4f9907624377',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:40:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:40:30Z,use_quota=True,user_id='cd990a60d4a840228debec9b50923d6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:40:30 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-0ca10b8f-9fec-42ed-af3e-e5efe72ece49 tempest-AttachVolumeNegativeTest-605821046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a1c9f64-d864-43ae-b894-a38077daacc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:40:30 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-0ca10b8f-9fec-42ed-af3e-e5efe72ece49 tempest-AttachVolumeNegativeTest-605821046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a1c9f64-d864-43ae-b894-a38077daacc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:40:30 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-0ca10b8f-9fec-42ed-af3e-e5efe72ece49 tempest-AttachVolumeNegativeTest-605821046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e543b06f-21e6-428b-a852-b6b78c8d1cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:40:30 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-0ca10b8f-9fec-42ed-af3e-e5efe72ece49 tempest-AttachVolumeNegativeTest-605821046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e543b06f-21e6-428b-a852-b6b78c8d1cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a1be3b5-70fb-44ba-9551-fb7c7861bfbe', 'volume_name': 'volume-9a1be3b5-70fb-44ba-9551-fb7c7861bfbe', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:40:30 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-0ca10b8f-9fec-42ed-af3e-e5efe72ece49 tempest-AttachVolumeNegativeTest-605821046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (007f669b-f57b-41c2-8d42-6945faa3bc74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:40:30 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-0ca10b8f-9fec-42ed-af3e-e5efe72ece49 tempest-AttachVolumeNegativeTest-605821046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (007f669b-f57b-41c2-8d42-6945faa3bc74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:40:30 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-0ca10b8f-9fec-42ed-af3e-e5efe72ece49 tempest-AttachVolumeNegativeTest-605821046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1c462da-b40a-4e55-b4e5-42331c127dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:40:30 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-0ca10b8f-9fec-42ed-af3e-e5efe72ece49 tempest-AttachVolumeNegativeTest-605821046 None] Volume 9a1be3b5-70fb-44ba-9551-fb7c7861bfbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a1be3b5-70fb-44ba-9551-fb7c7861bfbe', 'volume_size': 1} Sep 18 21:40:30 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-0ca10b8f-9fec-42ed-af3e-e5efe72ece49 tempest-AttachVolumeNegativeTest-605821046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:40:30 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-0ca10b8f-9fec-42ed-af3e-e5efe72ece49 tempest-AttachVolumeNegativeTest-605821046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:40:30 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-0ca10b8f-9fec-42ed-af3e-e5efe72ece49 tempest-AttachVolumeNegativeTest-605821046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:40:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-967837742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a1be3b5-70fb-44ba-9551-fb7c7861bfbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30df0b9dab9e41068c0b4f9907624377',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:40:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:40:30Z,use_quota=True,user_id='cd990a60d4a840228debec9b50923d6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:40:30 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-0ca10b8f-9fec-42ed-af3e-e5efe72ece49 tempest-AttachVolumeNegativeTest-605821046 None] Creating volume 9a1be3b5-70fb-44ba-9551-fb7c7861bfbe {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:40:30 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-0ca10b8f-9fec-42ed-af3e-e5efe72ece49 tempest-AttachVolumeNegativeTest-605821046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:40:30 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-0ca10b8f-9fec-42ed-af3e-e5efe72ece49 tempest-AttachVolumeNegativeTest-605821046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:40:30 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-0ca10b8f-9fec-42ed-af3e-e5efe72ece49 tempest-AttachVolumeNegativeTest-605821046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:40:30 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-0ca10b8f-9fec-42ed-af3e-e5efe72ece49 tempest-AttachVolumeNegativeTest-605821046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:40:30 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-0ca10b8f-9fec-42ed-af3e-e5efe72ece49 tempest-AttachVolumeNegativeTest-605821046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:40:30 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-0ca10b8f-9fec-42ed-af3e-e5efe72ece49 tempest-AttachVolumeNegativeTest-605821046 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:40:30 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-0ca10b8f-9fec-42ed-af3e-e5efe72ece49 tempest-AttachVolumeNegativeTest-605821046 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:40:30 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0ca10b8f-9fec-42ed-af3e-e5efe72ece49 tempest-AttachVolumeNegativeTest-605821046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9a1be3b5-70fb-44ba-9551-fb7c7861bfbe 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:40:30 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-6bc7ea33-993c-4a17-ba7e-7fe6bb876aba tempest-VolumesActionsTest-2054380204 None] Deleted volume successfully. Sep 18 21:40:30 devstack sudo[95135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9a1be3b5-70fb-44ba-9551-fb7c7861bfbe 1073741824 Sep 18 21:40:30 devstack sudo[95135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:40:30 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-6bc7ea33-993c-4a17-ba7e-7fe6bb876aba tempest-VolumesActionsTest-2054380204 None] Lock "cinder-f71bbf7b-37f7-4a9d-ad4e-eedcc67a9acd-delete_volume" released by "delete_volume" :: held 1.846s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:40:30 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-090f384e-42ef-43df-b05e-f0d40f261065 tempest-VolumesActionsTest-1824150770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:40:30 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-090f384e-42ef-43df-b05e-f0d40f261065 tempest-VolumesActionsTest-1824150770 None] Flow 'volume_create_manager' (ae87dc53-2843-4e5f-b66f-de97954f5fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:40:30 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-090f384e-42ef-43df-b05e-f0d40f261065 tempest-VolumesActionsTest-1824150770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c83e4e5-bef6-43d7-9ee4-1163efae57e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:40:30 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-090f384e-42ef-43df-b05e-f0d40f261065 tempest-VolumesActionsTest-1824150770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c83e4e5-bef6-43d7-9ee4-1163efae57e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:40:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1425134482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be28a927-c7e2-4883-885a-806c6db3392d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c77e6178bbf42ffa1eb7b0d3d137f70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:40:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:40:31Z,use_quota=True,user_id='03c4af1aa0bf4ab08b382ef23a425901',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:40:30 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-090f384e-42ef-43df-b05e-f0d40f261065 tempest-VolumesActionsTest-1824150770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de6125d9-64f6-4016-869e-b9c88decc236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:40:30 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-090f384e-42ef-43df-b05e-f0d40f261065 tempest-VolumesActionsTest-1824150770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de6125d9-64f6-4016-869e-b9c88decc236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:40:30 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-090f384e-42ef-43df-b05e-f0d40f261065 tempest-VolumesActionsTest-1824150770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74dcc165-6906-418d-9a28-4863aa7298b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:40:30 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-090f384e-42ef-43df-b05e-f0d40f261065 tempest-VolumesActionsTest-1824150770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74dcc165-6906-418d-9a28-4863aa7298b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be28a927-c7e2-4883-885a-806c6db3392d', 'volume_name': 'volume-be28a927-c7e2-4883-885a-806c6db3392d', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:40:30 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-090f384e-42ef-43df-b05e-f0d40f261065 tempest-VolumesActionsTest-1824150770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c7953d7-0745-4eba-82d7-cd1b72fd81ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:40:30 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-090f384e-42ef-43df-b05e-f0d40f261065 tempest-VolumesActionsTest-1824150770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c7953d7-0745-4eba-82d7-cd1b72fd81ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:40:30 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-090f384e-42ef-43df-b05e-f0d40f261065 tempest-VolumesActionsTest-1824150770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abb002c0-fe98-4aef-9117-39dd56b28fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:40:30 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-090f384e-42ef-43df-b05e-f0d40f261065 tempest-VolumesActionsTest-1824150770 None] Volume be28a927-c7e2-4883-885a-806c6db3392d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be28a927-c7e2-4883-885a-806c6db3392d', 'volume_size': 1} Sep 18 21:40:30 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-090f384e-42ef-43df-b05e-f0d40f261065 tempest-VolumesActionsTest-1824150770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:40:31 devstack sudo[95135]: pam_unix(sudo:session): session closed for user root Sep 18 21:40:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0ca10b8f-9fec-42ed-af3e-e5efe72ece49 tempest-AttachVolumeNegativeTest-605821046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9a1be3b5-70fb-44ba-9551-fb7c7861bfbe 1073741824" returned: 0 in 0.579s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:40:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0ca10b8f-9fec-42ed-af3e-e5efe72ece49 tempest-AttachVolumeNegativeTest-605821046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9a1be3b5-70fb-44ba-9551-fb7c7861bfbe {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:40:31 devstack sudo[95140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9a1be3b5-70fb-44ba-9551-fb7c7861bfbe Sep 18 21:40:31 devstack sudo[95140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:40:31 devstack sudo[95140]: pam_unix(sudo:session): session closed for user root Sep 18 21:40:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0ca10b8f-9fec-42ed-af3e-e5efe72ece49 tempest-AttachVolumeNegativeTest-605821046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9a1be3b5-70fb-44ba-9551-fb7c7861bfbe" returned: 0 in 0.285s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:40:31 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-0ca10b8f-9fec-42ed-af3e-e5efe72ece49 tempest-AttachVolumeNegativeTest-605821046 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:40:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-0ca10b8f-9fec-42ed-af3e-e5efe72ece49 tempest-AttachVolumeNegativeTest-605821046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:40:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-090f384e-42ef-43df-b05e-f0d40f261065 tempest-VolumesActionsTest-1824150770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.552s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:40:31 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-090f384e-42ef-43df-b05e-f0d40f261065 tempest-VolumesActionsTest-1824150770 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:40:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1425134482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be28a927-c7e2-4883-885a-806c6db3392d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c77e6178bbf42ffa1eb7b0d3d137f70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:40:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:40:31Z,use_quota=True,user_id='03c4af1aa0bf4ab08b382ef23a425901',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:40:31 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-090f384e-42ef-43df-b05e-f0d40f261065 tempest-VolumesActionsTest-1824150770 None] Creating volume be28a927-c7e2-4883-885a-806c6db3392d {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:40:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-090f384e-42ef-43df-b05e-f0d40f261065 tempest-VolumesActionsTest-1824150770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:40:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-090f384e-42ef-43df-b05e-f0d40f261065 tempest-VolumesActionsTest-1824150770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:40:31 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-090f384e-42ef-43df-b05e-f0d40f261065 tempest-VolumesActionsTest-1824150770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:40:31 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-090f384e-42ef-43df-b05e-f0d40f261065 tempest-VolumesActionsTest-1824150770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:40:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-090f384e-42ef-43df-b05e-f0d40f261065 tempest-VolumesActionsTest-1824150770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:40:31 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-090f384e-42ef-43df-b05e-f0d40f261065 tempest-VolumesActionsTest-1824150770 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:40:31 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-090f384e-42ef-43df-b05e-f0d40f261065 tempest-VolumesActionsTest-1824150770 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:40:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-090f384e-42ef-43df-b05e-f0d40f261065 tempest-VolumesActionsTest-1824150770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-be28a927-c7e2-4883-885a-806c6db3392d 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:40:31 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-0ca10b8f-9fec-42ed-af3e-e5efe72ece49 tempest-AttachVolumeNegativeTest-605821046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1c462da-b40a-4e55-b4e5-42331c127dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a1be3b5-70fb-44ba-9551-fb7c7861bfbe', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:40:31 devstack sudo[95143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-be28a927-c7e2-4883-885a-806c6db3392d 1073741824 Sep 18 21:40:31 devstack sudo[95143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:40:31 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-0ca10b8f-9fec-42ed-af3e-e5efe72ece49 tempest-AttachVolumeNegativeTest-605821046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daa19038-97a9-42ea-a95e-a77be7136ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:40:31 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-0ca10b8f-9fec-42ed-af3e-e5efe72ece49 tempest-AttachVolumeNegativeTest-605821046 None] Volume volume-9a1be3b5-70fb-44ba-9551-fb7c7861bfbe (9a1be3b5-70fb-44ba-9551-fb7c7861bfbe): created successfully Sep 18 21:40:31 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-0ca10b8f-9fec-42ed-af3e-e5efe72ece49 tempest-AttachVolumeNegativeTest-605821046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daa19038-97a9-42ea-a95e-a77be7136ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:40:31 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-0ca10b8f-9fec-42ed-af3e-e5efe72ece49 tempest-AttachVolumeNegativeTest-605821046 None] Flow 'volume_create_manager' (45f21dfa-0eb5-46b5-b6f2-cd375eb05f16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:40:31 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-0ca10b8f-9fec-42ed-af3e-e5efe72ece49 tempest-AttachVolumeNegativeTest-605821046 None] Created volume successfully. Sep 18 21:40:32 devstack sudo[95143]: pam_unix(sudo:session): session closed for user root Sep 18 21:40:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-090f384e-42ef-43df-b05e-f0d40f261065 tempest-VolumesActionsTest-1824150770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-be28a927-c7e2-4883-885a-806c6db3392d 1073741824" returned: 0 in 0.564s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:40:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-090f384e-42ef-43df-b05e-f0d40f261065 tempest-VolumesActionsTest-1824150770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-be28a927-c7e2-4883-885a-806c6db3392d {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:40:32 devstack sudo[95148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-be28a927-c7e2-4883-885a-806c6db3392d Sep 18 21:40:32 devstack sudo[95148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:40:32 devstack sudo[95148]: pam_unix(sudo:session): session closed for user root Sep 18 21:40:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-090f384e-42ef-43df-b05e-f0d40f261065 tempest-VolumesActionsTest-1824150770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-be28a927-c7e2-4883-885a-806c6db3392d" returned: 0 in 0.288s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:40:32 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-090f384e-42ef-43df-b05e-f0d40f261065 tempest-VolumesActionsTest-1824150770 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:40:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-090f384e-42ef-43df-b05e-f0d40f261065 tempest-VolumesActionsTest-1824150770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:40:32 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-090f384e-42ef-43df-b05e-f0d40f261065 tempest-VolumesActionsTest-1824150770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abb002c0-fe98-4aef-9117-39dd56b28fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be28a927-c7e2-4883-885a-806c6db3392d', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:40:32 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-090f384e-42ef-43df-b05e-f0d40f261065 tempest-VolumesActionsTest-1824150770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ab87234-f2f8-43a5-963c-b6fcd7eab5fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:40:32 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-090f384e-42ef-43df-b05e-f0d40f261065 tempest-VolumesActionsTest-1824150770 None] Volume volume-be28a927-c7e2-4883-885a-806c6db3392d (be28a927-c7e2-4883-885a-806c6db3392d): created successfully Sep 18 21:40:32 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-090f384e-42ef-43df-b05e-f0d40f261065 tempest-VolumesActionsTest-1824150770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ab87234-f2f8-43a5-963c-b6fcd7eab5fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:40:32 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-090f384e-42ef-43df-b05e-f0d40f261065 tempest-VolumesActionsTest-1824150770 None] Flow 'volume_create_manager' (ae87dc53-2843-4e5f-b66f-de97954f5fe4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:40:32 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-090f384e-42ef-43df-b05e-f0d40f261065 tempest-VolumesActionsTest-1824150770 None] Created volume successfully. Sep 18 21:40:33 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-a9eacd1d-d6c7-4da1-9c93-ce483f82c649 req-94b2e6ae-f5b3-478c-9844-a40781627fd2 tempest-AttachVolumeNegativeTest-605821046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:40:33 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-a9eacd1d-d6c7-4da1-9c93-ce483f82c649 req-94b2e6ae-f5b3-478c-9844-a40781627fd2 tempest-AttachVolumeNegativeTest-605821046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:40:33 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-a9eacd1d-d6c7-4da1-9c93-ce483f82c649 req-94b2e6ae-f5b3-478c-9844-a40781627fd2 tempest-AttachVolumeNegativeTest-605821046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:40:33 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [req-a9eacd1d-d6c7-4da1-9c93-ce483f82c649 req-94b2e6ae-f5b3-478c-9844-a40781627fd2 tempest-AttachVolumeNegativeTest-605821046 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff', 'name': 'volume-9a1be3b5-70fb-44ba-9551-fb7c7861bfbe', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '95e9ea6e-500e-4a84-bcba-982344183e3f', 'enforce_multipath': True} {{(pid=86136) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 18 21:40:33 devstack cinder-volume[86136]: INFO cinder.volume.manager [req-a9eacd1d-d6c7-4da1-9c93-ce483f82c649 req-94b2e6ae-f5b3-478c-9844-a40781627fd2 tempest-AttachVolumeNegativeTest-605821046 None] attachment_update completed successfully. Sep 18 21:40:33 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-ccf21c91-ad40-4edc-b852-beb77464c944 tempest-VolumesActionsTest-1824150770 None] Acquiring lock "cinder-be28a927-c7e2-4883-885a-806c6db3392d-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:40:33 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-ccf21c91-ad40-4edc-b852-beb77464c944 tempest-VolumesActionsTest-1824150770 None] Lock "cinder-be28a927-c7e2-4883-885a-806c6db3392d-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:40:34 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-ccf21c91-ad40-4edc-b852-beb77464c944 tempest-VolumesActionsTest-1824150770 None] Acquiring lock "cinder-quobyte-be28a927-c7e2-4883-885a-806c6db3392d" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:40:34 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-ccf21c91-ad40-4edc-b852-beb77464c944 tempest-VolumesActionsTest-1824150770 None] Lock "cinder-quobyte-be28a927-c7e2-4883-885a-806c6db3392d" acquired by "delete_volume" :: waited 0.026s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:40:34 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a2d7cf-e40f-4f49-bd36-c7bdf7e593d4]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:40:34 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ccf21c91-ad40-4edc-b852-beb77464c944 tempest-VolumesActionsTest-1824150770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-be28a927-c7e2-4883-885a-806c6db3392d {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:40:34 devstack sudo[95165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-be28a927-c7e2-4883-885a-806c6db3392d Sep 18 21:40:34 devstack sudo[95165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:40:34 devstack sudo[95165]: pam_unix(sudo:session): session closed for user root Sep 18 21:40:34 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ccf21c91-ad40-4edc-b852-beb77464c944 tempest-VolumesActionsTest-1824150770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-be28a927-c7e2-4883-885a-806c6db3392d" returned: 0 in 0.497s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:40:34 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ccf21c91-ad40-4edc-b852-beb77464c944 tempest-VolumesActionsTest-1824150770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-be28a927-c7e2-4883-885a-806c6db3392d {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:40:34 devstack sudo[95582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-be28a927-c7e2-4883-885a-806c6db3392d Sep 18 21:40:34 devstack sudo[95582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:40:35 devstack sudo[95582]: pam_unix(sudo:session): session closed for user root Sep 18 21:40:35 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ccf21c91-ad40-4edc-b852-beb77464c944 tempest-VolumesActionsTest-1824150770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-be28a927-c7e2-4883-885a-806c6db3392d" returned: 0 in 0.442s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:40:35 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-ccf21c91-ad40-4edc-b852-beb77464c944 tempest-VolumesActionsTest-1824150770 None] Lock "cinder-quobyte-be28a927-c7e2-4883-885a-806c6db3392d" released by "delete_volume" :: held 1.025s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:40:35 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-ccf21c91-ad40-4edc-b852-beb77464c944 tempest-VolumesActionsTest-1824150770 None] Created reservations ['cc5ada4a-ec4b-435f-90fd-5d7074a8c894', 'bca55f07-b586-4443-83f1-e2f2f711c7d6', '7a906f88-7666-4413-b5c8-b783eb81c565', '2f2df593-5da8-4ebf-ae0a-c2a84e0f3116'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:40:35 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-ccf21c91-ad40-4edc-b852-beb77464c944 tempest-VolumesActionsTest-1824150770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:40:35 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-ccf21c91-ad40-4edc-b852-beb77464c944 tempest-VolumesActionsTest-1824150770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:40:35 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-ccf21c91-ad40-4edc-b852-beb77464c944 tempest-VolumesActionsTest-1824150770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:40:35 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-ccf21c91-ad40-4edc-b852-beb77464c944 tempest-VolumesActionsTest-1824150770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:40:35 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-ccf21c91-ad40-4edc-b852-beb77464c944 tempest-VolumesActionsTest-1824150770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:40:35 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ccf21c91-ad40-4edc-b852-beb77464c944 tempest-VolumesActionsTest-1824150770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:40:35 devstack sudo[95585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:40:35 devstack sudo[95585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:40:35 devstack sudo[95585]: pam_unix(sudo:session): session closed for user root Sep 18 21:40:35 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ccf21c91-ad40-4edc-b852-beb77464c944 tempest-VolumesActionsTest-1824150770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.293s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:40:35 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-ccf21c91-ad40-4edc-b852-beb77464c944 tempest-VolumesActionsTest-1824150770 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:40:35 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-ccf21c91-ad40-4edc-b852-beb77464c944 tempest-VolumesActionsTest-1824150770 None] Deleted volume successfully. Sep 18 21:40:35 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-ccf21c91-ad40-4edc-b852-beb77464c944 tempest-VolumesActionsTest-1824150770 None] Lock "cinder-be28a927-c7e2-4883-885a-806c6db3392d-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:40:45 devstack cinder-volume[86136]: DEBUG dbcounter [-] [86136] Writing DB stats cinder:SELECT=59,cinder:UPDATE=80,cinder:INSERT=17,cinder:DELETE=6 {{(pid=86136) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 21:40:45 devstack cinder-volume[86136]: DEBUG dbcounter [-] [86136] Writing DB stats cinder:UPDATE=69,cinder:SELECT=58,cinder:DELETE=7,cinder:INSERT=16 {{(pid=86136) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 21:40:49 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-fef776e3-97a0-4afa-8c6b-25129d41b44e tempest-TestServerVolumeAttachScenarioOldVersion-516887614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:40:49 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-fef776e3-97a0-4afa-8c6b-25129d41b44e tempest-TestServerVolumeAttachScenarioOldVersion-516887614 None] Flow 'volume_create_manager' (62fad3aa-77ca-4240-a4a0-a518b2618e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:40:49 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-fef776e3-97a0-4afa-8c6b-25129d41b44e tempest-TestServerVolumeAttachScenarioOldVersion-516887614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e53708d4-e022-417b-9b40-e16870cbd5c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:40:49 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-fef776e3-97a0-4afa-8c6b-25129d41b44e tempest-TestServerVolumeAttachScenarioOldVersion-516887614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e53708d4-e022-417b-9b40-e16870cbd5c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:40:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-213539459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28647997-d572-4421-8450-e0ec43829147,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebe7ee5a84ee4b6e8b7119d8cf9a69a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:40:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:40:49Z,use_quota=True,user_id='fe98a3424ec4460dba8b981029342f59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:40:49 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-fef776e3-97a0-4afa-8c6b-25129d41b44e tempest-TestServerVolumeAttachScenarioOldVersion-516887614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ebd77f4-df4a-42b3-b75a-c49e6b61e99d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:40:49 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-fef776e3-97a0-4afa-8c6b-25129d41b44e tempest-TestServerVolumeAttachScenarioOldVersion-516887614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ebd77f4-df4a-42b3-b75a-c49e6b61e99d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:40:49 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-fef776e3-97a0-4afa-8c6b-25129d41b44e tempest-TestServerVolumeAttachScenarioOldVersion-516887614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4100ea6e-1fcc-4a47-8f8b-289e7f39e2e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:40:49 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-fef776e3-97a0-4afa-8c6b-25129d41b44e tempest-TestServerVolumeAttachScenarioOldVersion-516887614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4100ea6e-1fcc-4a47-8f8b-289e7f39e2e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28647997-d572-4421-8450-e0ec43829147', 'volume_name': 'volume-28647997-d572-4421-8450-e0ec43829147', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:40:49 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-fef776e3-97a0-4afa-8c6b-25129d41b44e tempest-TestServerVolumeAttachScenarioOldVersion-516887614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37e05e80-2efe-4b39-b202-742e23ab5574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:40:49 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-fef776e3-97a0-4afa-8c6b-25129d41b44e tempest-TestServerVolumeAttachScenarioOldVersion-516887614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37e05e80-2efe-4b39-b202-742e23ab5574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:40:49 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-fef776e3-97a0-4afa-8c6b-25129d41b44e tempest-TestServerVolumeAttachScenarioOldVersion-516887614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b26e5a0e-b8f3-4ff4-b76e-9dbc4ea5b6fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:40:49 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-fef776e3-97a0-4afa-8c6b-25129d41b44e tempest-TestServerVolumeAttachScenarioOldVersion-516887614 None] Volume 28647997-d572-4421-8450-e0ec43829147: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28647997-d572-4421-8450-e0ec43829147', 'volume_size': 1} Sep 18 21:40:49 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-fef776e3-97a0-4afa-8c6b-25129d41b44e tempest-TestServerVolumeAttachScenarioOldVersion-516887614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:40:49 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-fef776e3-97a0-4afa-8c6b-25129d41b44e tempest-TestServerVolumeAttachScenarioOldVersion-516887614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:40:49 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-fef776e3-97a0-4afa-8c6b-25129d41b44e tempest-TestServerVolumeAttachScenarioOldVersion-516887614 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:40:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-213539459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28647997-d572-4421-8450-e0ec43829147,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebe7ee5a84ee4b6e8b7119d8cf9a69a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:40:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:40:49Z,use_quota=True,user_id='fe98a3424ec4460dba8b981029342f59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:40:49 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-fef776e3-97a0-4afa-8c6b-25129d41b44e tempest-TestServerVolumeAttachScenarioOldVersion-516887614 None] Creating volume 28647997-d572-4421-8450-e0ec43829147 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:40:49 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-fef776e3-97a0-4afa-8c6b-25129d41b44e tempest-TestServerVolumeAttachScenarioOldVersion-516887614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:40:49 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-fef776e3-97a0-4afa-8c6b-25129d41b44e tempest-TestServerVolumeAttachScenarioOldVersion-516887614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:40:49 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-fef776e3-97a0-4afa-8c6b-25129d41b44e tempest-TestServerVolumeAttachScenarioOldVersion-516887614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:40:49 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-fef776e3-97a0-4afa-8c6b-25129d41b44e tempest-TestServerVolumeAttachScenarioOldVersion-516887614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:40:49 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-fef776e3-97a0-4afa-8c6b-25129d41b44e tempest-TestServerVolumeAttachScenarioOldVersion-516887614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:40:49 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-fef776e3-97a0-4afa-8c6b-25129d41b44e tempest-TestServerVolumeAttachScenarioOldVersion-516887614 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:40:49 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-fef776e3-97a0-4afa-8c6b-25129d41b44e tempest-TestServerVolumeAttachScenarioOldVersion-516887614 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:40:49 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-fef776e3-97a0-4afa-8c6b-25129d41b44e tempest-TestServerVolumeAttachScenarioOldVersion-516887614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-28647997-d572-4421-8450-e0ec43829147 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:40:49 devstack sudo[95686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-28647997-d572-4421-8450-e0ec43829147 1073741824 Sep 18 21:40:49 devstack sudo[95686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:40:49 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e601744-de13-477f-9907-1c80b26a33fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:40:49 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9e601744-de13-477f-9907-1c80b26a33fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] Flow 'volume_create_manager' (8cb7dd66-3a0d-46d1-b920-63ade8784416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:40:49 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9e601744-de13-477f-9907-1c80b26a33fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03ff5fcb-a577-46cc-a6ae-bb004c5f2aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:40:49 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9e601744-de13-477f-9907-1c80b26a33fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03ff5fcb-a577-46cc-a6ae-bb004c5f2aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:40:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-710032662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1fef3c6-febe-4394-8fd2-a4b83640cef6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01b8248666b640c7b91ed1dd920b54af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:40:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:40:50Z,use_quota=True,user_id='ffee98ac8fc34af6b155ad47c4006ebd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:40:49 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9e601744-de13-477f-9907-1c80b26a33fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (670e2182-9231-4f11-a3cd-1da801d8e125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:40:49 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9e601744-de13-477f-9907-1c80b26a33fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (670e2182-9231-4f11-a3cd-1da801d8e125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:40:49 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9e601744-de13-477f-9907-1c80b26a33fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dff3bbc-8e6f-4494-8edc-9a762f224424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:40:49 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9e601744-de13-477f-9907-1c80b26a33fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dff3bbc-8e6f-4494-8edc-9a762f224424) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1fef3c6-febe-4394-8fd2-a4b83640cef6', 'volume_name': 'volume-e1fef3c6-febe-4394-8fd2-a4b83640cef6', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:40:49 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9e601744-de13-477f-9907-1c80b26a33fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea7b770a-f966-4a07-a4ad-6d9c8afc221f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:40:49 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9e601744-de13-477f-9907-1c80b26a33fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea7b770a-f966-4a07-a4ad-6d9c8afc221f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:40:49 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9e601744-de13-477f-9907-1c80b26a33fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94fb05dd-b36b-45ca-a073-0537ee367d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:40:49 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-9e601744-de13-477f-9907-1c80b26a33fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] Volume e1fef3c6-febe-4394-8fd2-a4b83640cef6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1fef3c6-febe-4394-8fd2-a4b83640cef6', 'volume_size': 1} Sep 18 21:40:49 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-9e601744-de13-477f-9907-1c80b26a33fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:40:50 devstack sudo[95686]: pam_unix(sudo:session): session closed for user root Sep 18 21:40:50 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-fef776e3-97a0-4afa-8c6b-25129d41b44e tempest-TestServerVolumeAttachScenarioOldVersion-516887614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-28647997-d572-4421-8450-e0ec43829147 1073741824" returned: 0 in 0.853s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:40:50 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-fef776e3-97a0-4afa-8c6b-25129d41b44e tempest-TestServerVolumeAttachScenarioOldVersion-516887614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-28647997-d572-4421-8450-e0ec43829147 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:40:50 devstack sudo[95695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-28647997-d572-4421-8450-e0ec43829147 Sep 18 21:40:50 devstack sudo[95695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:40:50 devstack sudo[95695]: pam_unix(sudo:session): session closed for user root Sep 18 21:40:50 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-fef776e3-97a0-4afa-8c6b-25129d41b44e tempest-TestServerVolumeAttachScenarioOldVersion-516887614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-28647997-d572-4421-8450-e0ec43829147" returned: 0 in 0.371s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:40:50 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-fef776e3-97a0-4afa-8c6b-25129d41b44e tempest-TestServerVolumeAttachScenarioOldVersion-516887614 None] <== create_volume: return (1311ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:40:50 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-fef776e3-97a0-4afa-8c6b-25129d41b44e tempest-TestServerVolumeAttachScenarioOldVersion-516887614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.318s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:40:50 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-9e601744-de13-477f-9907-1c80b26a33fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.705s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:40:50 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-9e601744-de13-477f-9907-1c80b26a33fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:40:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-710032662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1fef3c6-febe-4394-8fd2-a4b83640cef6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01b8248666b640c7b91ed1dd920b54af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:40:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:40:50Z,use_quota=True,user_id='ffee98ac8fc34af6b155ad47c4006ebd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:40:50 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-9e601744-de13-477f-9907-1c80b26a33fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] Creating volume e1fef3c6-febe-4394-8fd2-a4b83640cef6 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:40:50 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-9e601744-de13-477f-9907-1c80b26a33fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:40:50 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-9e601744-de13-477f-9907-1c80b26a33fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:40:50 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-9e601744-de13-477f-9907-1c80b26a33fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:40:50 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-9e601744-de13-477f-9907-1c80b26a33fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:40:50 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-9e601744-de13-477f-9907-1c80b26a33fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:40:50 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-9e601744-de13-477f-9907-1c80b26a33fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:40:50 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-9e601744-de13-477f-9907-1c80b26a33fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:40:50 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9e601744-de13-477f-9907-1c80b26a33fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e1fef3c6-febe-4394-8fd2-a4b83640cef6 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:40:50 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-fef776e3-97a0-4afa-8c6b-25129d41b44e tempest-TestServerVolumeAttachScenarioOldVersion-516887614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b26e5a0e-b8f3-4ff4-b76e-9dbc4ea5b6fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28647997-d572-4421-8450-e0ec43829147', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:40:50 devstack sudo[95698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e1fef3c6-febe-4394-8fd2-a4b83640cef6 1073741824 Sep 18 21:40:50 devstack sudo[95698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:40:50 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-fef776e3-97a0-4afa-8c6b-25129d41b44e tempest-TestServerVolumeAttachScenarioOldVersion-516887614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (529a9ec4-ba77-404c-8e56-986ecf7f51fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:40:50 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-fef776e3-97a0-4afa-8c6b-25129d41b44e tempest-TestServerVolumeAttachScenarioOldVersion-516887614 None] Volume volume-28647997-d572-4421-8450-e0ec43829147 (28647997-d572-4421-8450-e0ec43829147): created successfully Sep 18 21:40:50 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-fef776e3-97a0-4afa-8c6b-25129d41b44e tempest-TestServerVolumeAttachScenarioOldVersion-516887614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (529a9ec4-ba77-404c-8e56-986ecf7f51fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:40:50 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-fef776e3-97a0-4afa-8c6b-25129d41b44e tempest-TestServerVolumeAttachScenarioOldVersion-516887614 None] Flow 'volume_create_manager' (62fad3aa-77ca-4240-a4a0-a518b2618e6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:40:50 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-fef776e3-97a0-4afa-8c6b-25129d41b44e tempest-TestServerVolumeAttachScenarioOldVersion-516887614 None] Created volume successfully. Sep 18 21:40:51 devstack sudo[95698]: pam_unix(sudo:session): session closed for user root Sep 18 21:40:51 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9e601744-de13-477f-9907-1c80b26a33fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e1fef3c6-febe-4394-8fd2-a4b83640cef6 1073741824" returned: 0 in 0.762s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:40:51 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9e601744-de13-477f-9907-1c80b26a33fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e1fef3c6-febe-4394-8fd2-a4b83640cef6 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:40:51 devstack sudo[95708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e1fef3c6-febe-4394-8fd2-a4b83640cef6 Sep 18 21:40:51 devstack sudo[95708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:40:51 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9e601744-de13-477f-9907-1c80b26a33fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e1fef3c6-febe-4394-8fd2-a4b83640cef6" returned: 0 in 0.532s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:40:51 devstack sudo[95708]: pam_unix(sudo:session): session closed for user root Sep 18 21:40:51 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-9e601744-de13-477f-9907-1c80b26a33fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] <== create_volume: return (1362ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:40:51 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-9e601744-de13-477f-9907-1c80b26a33fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.365s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:40:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9e601744-de13-477f-9907-1c80b26a33fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94fb05dd-b36b-45ca-a073-0537ee367d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1fef3c6-febe-4394-8fd2-a4b83640cef6', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:40:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9e601744-de13-477f-9907-1c80b26a33fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0503e031-df5f-439b-86e0-b551479ed1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:40:52 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-9e601744-de13-477f-9907-1c80b26a33fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] Volume volume-e1fef3c6-febe-4394-8fd2-a4b83640cef6 (e1fef3c6-febe-4394-8fd2-a4b83640cef6): created successfully Sep 18 21:40:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9e601744-de13-477f-9907-1c80b26a33fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0503e031-df5f-439b-86e0-b551479ed1a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:40:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9e601744-de13-477f-9907-1c80b26a33fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] Flow 'volume_create_manager' (8cb7dd66-3a0d-46d1-b920-63ade8784416) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:40:52 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-9e601744-de13-477f-9907-1c80b26a33fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] Created volume successfully. Sep 18 21:40:52 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-0a5d98b9-18b5-45d0-86f1-371ecebeb436 req-3847c547-702c-42f6-9bad-e0295d95aa02 tempest-TestServerVolumeAttachScenarioOldVersion-516887614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:40:52 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-0a5d98b9-18b5-45d0-86f1-371ecebeb436 req-3847c547-702c-42f6-9bad-e0295d95aa02 tempest-TestServerVolumeAttachScenarioOldVersion-516887614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:40:52 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-0a5d98b9-18b5-45d0-86f1-371ecebeb436 req-3847c547-702c-42f6-9bad-e0295d95aa02 tempest-TestServerVolumeAttachScenarioOldVersion-516887614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:40:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [req-0a5d98b9-18b5-45d0-86f1-371ecebeb436 req-3847c547-702c-42f6-9bad-e0295d95aa02 tempest-TestServerVolumeAttachScenarioOldVersion-516887614 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff', 'name': 'volume-28647997-d572-4421-8450-e0ec43829147', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bd5b2554-23bd-4f0b-ad16-6d409a65c1b1', 'enforce_multipath': True} {{(pid=86136) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 18 21:40:52 devstack cinder-volume[86136]: INFO cinder.volume.manager [req-0a5d98b9-18b5-45d0-86f1-371ecebeb436 req-3847c547-702c-42f6-9bad-e0295d95aa02 tempest-TestServerVolumeAttachScenarioOldVersion-516887614 None] attachment_update completed successfully. Sep 18 21:40:53 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6391e56e-9a07-4b7c-a6d0-6179f48ac227 tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:40:53 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6391e56e-9a07-4b7c-a6d0-6179f48ac227 tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:40:53 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-6391e56e-9a07-4b7c-a6d0-6179f48ac227 tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] Creating offline snapshot 588afc4b-3383-440f-b75f-d9ae314eef3f of volume e1fef3c6-febe-4394-8fd2-a4b83640cef6 {{(pid=86136) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 21:40:53 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[af32b0b9-8aea-4b43-8724-50b487239155]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:40:53 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6391e56e-9a07-4b7c-a6d0-6179f48ac227 tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e1fef3c6-febe-4394-8fd2-a4b83640cef6 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:40:53 devstack sudo[95723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e1fef3c6-febe-4394-8fd2-a4b83640cef6 Sep 18 21:40:53 devstack sudo[95723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:40:53 devstack sudo[95723]: pam_unix(sudo:session): session closed for user root Sep 18 21:40:53 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6391e56e-9a07-4b7c-a6d0-6179f48ac227 tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e1fef3c6-febe-4394-8fd2-a4b83640cef6" returned: 0 in 0.432s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:40:53 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6391e56e-9a07-4b7c-a6d0-6179f48ac227 tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e1fef3c6-febe-4394-8fd2-a4b83640cef6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e1fef3c6-febe-4394-8fd2-a4b83640cef6.588afc4b-3383-440f-b75f-d9ae314eef3f 1G {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:40:53 devstack sudo[95728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e1fef3c6-febe-4394-8fd2-a4b83640cef6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e1fef3c6-febe-4394-8fd2-a4b83640cef6.588afc4b-3383-440f-b75f-d9ae314eef3f 1G Sep 18 21:40:53 devstack sudo[95728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:40:54 devstack sudo[95728]: pam_unix(sudo:session): session closed for user root Sep 18 21:40:54 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6391e56e-9a07-4b7c-a6d0-6179f48ac227 tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e1fef3c6-febe-4394-8fd2-a4b83640cef6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e1fef3c6-febe-4394-8fd2-a4b83640cef6.588afc4b-3383-440f-b75f-d9ae314eef3f 1G" returned: 0 in 0.471s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:40:54 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6391e56e-9a07-4b7c-a6d0-6179f48ac227 tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1fef3c6-febe-4394-8fd2-a4b83640cef6 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e1fef3c6-febe-4394-8fd2-a4b83640cef6.588afc4b-3383-440f-b75f-d9ae314eef3f {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:40:54 devstack sudo[95733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1fef3c6-febe-4394-8fd2-a4b83640cef6 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e1fef3c6-febe-4394-8fd2-a4b83640cef6.588afc4b-3383-440f-b75f-d9ae314eef3f Sep 18 21:40:54 devstack sudo[95733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:40:54 devstack sudo[95733]: pam_unix(sudo:session): session closed for user root Sep 18 21:40:54 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6391e56e-9a07-4b7c-a6d0-6179f48ac227 tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1fef3c6-febe-4394-8fd2-a4b83640cef6 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e1fef3c6-febe-4394-8fd2-a4b83640cef6.588afc4b-3383-440f-b75f-d9ae314eef3f" returned: 0 in 0.423s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:40:54 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-6391e56e-9a07-4b7c-a6d0-6179f48ac227 tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e1fef3c6-febe-4394-8fd2-a4b83640cef6.588afc4b-3383-440f-b75f-d9ae314eef3f is being set with open permissions: ugo+rw Sep 18 21:40:54 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6391e56e-9a07-4b7c-a6d0-6179f48ac227 tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e1fef3c6-febe-4394-8fd2-a4b83640cef6.588afc4b-3383-440f-b75f-d9ae314eef3f {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:40:54 devstack sudo[95763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e1fef3c6-febe-4394-8fd2-a4b83640cef6.588afc4b-3383-440f-b75f-d9ae314eef3f Sep 18 21:40:54 devstack sudo[95763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:40:54 devstack sudo[95763]: pam_unix(sudo:session): session closed for user root Sep 18 21:40:54 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6391e56e-9a07-4b7c-a6d0-6179f48ac227 tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e1fef3c6-febe-4394-8fd2-a4b83640cef6.588afc4b-3383-440f-b75f-d9ae314eef3f" returned: 0 in 0.340s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:40:54 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6391e56e-9a07-4b7c-a6d0-6179f48ac227 tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e1fef3c6-febe-4394-8fd2-a4b83640cef6.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:40:54 devstack sudo[95766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e1fef3c6-febe-4394-8fd2-a4b83640cef6.info Sep 18 21:40:54 devstack sudo[95766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:40:55 devstack sudo[95766]: pam_unix(sudo:session): session closed for user root Sep 18 21:40:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6391e56e-9a07-4b7c-a6d0-6179f48ac227 tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e1fef3c6-febe-4394-8fd2-a4b83640cef6.info" returned: 0 in 0.330s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:40:55 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-6391e56e-9a07-4b7c-a6d0-6179f48ac227 tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e1fef3c6-febe-4394-8fd2-a4b83640cef6.info is being set with open permissions: ugo+rw Sep 18 21:40:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6391e56e-9a07-4b7c-a6d0-6179f48ac227 tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e1fef3c6-febe-4394-8fd2-a4b83640cef6.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:40:55 devstack sudo[95769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e1fef3c6-febe-4394-8fd2-a4b83640cef6.info Sep 18 21:40:55 devstack sudo[95769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:40:55 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-7da828f9-f69e-4768-a378-1274c779df23 tempest-SnapshotMetadataTestJSON-722146611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:40:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-7da828f9-f69e-4768-a378-1274c779df23 tempest-SnapshotMetadataTestJSON-722146611 None] Flow 'volume_create_manager' (320068dd-594d-4394-bf7b-06d5f5372e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:40:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-7da828f9-f69e-4768-a378-1274c779df23 tempest-SnapshotMetadataTestJSON-722146611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59a7b9b7-c9ba-4911-968b-016e8efc719b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:40:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-7da828f9-f69e-4768-a378-1274c779df23 tempest-SnapshotMetadataTestJSON-722146611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59a7b9b7-c9ba-4911-968b-016e8efc719b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:40:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-345505224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7d9dc0a-9332-4ba8-b87b-58305d712146,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7aa60adf1b73480493ab42a22e1cb2f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:40:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:40:55Z,use_quota=True,user_id='3ce9fc4ee1f744dfbf0e955f8667c756',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:40:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-7da828f9-f69e-4768-a378-1274c779df23 tempest-SnapshotMetadataTestJSON-722146611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2fb0bf2-084c-4afd-ab1f-4018a43d1520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:40:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-7da828f9-f69e-4768-a378-1274c779df23 tempest-SnapshotMetadataTestJSON-722146611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2fb0bf2-084c-4afd-ab1f-4018a43d1520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:40:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-7da828f9-f69e-4768-a378-1274c779df23 tempest-SnapshotMetadataTestJSON-722146611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f78f26e-803e-47af-9e34-c25e020f50d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:40:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-7da828f9-f69e-4768-a378-1274c779df23 tempest-SnapshotMetadataTestJSON-722146611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f78f26e-803e-47af-9e34-c25e020f50d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7d9dc0a-9332-4ba8-b87b-58305d712146', 'volume_name': 'volume-b7d9dc0a-9332-4ba8-b87b-58305d712146', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:40:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-7da828f9-f69e-4768-a378-1274c779df23 tempest-SnapshotMetadataTestJSON-722146611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cfbcefe-3b59-497f-9828-e1ea250099ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:40:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-7da828f9-f69e-4768-a378-1274c779df23 tempest-SnapshotMetadataTestJSON-722146611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cfbcefe-3b59-497f-9828-e1ea250099ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:40:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-7da828f9-f69e-4768-a378-1274c779df23 tempest-SnapshotMetadataTestJSON-722146611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d5dddfe-f86a-4377-b537-52c8cb8b6f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:40:55 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-7da828f9-f69e-4768-a378-1274c779df23 tempest-SnapshotMetadataTestJSON-722146611 None] Volume b7d9dc0a-9332-4ba8-b87b-58305d712146: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7d9dc0a-9332-4ba8-b87b-58305d712146', 'volume_size': 1} Sep 18 21:40:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-7da828f9-f69e-4768-a378-1274c779df23 tempest-SnapshotMetadataTestJSON-722146611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:40:55 devstack sudo[95769]: pam_unix(sudo:session): session closed for user root Sep 18 21:40:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6391e56e-9a07-4b7c-a6d0-6179f48ac227 tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e1fef3c6-febe-4394-8fd2-a4b83640cef6.info" returned: 0 in 0.326s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:40:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6391e56e-9a07-4b7c-a6d0-6179f48ac227 tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.442s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:40:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-7da828f9-f69e-4768-a378-1274c779df23 tempest-SnapshotMetadataTestJSON-722146611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.191s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:40:55 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-7da828f9-f69e-4768-a378-1274c779df23 tempest-SnapshotMetadataTestJSON-722146611 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:40:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-345505224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7d9dc0a-9332-4ba8-b87b-58305d712146,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7aa60adf1b73480493ab42a22e1cb2f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:40:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:40:55Z,use_quota=True,user_id='3ce9fc4ee1f744dfbf0e955f8667c756',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:40:55 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-7da828f9-f69e-4768-a378-1274c779df23 tempest-SnapshotMetadataTestJSON-722146611 None] Creating volume b7d9dc0a-9332-4ba8-b87b-58305d712146 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:40:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-7da828f9-f69e-4768-a378-1274c779df23 tempest-SnapshotMetadataTestJSON-722146611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:40:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-7da828f9-f69e-4768-a378-1274c779df23 tempest-SnapshotMetadataTestJSON-722146611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:40:55 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-7da828f9-f69e-4768-a378-1274c779df23 tempest-SnapshotMetadataTestJSON-722146611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:40:55 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-7da828f9-f69e-4768-a378-1274c779df23 tempest-SnapshotMetadataTestJSON-722146611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:40:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-7da828f9-f69e-4768-a378-1274c779df23 tempest-SnapshotMetadataTestJSON-722146611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:40:55 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-7da828f9-f69e-4768-a378-1274c779df23 tempest-SnapshotMetadataTestJSON-722146611 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:40:55 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-7da828f9-f69e-4768-a378-1274c779df23 tempest-SnapshotMetadataTestJSON-722146611 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:40:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-7da828f9-f69e-4768-a378-1274c779df23 tempest-SnapshotMetadataTestJSON-722146611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7d9dc0a-9332-4ba8-b87b-58305d712146 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:40:55 devstack sudo[95772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7d9dc0a-9332-4ba8-b87b-58305d712146 1073741824 Sep 18 21:40:55 devstack sudo[95772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:40:55 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-6391e56e-9a07-4b7c-a6d0-6179f48ac227 tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] Create snapshot completed successfully Sep 18 21:40:56 devstack sudo[95772]: pam_unix(sudo:session): session closed for user root Sep 18 21:40:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-7da828f9-f69e-4768-a378-1274c779df23 tempest-SnapshotMetadataTestJSON-722146611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7d9dc0a-9332-4ba8-b87b-58305d712146 1073741824" returned: 0 in 0.595s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:40:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-7da828f9-f69e-4768-a378-1274c779df23 tempest-SnapshotMetadataTestJSON-722146611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7d9dc0a-9332-4ba8-b87b-58305d712146 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:40:56 devstack sudo[95780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7d9dc0a-9332-4ba8-b87b-58305d712146 Sep 18 21:40:56 devstack sudo[95780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:40:56 devstack cinder-volume[86136]: INFO cinder.volume.manager [req-f37d7802-148f-4187-a542-a08f4f13ac69 req-ff26249e-0d67-4db0-b69a-05805a265c7a tempest-TestServerVolumeAttachScenarioOldVersion-516887614 None] Terminate volume connection completed successfully. Sep 18 21:40:56 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [req-f37d7802-148f-4187-a542-a08f4f13ac69 req-ff26249e-0d67-4db0-b69a-05805a265c7a tempest-TestServerVolumeAttachScenarioOldVersion-516887614 None] Deleting attachment bd5b2554-23bd-4f0b-ad16-6d409a65c1b1. {{(pid=86136) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 18 21:40:56 devstack sudo[95780]: pam_unix(sudo:session): session closed for user root Sep 18 21:40:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-7da828f9-f69e-4768-a378-1274c779df23 tempest-SnapshotMetadataTestJSON-722146611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7d9dc0a-9332-4ba8-b87b-58305d712146" returned: 0 in 0.387s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:40:56 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-7da828f9-f69e-4768-a378-1274c779df23 tempest-SnapshotMetadataTestJSON-722146611 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:40:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-7da828f9-f69e-4768-a378-1274c779df23 tempest-SnapshotMetadataTestJSON-722146611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:40:56 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-7da828f9-f69e-4768-a378-1274c779df23 tempest-SnapshotMetadataTestJSON-722146611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d5dddfe-f86a-4377-b537-52c8cb8b6f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7d9dc0a-9332-4ba8-b87b-58305d712146', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:40:56 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-7da828f9-f69e-4768-a378-1274c779df23 tempest-SnapshotMetadataTestJSON-722146611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f29204c-3cc8-4cb4-9405-fa82c4351140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:40:56 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-7da828f9-f69e-4768-a378-1274c779df23 tempest-SnapshotMetadataTestJSON-722146611 None] Volume volume-b7d9dc0a-9332-4ba8-b87b-58305d712146 (b7d9dc0a-9332-4ba8-b87b-58305d712146): created successfully Sep 18 21:40:56 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-7da828f9-f69e-4768-a378-1274c779df23 tempest-SnapshotMetadataTestJSON-722146611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f29204c-3cc8-4cb4-9405-fa82c4351140) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:40:56 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-7da828f9-f69e-4768-a378-1274c779df23 tempest-SnapshotMetadataTestJSON-722146611 None] Flow 'volume_create_manager' (320068dd-594d-4394-bf7b-06d5f5372e2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:40:56 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-7da828f9-f69e-4768-a378-1274c779df23 tempest-SnapshotMetadataTestJSON-722146611 None] Created volume successfully. Sep 18 21:40:57 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-39dc0f1c-49c7-4309-b3da-bc56f685db9b tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] Acquiring lock "cinder-588afc4b-3383-440f-b75f-d9ae314eef3f-delete_snapshot" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:40:57 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-39dc0f1c-49c7-4309-b3da-bc56f685db9b tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] Lock "cinder-588afc4b-3383-440f-b75f-d9ae314eef3f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:40:57 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-39dc0f1c-49c7-4309-b3da-bc56f685db9b tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] Acquiring lock "cinder-quobyte-e1fef3c6-febe-4394-8fd2-a4b83640cef6" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:40:57 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-39dc0f1c-49c7-4309-b3da-bc56f685db9b tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] Lock "cinder-quobyte-e1fef3c6-febe-4394-8fd2-a4b83640cef6" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:40:57 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-39dc0f1c-49c7-4309-b3da-bc56f685db9b tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] Acquiring lock "cinder-quobyte-588afc4b-3383-440f-b75f-d9ae314eef3f" by "_delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:40:57 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-39dc0f1c-49c7-4309-b3da-bc56f685db9b tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] Lock "cinder-quobyte-588afc4b-3383-440f-b75f-d9ae314eef3f" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:40:57 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-39dc0f1c-49c7-4309-b3da-bc56f685db9b tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] Deleting offline snapshot 588afc4b-3383-440f-b75f-d9ae314eef3f of volume e1fef3c6-febe-4394-8fd2-a4b83640cef6 {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 21:40:57 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-39dc0f1c-49c7-4309-b3da-bc56f685db9b tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] snapshot_file for this snap is: volume-e1fef3c6-febe-4394-8fd2-a4b83640cef6.588afc4b-3383-440f-b75f-d9ae314eef3f {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 21:40:57 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7296aea-7036-4422-b334-64996e4998e6]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:40:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-39dc0f1c-49c7-4309-b3da-bc56f685db9b tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e1fef3c6-febe-4394-8fd2-a4b83640cef6.588afc4b-3383-440f-b75f-d9ae314eef3f {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:40:57 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-9eb44a46-dc27-4989-8afa-eae8c241e3b2 tempest-TestServerVolumeAttachScenarioOldVersion-516887614 None] Acquiring lock "cinder-28647997-d572-4421-8450-e0ec43829147-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:40:57 devstack sudo[95795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e1fef3c6-febe-4394-8fd2-a4b83640cef6.588afc4b-3383-440f-b75f-d9ae314eef3f Sep 18 21:40:57 devstack sudo[95795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:40:57 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-9eb44a46-dc27-4989-8afa-eae8c241e3b2 tempest-TestServerVolumeAttachScenarioOldVersion-516887614 None] Lock "cinder-28647997-d572-4421-8450-e0ec43829147-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:40:57 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-9eb44a46-dc27-4989-8afa-eae8c241e3b2 tempest-TestServerVolumeAttachScenarioOldVersion-516887614 None] Acquiring lock "cinder-quobyte-28647997-d572-4421-8450-e0ec43829147" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:40:57 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-9eb44a46-dc27-4989-8afa-eae8c241e3b2 tempest-TestServerVolumeAttachScenarioOldVersion-516887614 None] Lock "cinder-quobyte-28647997-d572-4421-8450-e0ec43829147" acquired by "delete_volume" :: waited 0.028s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:40:57 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f3b3a6-b5c0-4543-9f23-ac8a4f677dc4]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:40:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9eb44a46-dc27-4989-8afa-eae8c241e3b2 tempest-TestServerVolumeAttachScenarioOldVersion-516887614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-28647997-d572-4421-8450-e0ec43829147 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:40:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-310ff1ea-0e2b-4934-82ce-64e2b92e4134 tempest-SnapshotMetadataTestJSON-722146611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:40:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-310ff1ea-0e2b-4934-82ce-64e2b92e4134 tempest-SnapshotMetadataTestJSON-722146611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:40:57 devstack sudo[95795]: pam_unix(sudo:session): session closed for user root Sep 18 21:40:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-39dc0f1c-49c7-4309-b3da-bc56f685db9b tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e1fef3c6-febe-4394-8fd2-a4b83640cef6.588afc4b-3383-440f-b75f-d9ae314eef3f" returned: 0 in 0.519s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:40:57 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-310ff1ea-0e2b-4934-82ce-64e2b92e4134 tempest-SnapshotMetadataTestJSON-722146611 None] Creating offline snapshot 55d66500-489c-4d85-9668-a35b029d563d of volume b7d9dc0a-9332-4ba8-b87b-58305d712146 {{(pid=86136) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 21:40:57 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-39dc0f1c-49c7-4309-b3da-bc56f685db9b tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1fef3c6-febe-4394-8fd2-a4b83640cef6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86136) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 21:40:57 devstack sudo[95802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-28647997-d572-4421-8450-e0ec43829147 Sep 18 21:40:57 devstack sudo[95802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:40:57 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d3ede62-2318-4efa-b101-a5b2b7ca8e2f]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:40:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-310ff1ea-0e2b-4934-82ce-64e2b92e4134 tempest-SnapshotMetadataTestJSON-722146611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7d9dc0a-9332-4ba8-b87b-58305d712146 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:40:57 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b485b9-96a5-40e1-ad5b-46141902a000]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:40:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-39dc0f1c-49c7-4309-b3da-bc56f685db9b tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e1fef3c6-febe-4394-8fd2-a4b83640cef6 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:40:57 devstack sudo[95809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7d9dc0a-9332-4ba8-b87b-58305d712146 Sep 18 21:40:57 devstack sudo[95809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:40:57 devstack sudo[95810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e1fef3c6-febe-4394-8fd2-a4b83640cef6 Sep 18 21:40:57 devstack sudo[95810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:40:58 devstack sudo[95802]: pam_unix(sudo:session): session closed for user root Sep 18 21:40:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9eb44a46-dc27-4989-8afa-eae8c241e3b2 tempest-TestServerVolumeAttachScenarioOldVersion-516887614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-28647997-d572-4421-8450-e0ec43829147" returned: 0 in 0.634s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:40:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9eb44a46-dc27-4989-8afa-eae8c241e3b2 tempest-TestServerVolumeAttachScenarioOldVersion-516887614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-28647997-d572-4421-8450-e0ec43829147 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:40:58 devstack sudo[95822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-28647997-d572-4421-8450-e0ec43829147 Sep 18 21:40:58 devstack sudo[95822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:40:58 devstack sudo[95809]: pam_unix(sudo:session): session closed for user root Sep 18 21:40:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-310ff1ea-0e2b-4934-82ce-64e2b92e4134 tempest-SnapshotMetadataTestJSON-722146611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7d9dc0a-9332-4ba8-b87b-58305d712146" returned: 0 in 0.564s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:40:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-310ff1ea-0e2b-4934-82ce-64e2b92e4134 tempest-SnapshotMetadataTestJSON-722146611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7d9dc0a-9332-4ba8-b87b-58305d712146,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7d9dc0a-9332-4ba8-b87b-58305d712146.55d66500-489c-4d85-9668-a35b029d563d 1G {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:40:58 devstack sudo[95829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7d9dc0a-9332-4ba8-b87b-58305d712146,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7d9dc0a-9332-4ba8-b87b-58305d712146.55d66500-489c-4d85-9668-a35b029d563d 1G Sep 18 21:40:58 devstack sudo[95829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:40:58 devstack sudo[95810]: pam_unix(sudo:session): session closed for user root Sep 18 21:40:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-39dc0f1c-49c7-4309-b3da-bc56f685db9b tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e1fef3c6-febe-4394-8fd2-a4b83640cef6" returned: 0 in 0.611s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:40:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-39dc0f1c-49c7-4309-b3da-bc56f685db9b tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e1fef3c6-febe-4394-8fd2-a4b83640cef6.588afc4b-3383-440f-b75f-d9ae314eef3f {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:40:58 devstack sudo[95831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e1fef3c6-febe-4394-8fd2-a4b83640cef6.588afc4b-3383-440f-b75f-d9ae314eef3f Sep 18 21:40:58 devstack sudo[95831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:40:58 devstack sudo[95822]: pam_unix(sudo:session): session closed for user root Sep 18 21:40:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9eb44a46-dc27-4989-8afa-eae8c241e3b2 tempest-TestServerVolumeAttachScenarioOldVersion-516887614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-28647997-d572-4421-8450-e0ec43829147" returned: 0 in 0.424s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:40:58 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-9eb44a46-dc27-4989-8afa-eae8c241e3b2 tempest-TestServerVolumeAttachScenarioOldVersion-516887614 None] Lock "cinder-quobyte-28647997-d572-4421-8450-e0ec43829147" released by "delete_volume" :: held 1.166s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:40:58 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-9eb44a46-dc27-4989-8afa-eae8c241e3b2 tempest-TestServerVolumeAttachScenarioOldVersion-516887614 None] Created reservations ['e175ddb0-8bd8-450f-96ef-451e6c331095', 'fdc75450-0543-4662-82e3-587d8cb91f5e', '72084d76-fe3a-40ec-8003-14a766a60c01', 'b6aaa7c5-b32d-4928-b955-823eba5e6430'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:40:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-9eb44a46-dc27-4989-8afa-eae8c241e3b2 tempest-TestServerVolumeAttachScenarioOldVersion-516887614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:40:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-9eb44a46-dc27-4989-8afa-eae8c241e3b2 tempest-TestServerVolumeAttachScenarioOldVersion-516887614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:40:58 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-9eb44a46-dc27-4989-8afa-eae8c241e3b2 tempest-TestServerVolumeAttachScenarioOldVersion-516887614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:40:58 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-9eb44a46-dc27-4989-8afa-eae8c241e3b2 tempest-TestServerVolumeAttachScenarioOldVersion-516887614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:40:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-9eb44a46-dc27-4989-8afa-eae8c241e3b2 tempest-TestServerVolumeAttachScenarioOldVersion-516887614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:40:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9eb44a46-dc27-4989-8afa-eae8c241e3b2 tempest-TestServerVolumeAttachScenarioOldVersion-516887614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:40:58 devstack sudo[95841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:40:58 devstack sudo[95841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:40:58 devstack sudo[95831]: pam_unix(sudo:session): session closed for user root Sep 18 21:40:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-39dc0f1c-49c7-4309-b3da-bc56f685db9b tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e1fef3c6-febe-4394-8fd2-a4b83640cef6.588afc4b-3383-440f-b75f-d9ae314eef3f" returned: 0 in 0.466s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:40:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-39dc0f1c-49c7-4309-b3da-bc56f685db9b tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e1fef3c6-febe-4394-8fd2-a4b83640cef6.588afc4b-3383-440f-b75f-d9ae314eef3f {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:40:58 devstack sudo[95843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e1fef3c6-febe-4394-8fd2-a4b83640cef6.588afc4b-3383-440f-b75f-d9ae314eef3f Sep 18 21:40:58 devstack sudo[95843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:40:58 devstack sudo[95829]: pam_unix(sudo:session): session closed for user root Sep 18 21:40:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-310ff1ea-0e2b-4934-82ce-64e2b92e4134 tempest-SnapshotMetadataTestJSON-722146611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7d9dc0a-9332-4ba8-b87b-58305d712146,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7d9dc0a-9332-4ba8-b87b-58305d712146.55d66500-489c-4d85-9668-a35b029d563d 1G" returned: 0 in 0.609s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:40:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-310ff1ea-0e2b-4934-82ce-64e2b92e4134 tempest-SnapshotMetadataTestJSON-722146611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7d9dc0a-9332-4ba8-b87b-58305d712146 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7d9dc0a-9332-4ba8-b87b-58305d712146.55d66500-489c-4d85-9668-a35b029d563d {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:40:58 devstack sudo[95845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7d9dc0a-9332-4ba8-b87b-58305d712146 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7d9dc0a-9332-4ba8-b87b-58305d712146.55d66500-489c-4d85-9668-a35b029d563d Sep 18 21:40:58 devstack sudo[95845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:40:59 devstack sudo[95841]: pam_unix(sudo:session): session closed for user root Sep 18 21:40:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9eb44a46-dc27-4989-8afa-eae8c241e3b2 tempest-TestServerVolumeAttachScenarioOldVersion-516887614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.358s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:40:59 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-9eb44a46-dc27-4989-8afa-eae8c241e3b2 tempest-TestServerVolumeAttachScenarioOldVersion-516887614 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:40:59 devstack sudo[95843]: pam_unix(sudo:session): session closed for user root Sep 18 21:40:59 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-9eb44a46-dc27-4989-8afa-eae8c241e3b2 tempest-TestServerVolumeAttachScenarioOldVersion-516887614 None] Deleted volume successfully. Sep 18 21:40:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-39dc0f1c-49c7-4309-b3da-bc56f685db9b tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e1fef3c6-febe-4394-8fd2-a4b83640cef6.588afc4b-3383-440f-b75f-d9ae314eef3f" returned: 0 in 0.325s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:40:59 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-39dc0f1c-49c7-4309-b3da-bc56f685db9b tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] Lock "cinder-quobyte-588afc4b-3383-440f-b75f-d9ae314eef3f" released by "_delete_snapshot" :: held 2.126s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:40:59 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-9eb44a46-dc27-4989-8afa-eae8c241e3b2 tempest-TestServerVolumeAttachScenarioOldVersion-516887614 None] Lock "cinder-28647997-d572-4421-8450-e0ec43829147-delete_volume" released by "delete_volume" :: held 1.928s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:40:59 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-39dc0f1c-49c7-4309-b3da-bc56f685db9b tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] Lock "cinder-quobyte-e1fef3c6-febe-4394-8fd2-a4b83640cef6" released by "delete_snapshot" :: held 2.158s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:40:59 devstack sudo[95845]: pam_unix(sudo:session): session closed for user root Sep 18 21:40:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-310ff1ea-0e2b-4934-82ce-64e2b92e4134 tempest-SnapshotMetadataTestJSON-722146611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7d9dc0a-9332-4ba8-b87b-58305d712146 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7d9dc0a-9332-4ba8-b87b-58305d712146.55d66500-489c-4d85-9668-a35b029d563d" returned: 0 in 0.374s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:40:59 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-310ff1ea-0e2b-4934-82ce-64e2b92e4134 tempest-SnapshotMetadataTestJSON-722146611 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7d9dc0a-9332-4ba8-b87b-58305d712146.55d66500-489c-4d85-9668-a35b029d563d is being set with open permissions: ugo+rw Sep 18 21:40:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-310ff1ea-0e2b-4934-82ce-64e2b92e4134 tempest-SnapshotMetadataTestJSON-722146611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7d9dc0a-9332-4ba8-b87b-58305d712146.55d66500-489c-4d85-9668-a35b029d563d {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:40:59 devstack sudo[95852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7d9dc0a-9332-4ba8-b87b-58305d712146.55d66500-489c-4d85-9668-a35b029d563d Sep 18 21:40:59 devstack sudo[95852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:40:59 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-39dc0f1c-49c7-4309-b3da-bc56f685db9b tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] Created reservations ['2bf72c4e-d8e6-4421-a8ca-983fb16a69a9', 'ace78d06-9162-4eed-b26d-47d74045adba', '1f037f30-5495-4346-ac5d-472495495c1e', 'c646e0d9-2392-40ff-a54c-f06750676a12'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:40:59 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-39dc0f1c-49c7-4309-b3da-bc56f685db9b tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] Delete snapshot completed successfully. Sep 18 21:40:59 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-39dc0f1c-49c7-4309-b3da-bc56f685db9b tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] Lock "cinder-588afc4b-3383-440f-b75f-d9ae314eef3f-delete_snapshot" released by "delete_snapshot" :: held 2.362s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:40:59 devstack sudo[95852]: pam_unix(sudo:session): session closed for user root Sep 18 21:40:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-310ff1ea-0e2b-4934-82ce-64e2b92e4134 tempest-SnapshotMetadataTestJSON-722146611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7d9dc0a-9332-4ba8-b87b-58305d712146.55d66500-489c-4d85-9668-a35b029d563d" returned: 0 in 0.307s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:40:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-310ff1ea-0e2b-4934-82ce-64e2b92e4134 tempest-SnapshotMetadataTestJSON-722146611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7d9dc0a-9332-4ba8-b87b-58305d712146.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:40:59 devstack sudo[95871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7d9dc0a-9332-4ba8-b87b-58305d712146.info Sep 18 21:40:59 devstack sudo[95871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:40:59 devstack sudo[95871]: pam_unix(sudo:session): session closed for user root Sep 18 21:40:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-310ff1ea-0e2b-4934-82ce-64e2b92e4134 tempest-SnapshotMetadataTestJSON-722146611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7d9dc0a-9332-4ba8-b87b-58305d712146.info" returned: 0 in 0.328s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:40:59 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-310ff1ea-0e2b-4934-82ce-64e2b92e4134 tempest-SnapshotMetadataTestJSON-722146611 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7d9dc0a-9332-4ba8-b87b-58305d712146.info is being set with open permissions: ugo+rw Sep 18 21:40:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-310ff1ea-0e2b-4934-82ce-64e2b92e4134 tempest-SnapshotMetadataTestJSON-722146611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7d9dc0a-9332-4ba8-b87b-58305d712146.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:41:00 devstack sudo[95875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7d9dc0a-9332-4ba8-b87b-58305d712146.info Sep 18 21:41:00 devstack sudo[95875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:41:00 devstack sudo[95875]: pam_unix(sudo:session): session closed for user root Sep 18 21:41:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-310ff1ea-0e2b-4934-82ce-64e2b92e4134 tempest-SnapshotMetadataTestJSON-722146611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7d9dc0a-9332-4ba8-b87b-58305d712146.info" returned: 0 in 0.357s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:41:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-310ff1ea-0e2b-4934-82ce-64e2b92e4134 tempest-SnapshotMetadataTestJSON-722146611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.683s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:41:00 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-310ff1ea-0e2b-4934-82ce-64e2b92e4134 tempest-SnapshotMetadataTestJSON-722146611 None] Create snapshot completed successfully Sep 18 21:41:00 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-cfc14574-0b0e-4603-b781-7a122f4b301f tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] Acquiring lock "cinder-e1fef3c6-febe-4394-8fd2-a4b83640cef6-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:41:00 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-cfc14574-0b0e-4603-b781-7a122f4b301f tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] Lock "cinder-e1fef3c6-febe-4394-8fd2-a4b83640cef6-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:41:00 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-cfc14574-0b0e-4603-b781-7a122f4b301f tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] Acquiring lock "cinder-quobyte-e1fef3c6-febe-4394-8fd2-a4b83640cef6" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:41:00 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-cfc14574-0b0e-4603-b781-7a122f4b301f tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] Lock "cinder-quobyte-e1fef3c6-febe-4394-8fd2-a4b83640cef6" acquired by "delete_volume" :: waited 0.030s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:41:00 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[6961d281-6998-4c30-898e-6c95626de4ef]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:41:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-cfc14574-0b0e-4603-b781-7a122f4b301f tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e1fef3c6-febe-4394-8fd2-a4b83640cef6 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:41:00 devstack sudo[95899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e1fef3c6-febe-4394-8fd2-a4b83640cef6 Sep 18 21:41:00 devstack sudo[95899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:41:01 devstack sudo[95899]: pam_unix(sudo:session): session closed for user root Sep 18 21:41:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-cfc14574-0b0e-4603-b781-7a122f4b301f tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e1fef3c6-febe-4394-8fd2-a4b83640cef6" returned: 0 in 0.413s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:41:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-cfc14574-0b0e-4603-b781-7a122f4b301f tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e1fef3c6-febe-4394-8fd2-a4b83640cef6 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:41:01 devstack sudo[95904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e1fef3c6-febe-4394-8fd2-a4b83640cef6 Sep 18 21:41:01 devstack sudo[95904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:41:01 devstack sudo[95904]: pam_unix(sudo:session): session closed for user root Sep 18 21:41:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-cfc14574-0b0e-4603-b781-7a122f4b301f tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e1fef3c6-febe-4394-8fd2-a4b83640cef6" returned: 0 in 0.323s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:41:01 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-cfc14574-0b0e-4603-b781-7a122f4b301f tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] Lock "cinder-quobyte-e1fef3c6-febe-4394-8fd2-a4b83640cef6" released by "delete_volume" :: held 0.816s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:41:01 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-cfc14574-0b0e-4603-b781-7a122f4b301f tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] Created reservations ['95432bc0-b73a-46fa-9806-e1b2b7617346', 'cced24c8-39e4-4756-ba59-78aec21b2622', '60a5c801-24b5-4de7-ab36-b6eaed193251', 'ba8d31f1-51e4-4e44-a314-04013c94f20e'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:41:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-cfc14574-0b0e-4603-b781-7a122f4b301f tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:41:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-cfc14574-0b0e-4603-b781-7a122f4b301f tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:41:01 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-cfc14574-0b0e-4603-b781-7a122f4b301f tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:41:01 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-cfc14574-0b0e-4603-b781-7a122f4b301f tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:41:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-cfc14574-0b0e-4603-b781-7a122f4b301f tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:41:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-cfc14574-0b0e-4603-b781-7a122f4b301f tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:41:01 devstack sudo[95909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:41:01 devstack sudo[95909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:41:01 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-99bf898d-ceba-462d-b5b4-c86a6d5724b4 tempest-SnapshotMetadataTestJSON-722146611 None] Acquiring lock "cinder-55d66500-489c-4d85-9668-a35b029d563d-delete_snapshot" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:41:01 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-99bf898d-ceba-462d-b5b4-c86a6d5724b4 tempest-SnapshotMetadataTestJSON-722146611 None] Lock "cinder-55d66500-489c-4d85-9668-a35b029d563d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:41:01 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-99bf898d-ceba-462d-b5b4-c86a6d5724b4 tempest-SnapshotMetadataTestJSON-722146611 None] Acquiring lock "cinder-quobyte-b7d9dc0a-9332-4ba8-b87b-58305d712146" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:41:01 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-99bf898d-ceba-462d-b5b4-c86a6d5724b4 tempest-SnapshotMetadataTestJSON-722146611 None] Lock "cinder-quobyte-b7d9dc0a-9332-4ba8-b87b-58305d712146" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:41:01 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-99bf898d-ceba-462d-b5b4-c86a6d5724b4 tempest-SnapshotMetadataTestJSON-722146611 None] Acquiring lock "cinder-quobyte-55d66500-489c-4d85-9668-a35b029d563d" by "_delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:41:01 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-99bf898d-ceba-462d-b5b4-c86a6d5724b4 tempest-SnapshotMetadataTestJSON-722146611 None] Lock "cinder-quobyte-55d66500-489c-4d85-9668-a35b029d563d" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:41:01 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-99bf898d-ceba-462d-b5b4-c86a6d5724b4 tempest-SnapshotMetadataTestJSON-722146611 None] Deleting offline snapshot 55d66500-489c-4d85-9668-a35b029d563d of volume b7d9dc0a-9332-4ba8-b87b-58305d712146 {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 21:41:01 devstack sudo[95909]: pam_unix(sudo:session): session closed for user root Sep 18 21:41:02 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-99bf898d-ceba-462d-b5b4-c86a6d5724b4 tempest-SnapshotMetadataTestJSON-722146611 None] snapshot_file for this snap is: volume-b7d9dc0a-9332-4ba8-b87b-58305d712146.55d66500-489c-4d85-9668-a35b029d563d {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 21:41:02 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-cfc14574-0b0e-4603-b781-7a122f4b301f tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.421s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:41:02 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-cfc14574-0b0e-4603-b781-7a122f4b301f tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:41:02 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-cfc14574-0b0e-4603-b781-7a122f4b301f tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] Deleted volume successfully. Sep 18 21:41:02 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee0c46e-5cd6-42d3-99ea-3f0f2bd4846a]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:41:02 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-99bf898d-ceba-462d-b5b4-c86a6d5724b4 tempest-SnapshotMetadataTestJSON-722146611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7d9dc0a-9332-4ba8-b87b-58305d712146.55d66500-489c-4d85-9668-a35b029d563d {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:41:02 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-cfc14574-0b0e-4603-b781-7a122f4b301f tempest-VolumeSnapshotQuotasNegativeTestJSON-1802231644 None] Lock "cinder-e1fef3c6-febe-4394-8fd2-a4b83640cef6-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:41:02 devstack sudo[95913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7d9dc0a-9332-4ba8-b87b-58305d712146.55d66500-489c-4d85-9668-a35b029d563d Sep 18 21:41:02 devstack sudo[95913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:41:02 devstack sudo[95913]: pam_unix(sudo:session): session closed for user root Sep 18 21:41:02 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-99bf898d-ceba-462d-b5b4-c86a6d5724b4 tempest-SnapshotMetadataTestJSON-722146611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7d9dc0a-9332-4ba8-b87b-58305d712146.55d66500-489c-4d85-9668-a35b029d563d" returned: 0 in 0.445s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:41:02 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-99bf898d-ceba-462d-b5b4-c86a6d5724b4 tempest-SnapshotMetadataTestJSON-722146611 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7d9dc0a-9332-4ba8-b87b-58305d712146(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86136) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 21:41:02 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[be2817d4-3fc5-4dec-b6c4-7fa2dde21295]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:41:02 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-99bf898d-ceba-462d-b5b4-c86a6d5724b4 tempest-SnapshotMetadataTestJSON-722146611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7d9dc0a-9332-4ba8-b87b-58305d712146 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:41:02 devstack sudo[95918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7d9dc0a-9332-4ba8-b87b-58305d712146 Sep 18 21:41:02 devstack sudo[95918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:41:02 devstack sudo[95918]: pam_unix(sudo:session): session closed for user root Sep 18 21:41:02 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-99bf898d-ceba-462d-b5b4-c86a6d5724b4 tempest-SnapshotMetadataTestJSON-722146611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7d9dc0a-9332-4ba8-b87b-58305d712146" returned: 0 in 0.428s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:41:02 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-99bf898d-ceba-462d-b5b4-c86a6d5724b4 tempest-SnapshotMetadataTestJSON-722146611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7d9dc0a-9332-4ba8-b87b-58305d712146.55d66500-489c-4d85-9668-a35b029d563d {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:41:02 devstack sudo[95923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7d9dc0a-9332-4ba8-b87b-58305d712146.55d66500-489c-4d85-9668-a35b029d563d Sep 18 21:41:02 devstack sudo[95923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:41:03 devstack sudo[95923]: pam_unix(sudo:session): session closed for user root Sep 18 21:41:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-99bf898d-ceba-462d-b5b4-c86a6d5724b4 tempest-SnapshotMetadataTestJSON-722146611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7d9dc0a-9332-4ba8-b87b-58305d712146.55d66500-489c-4d85-9668-a35b029d563d" returned: 0 in 0.458s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:41:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-99bf898d-ceba-462d-b5b4-c86a6d5724b4 tempest-SnapshotMetadataTestJSON-722146611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7d9dc0a-9332-4ba8-b87b-58305d712146.55d66500-489c-4d85-9668-a35b029d563d {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:41:03 devstack sudo[95929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7d9dc0a-9332-4ba8-b87b-58305d712146.55d66500-489c-4d85-9668-a35b029d563d Sep 18 21:41:03 devstack sudo[95929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:41:03 devstack sudo[95929]: pam_unix(sudo:session): session closed for user root Sep 18 21:41:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-99bf898d-ceba-462d-b5b4-c86a6d5724b4 tempest-SnapshotMetadataTestJSON-722146611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7d9dc0a-9332-4ba8-b87b-58305d712146.55d66500-489c-4d85-9668-a35b029d563d" returned: 0 in 0.277s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:41:03 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-99bf898d-ceba-462d-b5b4-c86a6d5724b4 tempest-SnapshotMetadataTestJSON-722146611 None] Lock "cinder-quobyte-55d66500-489c-4d85-9668-a35b029d563d" released by "_delete_snapshot" :: held 1.776s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:41:03 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-99bf898d-ceba-462d-b5b4-c86a6d5724b4 tempest-SnapshotMetadataTestJSON-722146611 None] Lock "cinder-quobyte-b7d9dc0a-9332-4ba8-b87b-58305d712146" released by "delete_snapshot" :: held 1.808s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:41:03 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-99bf898d-ceba-462d-b5b4-c86a6d5724b4 tempest-SnapshotMetadataTestJSON-722146611 None] Created reservations ['ab644d7b-0871-46a1-a251-578ee923e119', '412fe034-77f4-4f5f-a929-4f53fed24dd1', '4e619a9a-db08-497e-bc99-4f40b66f2a83', '4068d989-b61a-41ce-a623-562b5519725b'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:41:03 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-99bf898d-ceba-462d-b5b4-c86a6d5724b4 tempest-SnapshotMetadataTestJSON-722146611 None] Delete snapshot completed successfully. Sep 18 21:41:03 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-99bf898d-ceba-462d-b5b4-c86a6d5724b4 tempest-SnapshotMetadataTestJSON-722146611 None] Lock "cinder-55d66500-489c-4d85-9668-a35b029d563d-delete_snapshot" released by "delete_snapshot" :: held 1.982s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:41:04 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-58918529-f6dc-46d0-bd7f-5b4f5962d175 tempest-SnapshotMetadataTestJSON-722146611 None] Acquiring lock "cinder-b7d9dc0a-9332-4ba8-b87b-58305d712146-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:41:04 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-58918529-f6dc-46d0-bd7f-5b4f5962d175 tempest-SnapshotMetadataTestJSON-722146611 None] Lock "cinder-b7d9dc0a-9332-4ba8-b87b-58305d712146-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:41:04 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-58918529-f6dc-46d0-bd7f-5b4f5962d175 tempest-SnapshotMetadataTestJSON-722146611 None] Acquiring lock "cinder-quobyte-b7d9dc0a-9332-4ba8-b87b-58305d712146" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:41:04 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-58918529-f6dc-46d0-bd7f-5b4f5962d175 tempest-SnapshotMetadataTestJSON-722146611 None] Lock "cinder-quobyte-b7d9dc0a-9332-4ba8-b87b-58305d712146" acquired by "delete_volume" :: waited 0.018s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:41:04 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[332bfc52-3be7-4bb5-b5a4-47f4c92a6235]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:41:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-58918529-f6dc-46d0-bd7f-5b4f5962d175 tempest-SnapshotMetadataTestJSON-722146611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7d9dc0a-9332-4ba8-b87b-58305d712146 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:41:04 devstack sudo[95932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7d9dc0a-9332-4ba8-b87b-58305d712146 Sep 18 21:41:04 devstack sudo[95932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:41:04 devstack sudo[95932]: pam_unix(sudo:session): session closed for user root Sep 18 21:41:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-58918529-f6dc-46d0-bd7f-5b4f5962d175 tempest-SnapshotMetadataTestJSON-722146611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7d9dc0a-9332-4ba8-b87b-58305d712146" returned: 0 in 0.442s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:41:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-58918529-f6dc-46d0-bd7f-5b4f5962d175 tempest-SnapshotMetadataTestJSON-722146611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7d9dc0a-9332-4ba8-b87b-58305d712146 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:41:04 devstack sudo[95937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7d9dc0a-9332-4ba8-b87b-58305d712146 Sep 18 21:41:04 devstack sudo[95937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:41:05 devstack sudo[95937]: pam_unix(sudo:session): session closed for user root Sep 18 21:41:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-58918529-f6dc-46d0-bd7f-5b4f5962d175 tempest-SnapshotMetadataTestJSON-722146611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7d9dc0a-9332-4ba8-b87b-58305d712146" returned: 0 in 0.298s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:41:05 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-58918529-f6dc-46d0-bd7f-5b4f5962d175 tempest-SnapshotMetadataTestJSON-722146611 None] Lock "cinder-quobyte-b7d9dc0a-9332-4ba8-b87b-58305d712146" released by "delete_volume" :: held 0.827s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:41:05 devstack cinder-volume[86136]: DEBUG oslo_service.periodic_task [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86136) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 21:41:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:41:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:41:05 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:41:05 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:41:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:41:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:41:05 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-58918529-f6dc-46d0-bd7f-5b4f5962d175 tempest-SnapshotMetadataTestJSON-722146611 None] Created reservations ['b16d5b00-092e-4317-b47b-ee536240d474', '5f360197-d391-4a0c-ba9d-7cd12a8f2e42', '2ed09fbc-6f67-42ce-808e-a67425b478c0', '47e0d257-0cad-428e-b33b-7bd36f3312a8'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:41:05 devstack sudo[95940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:41:05 devstack sudo[95940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:41:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-58918529-f6dc-46d0-bd7f-5b4f5962d175 tempest-SnapshotMetadataTestJSON-722146611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:41:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-58918529-f6dc-46d0-bd7f-5b4f5962d175 tempest-SnapshotMetadataTestJSON-722146611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:41:05 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-58918529-f6dc-46d0-bd7f-5b4f5962d175 tempest-SnapshotMetadataTestJSON-722146611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:41:05 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-58918529-f6dc-46d0-bd7f-5b4f5962d175 tempest-SnapshotMetadataTestJSON-722146611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:41:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-58918529-f6dc-46d0-bd7f-5b4f5962d175 tempest-SnapshotMetadataTestJSON-722146611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:41:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-58918529-f6dc-46d0-bd7f-5b4f5962d175 tempest-SnapshotMetadataTestJSON-722146611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:41:05 devstack sudo[95942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:41:05 devstack sudo[95942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:41:05 devstack sudo[95940]: pam_unix(sudo:session): session closed for user root Sep 18 21:41:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.389s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:41:05 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:41:05 devstack cinder-volume[86136]: DEBUG oslo_service.periodic_task [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Running periodic task VolumeManager._thread_info {{(pid=86136) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 21:41:05 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] thread count: 28 {{(pid=86136) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 18 21:41:05 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] thread info: [<_MainThread(MainThread, started 138548347871360)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86136) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 18 21:41:05 devstack sudo[95942]: pam_unix(sudo:session): session closed for user root Sep 18 21:41:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-58918529-f6dc-46d0-bd7f-5b4f5962d175 tempest-SnapshotMetadataTestJSON-722146611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.441s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:41:05 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-58918529-f6dc-46d0-bd7f-5b4f5962d175 tempest-SnapshotMetadataTestJSON-722146611 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:41:05 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-58918529-f6dc-46d0-bd7f-5b4f5962d175 tempest-SnapshotMetadataTestJSON-722146611 None] Deleted volume successfully. Sep 18 21:41:05 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-58918529-f6dc-46d0-bd7f-5b4f5962d175 tempest-SnapshotMetadataTestJSON-722146611 None] Lock "cinder-b7d9dc0a-9332-4ba8-b87b-58305d712146-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:41:09 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd9436f7-fc40-4e48-970d-1903d9a92ad3 tempest-VolumeTypesAccessTest-886188267 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:41:09 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-bd9436f7-fc40-4e48-970d-1903d9a92ad3 tempest-VolumeTypesAccessTest-886188267 None] Flow 'volume_create_manager' (612ec286-524b-4e2b-b669-70722675d6d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:41:09 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-bd9436f7-fc40-4e48-970d-1903d9a92ad3 tempest-VolumeTypesAccessTest-886188267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4b8622c-bafb-4da0-b43c-9bc88ea5e9dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:41:09 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-bd9436f7-fc40-4e48-970d-1903d9a92ad3 tempest-VolumeTypesAccessTest-886188267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4b8622c-bafb-4da0-b43c-9bc88ea5e9dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:41:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-449941698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e97e59ce-da82-42b5-854d-d11209756a4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='377f77a5ff3d45beb3e5f6b2cf449a2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:41:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:41:10Z,use_quota=True,user_id='985669f508d2498bb5ab5b9ddd7440aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58fa306c-3cb8-4790-a9d8-6fc4b205922f),volume_type_id=58fa306c-3cb8-4790-a9d8-6fc4b205922f)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:41:09 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-bd9436f7-fc40-4e48-970d-1903d9a92ad3 tempest-VolumeTypesAccessTest-886188267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf21d819-d9f8-45f3-a334-d91f1c94cea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:41:09 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-bd9436f7-fc40-4e48-970d-1903d9a92ad3 tempest-VolumeTypesAccessTest-886188267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf21d819-d9f8-45f3-a334-d91f1c94cea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:41:09 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-bd9436f7-fc40-4e48-970d-1903d9a92ad3 tempest-VolumeTypesAccessTest-886188267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf7b0a64-851a-42fa-a501-9cc7726ac1e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:41:09 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-bd9436f7-fc40-4e48-970d-1903d9a92ad3 tempest-VolumeTypesAccessTest-886188267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf7b0a64-851a-42fa-a501-9cc7726ac1e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e97e59ce-da82-42b5-854d-d11209756a4a', 'volume_name': 'volume-e97e59ce-da82-42b5-854d-d11209756a4a', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:41:09 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-bd9436f7-fc40-4e48-970d-1903d9a92ad3 tempest-VolumeTypesAccessTest-886188267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28ba207d-2cd0-4273-96f1-0ba3e87a0036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:41:09 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-bd9436f7-fc40-4e48-970d-1903d9a92ad3 tempest-VolumeTypesAccessTest-886188267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28ba207d-2cd0-4273-96f1-0ba3e87a0036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:41:09 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-bd9436f7-fc40-4e48-970d-1903d9a92ad3 tempest-VolumeTypesAccessTest-886188267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8082dff-83ab-4bce-9569-0787c38e3ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:41:09 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-bd9436f7-fc40-4e48-970d-1903d9a92ad3 tempest-VolumeTypesAccessTest-886188267 None] Volume e97e59ce-da82-42b5-854d-d11209756a4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e97e59ce-da82-42b5-854d-d11209756a4a', 'volume_size': 1} Sep 18 21:41:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-bd9436f7-fc40-4e48-970d-1903d9a92ad3 tempest-VolumeTypesAccessTest-886188267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:41:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-bd9436f7-fc40-4e48-970d-1903d9a92ad3 tempest-VolumeTypesAccessTest-886188267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:41:09 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-bd9436f7-fc40-4e48-970d-1903d9a92ad3 tempest-VolumeTypesAccessTest-886188267 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:41:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-449941698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e97e59ce-da82-42b5-854d-d11209756a4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='377f77a5ff3d45beb3e5f6b2cf449a2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:41:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:41:10Z,use_quota=True,user_id='985669f508d2498bb5ab5b9ddd7440aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58fa306c-3cb8-4790-a9d8-6fc4b205922f),volume_type_id=58fa306c-3cb8-4790-a9d8-6fc4b205922f)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:41:09 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-bd9436f7-fc40-4e48-970d-1903d9a92ad3 tempest-VolumeTypesAccessTest-886188267 None] Creating volume e97e59ce-da82-42b5-854d-d11209756a4a {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:41:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-bd9436f7-fc40-4e48-970d-1903d9a92ad3 tempest-VolumeTypesAccessTest-886188267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:41:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-bd9436f7-fc40-4e48-970d-1903d9a92ad3 tempest-VolumeTypesAccessTest-886188267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:41:09 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-bd9436f7-fc40-4e48-970d-1903d9a92ad3 tempest-VolumeTypesAccessTest-886188267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:41:09 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-bd9436f7-fc40-4e48-970d-1903d9a92ad3 tempest-VolumeTypesAccessTest-886188267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:41:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-bd9436f7-fc40-4e48-970d-1903d9a92ad3 tempest-VolumeTypesAccessTest-886188267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:41:09 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-bd9436f7-fc40-4e48-970d-1903d9a92ad3 tempest-VolumeTypesAccessTest-886188267 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:41:09 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-bd9436f7-fc40-4e48-970d-1903d9a92ad3 tempest-VolumeTypesAccessTest-886188267 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:41:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-bd9436f7-fc40-4e48-970d-1903d9a92ad3 tempest-VolumeTypesAccessTest-886188267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e97e59ce-da82-42b5-854d-d11209756a4a 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:41:09 devstack sudo[95948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e97e59ce-da82-42b5-854d-d11209756a4a 1073741824 Sep 18 21:41:09 devstack sudo[95948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:41:10 devstack sudo[95948]: pam_unix(sudo:session): session closed for user root Sep 18 21:41:10 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-bd9436f7-fc40-4e48-970d-1903d9a92ad3 tempest-VolumeTypesAccessTest-886188267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e97e59ce-da82-42b5-854d-d11209756a4a 1073741824" returned: 0 in 0.577s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:41:10 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-bd9436f7-fc40-4e48-970d-1903d9a92ad3 tempest-VolumeTypesAccessTest-886188267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e97e59ce-da82-42b5-854d-d11209756a4a {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:41:10 devstack sudo[95957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e97e59ce-da82-42b5-854d-d11209756a4a Sep 18 21:41:10 devstack sudo[95957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:41:11 devstack sudo[95957]: pam_unix(sudo:session): session closed for user root Sep 18 21:41:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-bd9436f7-fc40-4e48-970d-1903d9a92ad3 tempest-VolumeTypesAccessTest-886188267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e97e59ce-da82-42b5-854d-d11209756a4a" returned: 0 in 0.457s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:41:11 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-bd9436f7-fc40-4e48-970d-1903d9a92ad3 tempest-VolumeTypesAccessTest-886188267 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:41:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-bd9436f7-fc40-4e48-970d-1903d9a92ad3 tempest-VolumeTypesAccessTest-886188267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:41:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-bd9436f7-fc40-4e48-970d-1903d9a92ad3 tempest-VolumeTypesAccessTest-886188267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8082dff-83ab-4bce-9569-0787c38e3ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e97e59ce-da82-42b5-854d-d11209756a4a', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:41:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-bd9436f7-fc40-4e48-970d-1903d9a92ad3 tempest-VolumeTypesAccessTest-886188267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a1ccea7-01b5-40f0-b260-f7f02686753c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:41:11 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-bd9436f7-fc40-4e48-970d-1903d9a92ad3 tempest-VolumeTypesAccessTest-886188267 None] Volume volume-e97e59ce-da82-42b5-854d-d11209756a4a (e97e59ce-da82-42b5-854d-d11209756a4a): created successfully Sep 18 21:41:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-bd9436f7-fc40-4e48-970d-1903d9a92ad3 tempest-VolumeTypesAccessTest-886188267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a1ccea7-01b5-40f0-b260-f7f02686753c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:41:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-bd9436f7-fc40-4e48-970d-1903d9a92ad3 tempest-VolumeTypesAccessTest-886188267 None] Flow 'volume_create_manager' (612ec286-524b-4e2b-b669-70722675d6d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:41:11 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-bd9436f7-fc40-4e48-970d-1903d9a92ad3 tempest-VolumeTypesAccessTest-886188267 None] Created volume successfully. Sep 18 21:41:12 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-ba6c0ec0-763c-457d-b597-26438f930fc9 tempest-VolumeTypesAccessTest-886188267 None] Acquiring lock "cinder-e97e59ce-da82-42b5-854d-d11209756a4a-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:41:12 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-ba6c0ec0-763c-457d-b597-26438f930fc9 tempest-VolumeTypesAccessTest-886188267 None] Lock "cinder-e97e59ce-da82-42b5-854d-d11209756a4a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:41:12 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-ba6c0ec0-763c-457d-b597-26438f930fc9 tempest-VolumeTypesAccessTest-886188267 None] Acquiring lock "cinder-quobyte-e97e59ce-da82-42b5-854d-d11209756a4a" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:41:12 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-ba6c0ec0-763c-457d-b597-26438f930fc9 tempest-VolumeTypesAccessTest-886188267 None] Lock "cinder-quobyte-e97e59ce-da82-42b5-854d-d11209756a4a" acquired by "delete_volume" :: waited 0.029s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:41:12 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3548be2-025e-4ddd-ae0f-db66ddc19c01]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:41:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ba6c0ec0-763c-457d-b597-26438f930fc9 tempest-VolumeTypesAccessTest-886188267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e97e59ce-da82-42b5-854d-d11209756a4a {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:41:12 devstack sudo[95986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e97e59ce-da82-42b5-854d-d11209756a4a Sep 18 21:41:12 devstack sudo[95986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:41:12 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1764263-fe51-431b-956c-9438a7464801 tempest-VolumesTransfersV355Test-1794173408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:41:12 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c1764263-fe51-431b-956c-9438a7464801 tempest-VolumesTransfersV355Test-1794173408 None] Flow 'volume_create_manager' (91372dca-8bbc-48dd-a4ce-52d1e75a6793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:41:12 devstack sudo[95986]: pam_unix(sudo:session): session closed for user root Sep 18 21:41:12 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c1764263-fe51-431b-956c-9438a7464801 tempest-VolumesTransfersV355Test-1794173408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5bbe3b9-5147-4403-b825-1417a847d593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:41:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ba6c0ec0-763c-457d-b597-26438f930fc9 tempest-VolumeTypesAccessTest-886188267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e97e59ce-da82-42b5-854d-d11209756a4a" returned: 0 in 0.483s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:41:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ba6c0ec0-763c-457d-b597-26438f930fc9 tempest-VolumeTypesAccessTest-886188267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e97e59ce-da82-42b5-854d-d11209756a4a {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:41:12 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c1764263-fe51-431b-956c-9438a7464801 tempest-VolumesTransfersV355Test-1794173408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5bbe3b9-5147-4403-b825-1417a847d593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:41:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1458517517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=098b6b9e-f00c-4e88-ac1c-c352b1095a9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18a0b68211444ce780b8b4213557691b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:41:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:41:13Z,use_quota=True,user_id='93bbc040918647879767108d0e686746',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:41:12 devstack sudo[95992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e97e59ce-da82-42b5-854d-d11209756a4a Sep 18 21:41:12 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c1764263-fe51-431b-956c-9438a7464801 tempest-VolumesTransfersV355Test-1794173408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3287e982-07f9-433d-bd53-48b1e05a2a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:41:12 devstack sudo[95992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:41:12 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c1764263-fe51-431b-956c-9438a7464801 tempest-VolumesTransfersV355Test-1794173408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3287e982-07f9-433d-bd53-48b1e05a2a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:41:12 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c1764263-fe51-431b-956c-9438a7464801 tempest-VolumesTransfersV355Test-1794173408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (101025a3-e8e5-49e9-b2d9-1654d446f54d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:41:12 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c1764263-fe51-431b-956c-9438a7464801 tempest-VolumesTransfersV355Test-1794173408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (101025a3-e8e5-49e9-b2d9-1654d446f54d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '098b6b9e-f00c-4e88-ac1c-c352b1095a9e', 'volume_name': 'volume-098b6b9e-f00c-4e88-ac1c-c352b1095a9e', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:41:12 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c1764263-fe51-431b-956c-9438a7464801 tempest-VolumesTransfersV355Test-1794173408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68b85604-bbc9-4f0d-84b8-67c48d0a00b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:41:12 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c1764263-fe51-431b-956c-9438a7464801 tempest-VolumesTransfersV355Test-1794173408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68b85604-bbc9-4f0d-84b8-67c48d0a00b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:41:12 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c1764263-fe51-431b-956c-9438a7464801 tempest-VolumesTransfersV355Test-1794173408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abcd78f2-f6c7-4c9a-869e-6d6742b1fe97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:41:12 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-c1764263-fe51-431b-956c-9438a7464801 tempest-VolumesTransfersV355Test-1794173408 None] Volume 098b6b9e-f00c-4e88-ac1c-c352b1095a9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-098b6b9e-f00c-4e88-ac1c-c352b1095a9e', 'volume_size': 1} Sep 18 21:41:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c1764263-fe51-431b-956c-9438a7464801 tempest-VolumesTransfersV355Test-1794173408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:41:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c1764263-fe51-431b-956c-9438a7464801 tempest-VolumesTransfersV355Test-1794173408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:41:12 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-c1764263-fe51-431b-956c-9438a7464801 tempest-VolumesTransfersV355Test-1794173408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:41:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1458517517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=098b6b9e-f00c-4e88-ac1c-c352b1095a9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18a0b68211444ce780b8b4213557691b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:41:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:41:13Z,use_quota=True,user_id='93bbc040918647879767108d0e686746',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:41:12 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-c1764263-fe51-431b-956c-9438a7464801 tempest-VolumesTransfersV355Test-1794173408 None] Creating volume 098b6b9e-f00c-4e88-ac1c-c352b1095a9e {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:41:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c1764263-fe51-431b-956c-9438a7464801 tempest-VolumesTransfersV355Test-1794173408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:41:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c1764263-fe51-431b-956c-9438a7464801 tempest-VolumesTransfersV355Test-1794173408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:41:12 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-c1764263-fe51-431b-956c-9438a7464801 tempest-VolumesTransfersV355Test-1794173408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:41:12 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-c1764263-fe51-431b-956c-9438a7464801 tempest-VolumesTransfersV355Test-1794173408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:41:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c1764263-fe51-431b-956c-9438a7464801 tempest-VolumesTransfersV355Test-1794173408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:41:12 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-c1764263-fe51-431b-956c-9438a7464801 tempest-VolumesTransfersV355Test-1794173408 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:41:12 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-c1764263-fe51-431b-956c-9438a7464801 tempest-VolumesTransfersV355Test-1794173408 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:41:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c1764263-fe51-431b-956c-9438a7464801 tempest-VolumesTransfersV355Test-1794173408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-098b6b9e-f00c-4e88-ac1c-c352b1095a9e 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:41:12 devstack sudo[95994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-098b6b9e-f00c-4e88-ac1c-c352b1095a9e 1073741824 Sep 18 21:41:12 devstack sudo[95994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:41:13 devstack sudo[95992]: pam_unix(sudo:session): session closed for user root Sep 18 21:41:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ba6c0ec0-763c-457d-b597-26438f930fc9 tempest-VolumeTypesAccessTest-886188267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e97e59ce-da82-42b5-854d-d11209756a4a" returned: 0 in 0.320s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:41:13 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-ba6c0ec0-763c-457d-b597-26438f930fc9 tempest-VolumeTypesAccessTest-886188267 None] Lock "cinder-quobyte-e97e59ce-da82-42b5-854d-d11209756a4a" released by "delete_volume" :: held 0.870s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:41:13 devstack cinder-volume[86136]: WARNING cinder.quota [None req-ba6c0ec0-763c-457d-b597-26438f930fc9 tempest-VolumeTypesAccessTest-886188267 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-941668374 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-941668374, it is now deprecated. Please use the default quota class for default quota. Sep 18 21:41:13 devstack cinder-volume[86136]: WARNING cinder.quota [None req-ba6c0ec0-763c-457d-b597-26438f930fc9 tempest-VolumeTypesAccessTest-886188267 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-941668374 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-941668374, it is now deprecated. Please use the default quota class for default quota. Sep 18 21:41:13 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-ba6c0ec0-763c-457d-b597-26438f930fc9 tempest-VolumeTypesAccessTest-886188267 None] Created reservations ['544bd3ed-0f5e-449a-a4f7-3bb6b1bb2f97', 'cf96bc30-c709-4be3-a160-1b17c7a1e248', 'b9036654-6116-45be-9e29-5935a307e86b', '61697a5d-d1c4-4686-9816-2863ecc469d2'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:41:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-ba6c0ec0-763c-457d-b597-26438f930fc9 tempest-VolumeTypesAccessTest-886188267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:41:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-ba6c0ec0-763c-457d-b597-26438f930fc9 tempest-VolumeTypesAccessTest-886188267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:41:13 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-ba6c0ec0-763c-457d-b597-26438f930fc9 tempest-VolumeTypesAccessTest-886188267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:41:13 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-ba6c0ec0-763c-457d-b597-26438f930fc9 tempest-VolumeTypesAccessTest-886188267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:41:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-ba6c0ec0-763c-457d-b597-26438f930fc9 tempest-VolumeTypesAccessTest-886188267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:41:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ba6c0ec0-763c-457d-b597-26438f930fc9 tempest-VolumeTypesAccessTest-886188267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:41:13 devstack sudo[96000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:41:13 devstack sudo[96000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:41:13 devstack sudo[95994]: pam_unix(sudo:session): session closed for user root Sep 18 21:41:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c1764263-fe51-431b-956c-9438a7464801 tempest-VolumesTransfersV355Test-1794173408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-098b6b9e-f00c-4e88-ac1c-c352b1095a9e 1073741824" returned: 0 in 0.616s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:41:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c1764263-fe51-431b-956c-9438a7464801 tempest-VolumesTransfersV355Test-1794173408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-098b6b9e-f00c-4e88-ac1c-c352b1095a9e {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:41:13 devstack sudo[96000]: pam_unix(sudo:session): session closed for user root Sep 18 21:41:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ba6c0ec0-763c-457d-b597-26438f930fc9 tempest-VolumeTypesAccessTest-886188267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.291s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:41:13 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-ba6c0ec0-763c-457d-b597-26438f930fc9 tempest-VolumeTypesAccessTest-886188267 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:41:13 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-ba6c0ec0-763c-457d-b597-26438f930fc9 tempest-VolumeTypesAccessTest-886188267 None] Deleted volume successfully. Sep 18 21:41:13 devstack sudo[96004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-098b6b9e-f00c-4e88-ac1c-c352b1095a9e Sep 18 21:41:13 devstack sudo[96004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:41:13 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-ba6c0ec0-763c-457d-b597-26438f930fc9 tempest-VolumeTypesAccessTest-886188267 None] Lock "cinder-e97e59ce-da82-42b5-854d-d11209756a4a-delete_volume" released by "delete_volume" :: held 1.443s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:41:13 devstack sudo[96004]: pam_unix(sudo:session): session closed for user root Sep 18 21:41:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c1764263-fe51-431b-956c-9438a7464801 tempest-VolumesTransfersV355Test-1794173408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-098b6b9e-f00c-4e88-ac1c-c352b1095a9e" returned: 0 in 0.448s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:41:13 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-c1764263-fe51-431b-956c-9438a7464801 tempest-VolumesTransfersV355Test-1794173408 None] <== create_volume: return (1136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:41:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c1764263-fe51-431b-956c-9438a7464801 tempest-VolumesTransfersV355Test-1794173408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:41:13 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c1764263-fe51-431b-956c-9438a7464801 tempest-VolumesTransfersV355Test-1794173408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abcd78f2-f6c7-4c9a-869e-6d6742b1fe97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-098b6b9e-f00c-4e88-ac1c-c352b1095a9e', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:41:14 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c1764263-fe51-431b-956c-9438a7464801 tempest-VolumesTransfersV355Test-1794173408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (520b3e12-fed2-4ea7-9be3-c375dd001242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:41:14 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-c1764263-fe51-431b-956c-9438a7464801 tempest-VolumesTransfersV355Test-1794173408 None] Volume volume-098b6b9e-f00c-4e88-ac1c-c352b1095a9e (098b6b9e-f00c-4e88-ac1c-c352b1095a9e): created successfully Sep 18 21:41:14 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c1764263-fe51-431b-956c-9438a7464801 tempest-VolumesTransfersV355Test-1794173408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (520b3e12-fed2-4ea7-9be3-c375dd001242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:41:14 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c1764263-fe51-431b-956c-9438a7464801 tempest-VolumesTransfersV355Test-1794173408 None] Flow 'volume_create_manager' (91372dca-8bbc-48dd-a4ce-52d1e75a6793) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:41:14 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-c1764263-fe51-431b-956c-9438a7464801 tempest-VolumesTransfersV355Test-1794173408 None] Created volume successfully. Sep 18 21:41:16 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-518bcb36-e1d2-468d-ba9f-0b75840d305a tempest-VolumesTransfersV355Test-122617464 None] Transfer volume completed successfully. Sep 18 21:41:17 devstack cinder-volume[86136]: INFO cinder.volume.manager [req-3862f84a-b497-4fbc-ad16-0ab4349984fa req-4bbd546f-3c62-4004-9efd-ae623b15c600 tempest-AttachVolumeNegativeTest-605821046 None] Terminate volume connection completed successfully. Sep 18 21:41:17 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [req-3862f84a-b497-4fbc-ad16-0ab4349984fa req-4bbd546f-3c62-4004-9efd-ae623b15c600 tempest-AttachVolumeNegativeTest-605821046 None] Deleting attachment 95e9ea6e-500e-4a84-bcba-982344183e3f. {{(pid=86136) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 18 21:41:17 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-ea670df6-e6cd-4856-8370-95af53a7b677 tempest-VolumesTransfersV355Test-863879179 None] Acquiring lock "cinder-098b6b9e-f00c-4e88-ac1c-c352b1095a9e-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:41:17 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-ea670df6-e6cd-4856-8370-95af53a7b677 tempest-VolumesTransfersV355Test-863879179 None] Lock "cinder-098b6b9e-f00c-4e88-ac1c-c352b1095a9e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:41:17 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-ea670df6-e6cd-4856-8370-95af53a7b677 tempest-VolumesTransfersV355Test-863879179 None] Acquiring lock "cinder-quobyte-098b6b9e-f00c-4e88-ac1c-c352b1095a9e" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:41:17 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-ea670df6-e6cd-4856-8370-95af53a7b677 tempest-VolumesTransfersV355Test-863879179 None] Lock "cinder-quobyte-098b6b9e-f00c-4e88-ac1c-c352b1095a9e" acquired by "delete_volume" :: waited 0.038s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:41:17 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[c29b90fa-0e07-4e95-be18-c753c2e6318b]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:41:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ea670df6-e6cd-4856-8370-95af53a7b677 tempest-VolumesTransfersV355Test-863879179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-098b6b9e-f00c-4e88-ac1c-c352b1095a9e {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:41:17 devstack sudo[96050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-098b6b9e-f00c-4e88-ac1c-c352b1095a9e Sep 18 21:41:17 devstack sudo[96050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:41:18 devstack sudo[96050]: pam_unix(sudo:session): session closed for user root Sep 18 21:41:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ea670df6-e6cd-4856-8370-95af53a7b677 tempest-VolumesTransfersV355Test-863879179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-098b6b9e-f00c-4e88-ac1c-c352b1095a9e" returned: 0 in 0.586s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:41:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ea670df6-e6cd-4856-8370-95af53a7b677 tempest-VolumesTransfersV355Test-863879179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-098b6b9e-f00c-4e88-ac1c-c352b1095a9e {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:41:18 devstack sudo[96055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-098b6b9e-f00c-4e88-ac1c-c352b1095a9e Sep 18 21:41:18 devstack sudo[96055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:41:18 devstack sudo[96055]: pam_unix(sudo:session): session closed for user root Sep 18 21:41:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ea670df6-e6cd-4856-8370-95af53a7b677 tempest-VolumesTransfersV355Test-863879179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-098b6b9e-f00c-4e88-ac1c-c352b1095a9e" returned: 0 in 0.404s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:41:18 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-ea670df6-e6cd-4856-8370-95af53a7b677 tempest-VolumesTransfersV355Test-863879179 None] Lock "cinder-quobyte-098b6b9e-f00c-4e88-ac1c-c352b1095a9e" released by "delete_volume" :: held 1.080s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:41:18 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-ea670df6-e6cd-4856-8370-95af53a7b677 tempest-VolumesTransfersV355Test-863879179 None] Created reservations ['76c0e121-f383-4d89-8019-9a7d55ffcdb6', '88302a8d-f824-4f15-bfca-23fec77091c9', 'cb65100b-d12a-4af9-8809-ad948bc7069f', '8d17d9d9-9f7a-42df-956d-8dfd2f1e873d'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:41:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-ea670df6-e6cd-4856-8370-95af53a7b677 tempest-VolumesTransfersV355Test-863879179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:41:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-ea670df6-e6cd-4856-8370-95af53a7b677 tempest-VolumesTransfersV355Test-863879179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:41:18 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-ea670df6-e6cd-4856-8370-95af53a7b677 tempest-VolumesTransfersV355Test-863879179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:41:18 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-ea670df6-e6cd-4856-8370-95af53a7b677 tempest-VolumesTransfersV355Test-863879179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:41:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-ea670df6-e6cd-4856-8370-95af53a7b677 tempest-VolumesTransfersV355Test-863879179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:41:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ea670df6-e6cd-4856-8370-95af53a7b677 tempest-VolumesTransfersV355Test-863879179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:41:18 devstack sudo[96077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:41:18 devstack sudo[96077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:41:19 devstack sudo[96077]: pam_unix(sudo:session): session closed for user root Sep 18 21:41:19 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ea670df6-e6cd-4856-8370-95af53a7b677 tempest-VolumesTransfersV355Test-863879179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.394s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:41:19 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-ea670df6-e6cd-4856-8370-95af53a7b677 tempest-VolumesTransfersV355Test-863879179 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:41:19 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-ea670df6-e6cd-4856-8370-95af53a7b677 tempest-VolumesTransfersV355Test-863879179 None] Deleted volume successfully. Sep 18 21:41:19 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-ea670df6-e6cd-4856-8370-95af53a7b677 tempest-VolumesTransfersV355Test-863879179 None] Lock "cinder-098b6b9e-f00c-4e88-ac1c-c352b1095a9e-delete_volume" released by "delete_volume" :: held 1.778s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:41:20 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b2851bd-8385-4c11-ab16-8c9f233e91de tempest-VolumesTransfersV355Test-1794173408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:41:20 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9b2851bd-8385-4c11-ab16-8c9f233e91de tempest-VolumesTransfersV355Test-1794173408 None] Flow 'volume_create_manager' (f7e146b9-a2e5-4124-9727-149e6fbef6eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:41:20 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9b2851bd-8385-4c11-ab16-8c9f233e91de tempest-VolumesTransfersV355Test-1794173408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8200ba0-9cc9-46dd-a34b-fa439320b45d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:41:20 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9b2851bd-8385-4c11-ab16-8c9f233e91de tempest-VolumesTransfersV355Test-1794173408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8200ba0-9cc9-46dd-a34b-fa439320b45d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:41:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2104215288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f2b37b7-9993-496d-b5c8-bdc5f226bcbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18a0b68211444ce780b8b4213557691b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:41:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:41:21Z,use_quota=True,user_id='93bbc040918647879767108d0e686746',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:41:20 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9b2851bd-8385-4c11-ab16-8c9f233e91de tempest-VolumesTransfersV355Test-1794173408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6595060c-b701-418f-b1bf-88ad4f1b5dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:41:20 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9b2851bd-8385-4c11-ab16-8c9f233e91de tempest-VolumesTransfersV355Test-1794173408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6595060c-b701-418f-b1bf-88ad4f1b5dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:41:20 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9b2851bd-8385-4c11-ab16-8c9f233e91de tempest-VolumesTransfersV355Test-1794173408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8de25ed9-707d-4719-9a6b-77fbe44c7800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:41:20 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9b2851bd-8385-4c11-ab16-8c9f233e91de tempest-VolumesTransfersV355Test-1794173408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8de25ed9-707d-4719-9a6b-77fbe44c7800) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f2b37b7-9993-496d-b5c8-bdc5f226bcbe', 'volume_name': 'volume-3f2b37b7-9993-496d-b5c8-bdc5f226bcbe', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:41:20 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9b2851bd-8385-4c11-ab16-8c9f233e91de tempest-VolumesTransfersV355Test-1794173408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2857aa36-3622-4873-bc2a-a6dd6855e408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:41:20 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9b2851bd-8385-4c11-ab16-8c9f233e91de tempest-VolumesTransfersV355Test-1794173408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2857aa36-3622-4873-bc2a-a6dd6855e408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:41:20 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9b2851bd-8385-4c11-ab16-8c9f233e91de tempest-VolumesTransfersV355Test-1794173408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (441e8b5c-ee85-409f-b407-1b39f5113efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:41:20 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-9b2851bd-8385-4c11-ab16-8c9f233e91de tempest-VolumesTransfersV355Test-1794173408 None] Volume 3f2b37b7-9993-496d-b5c8-bdc5f226bcbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f2b37b7-9993-496d-b5c8-bdc5f226bcbe', 'volume_size': 1} Sep 18 21:41:20 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-9b2851bd-8385-4c11-ab16-8c9f233e91de tempest-VolumesTransfersV355Test-1794173408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:41:20 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-9b2851bd-8385-4c11-ab16-8c9f233e91de tempest-VolumesTransfersV355Test-1794173408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:41:20 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-9b2851bd-8385-4c11-ab16-8c9f233e91de tempest-VolumesTransfersV355Test-1794173408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:41:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2104215288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f2b37b7-9993-496d-b5c8-bdc5f226bcbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18a0b68211444ce780b8b4213557691b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:41:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:41:21Z,use_quota=True,user_id='93bbc040918647879767108d0e686746',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:41:20 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-9b2851bd-8385-4c11-ab16-8c9f233e91de tempest-VolumesTransfersV355Test-1794173408 None] Creating volume 3f2b37b7-9993-496d-b5c8-bdc5f226bcbe {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:41:20 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-9b2851bd-8385-4c11-ab16-8c9f233e91de tempest-VolumesTransfersV355Test-1794173408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:41:20 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-9b2851bd-8385-4c11-ab16-8c9f233e91de tempest-VolumesTransfersV355Test-1794173408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:41:20 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-9b2851bd-8385-4c11-ab16-8c9f233e91de tempest-VolumesTransfersV355Test-1794173408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:41:20 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-9b2851bd-8385-4c11-ab16-8c9f233e91de tempest-VolumesTransfersV355Test-1794173408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:41:20 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-9b2851bd-8385-4c11-ab16-8c9f233e91de tempest-VolumesTransfersV355Test-1794173408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:41:20 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-9b2851bd-8385-4c11-ab16-8c9f233e91de tempest-VolumesTransfersV355Test-1794173408 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:41:20 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-9b2851bd-8385-4c11-ab16-8c9f233e91de tempest-VolumesTransfersV355Test-1794173408 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:41:20 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9b2851bd-8385-4c11-ab16-8c9f233e91de tempest-VolumesTransfersV355Test-1794173408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3f2b37b7-9993-496d-b5c8-bdc5f226bcbe 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:41:20 devstack sudo[96085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3f2b37b7-9993-496d-b5c8-bdc5f226bcbe 1073741824 Sep 18 21:41:20 devstack sudo[96085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:41:21 devstack sudo[96085]: pam_unix(sudo:session): session closed for user root Sep 18 21:41:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9b2851bd-8385-4c11-ab16-8c9f233e91de tempest-VolumesTransfersV355Test-1794173408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3f2b37b7-9993-496d-b5c8-bdc5f226bcbe 1073741824" returned: 0 in 0.608s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:41:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9b2851bd-8385-4c11-ab16-8c9f233e91de tempest-VolumesTransfersV355Test-1794173408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3f2b37b7-9993-496d-b5c8-bdc5f226bcbe {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:41:21 devstack sudo[96091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3f2b37b7-9993-496d-b5c8-bdc5f226bcbe Sep 18 21:41:21 devstack sudo[96091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:41:21 devstack sudo[96091]: pam_unix(sudo:session): session closed for user root Sep 18 21:41:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9b2851bd-8385-4c11-ab16-8c9f233e91de tempest-VolumesTransfersV355Test-1794173408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3f2b37b7-9993-496d-b5c8-bdc5f226bcbe" returned: 0 in 0.376s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:41:21 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-9b2851bd-8385-4c11-ab16-8c9f233e91de tempest-VolumesTransfersV355Test-1794173408 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:41:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-9b2851bd-8385-4c11-ab16-8c9f233e91de tempest-VolumesTransfersV355Test-1794173408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:41:21 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9b2851bd-8385-4c11-ab16-8c9f233e91de tempest-VolumesTransfersV355Test-1794173408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (441e8b5c-ee85-409f-b407-1b39f5113efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f2b37b7-9993-496d-b5c8-bdc5f226bcbe', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:41:21 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9b2851bd-8385-4c11-ab16-8c9f233e91de tempest-VolumesTransfersV355Test-1794173408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b86e388c-dd41-46f7-8dc0-c99875e6729c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:41:21 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-9b2851bd-8385-4c11-ab16-8c9f233e91de tempest-VolumesTransfersV355Test-1794173408 None] Volume volume-3f2b37b7-9993-496d-b5c8-bdc5f226bcbe (3f2b37b7-9993-496d-b5c8-bdc5f226bcbe): created successfully Sep 18 21:41:21 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9b2851bd-8385-4c11-ab16-8c9f233e91de tempest-VolumesTransfersV355Test-1794173408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b86e388c-dd41-46f7-8dc0-c99875e6729c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:41:21 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9b2851bd-8385-4c11-ab16-8c9f233e91de tempest-VolumesTransfersV355Test-1794173408 None] Flow 'volume_create_manager' (f7e146b9-a2e5-4124-9727-149e6fbef6eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:41:21 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-9b2851bd-8385-4c11-ab16-8c9f233e91de tempest-VolumesTransfersV355Test-1794173408 None] Created volume successfully. Sep 18 21:41:23 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-ca9c2577-7b5d-421f-827e-37ac74fba44c tempest-VolumesTransfersV355Test-863879179 None] Acquiring lock "cinder-3f2b37b7-9993-496d-b5c8-bdc5f226bcbe-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:41:23 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-ca9c2577-7b5d-421f-827e-37ac74fba44c tempest-VolumesTransfersV355Test-863879179 None] Lock "cinder-3f2b37b7-9993-496d-b5c8-bdc5f226bcbe-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:41:23 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-ca9c2577-7b5d-421f-827e-37ac74fba44c tempest-VolumesTransfersV355Test-863879179 None] Acquiring lock "cinder-quobyte-3f2b37b7-9993-496d-b5c8-bdc5f226bcbe" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:41:23 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-ca9c2577-7b5d-421f-827e-37ac74fba44c tempest-VolumesTransfersV355Test-863879179 None] Lock "cinder-quobyte-3f2b37b7-9993-496d-b5c8-bdc5f226bcbe" acquired by "delete_volume" :: waited 0.019s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:41:23 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[174f0551-1733-49c0-95a1-43eef80a6118]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:41:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ca9c2577-7b5d-421f-827e-37ac74fba44c tempest-VolumesTransfersV355Test-863879179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3f2b37b7-9993-496d-b5c8-bdc5f226bcbe {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:41:23 devstack sudo[96094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3f2b37b7-9993-496d-b5c8-bdc5f226bcbe Sep 18 21:41:23 devstack sudo[96094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:41:23 devstack sudo[96094]: pam_unix(sudo:session): session closed for user root Sep 18 21:41:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ca9c2577-7b5d-421f-827e-37ac74fba44c tempest-VolumesTransfersV355Test-863879179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3f2b37b7-9993-496d-b5c8-bdc5f226bcbe" returned: 0 in 0.403s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:41:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ca9c2577-7b5d-421f-827e-37ac74fba44c tempest-VolumesTransfersV355Test-863879179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3f2b37b7-9993-496d-b5c8-bdc5f226bcbe {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:41:23 devstack sudo[96099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3f2b37b7-9993-496d-b5c8-bdc5f226bcbe Sep 18 21:41:23 devstack sudo[96099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:41:24 devstack sudo[96099]: pam_unix(sudo:session): session closed for user root Sep 18 21:41:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ca9c2577-7b5d-421f-827e-37ac74fba44c tempest-VolumesTransfersV355Test-863879179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3f2b37b7-9993-496d-b5c8-bdc5f226bcbe" returned: 0 in 0.293s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:41:24 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-ca9c2577-7b5d-421f-827e-37ac74fba44c tempest-VolumesTransfersV355Test-863879179 None] Lock "cinder-quobyte-3f2b37b7-9993-496d-b5c8-bdc5f226bcbe" released by "delete_volume" :: held 0.753s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:41:24 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-ca9c2577-7b5d-421f-827e-37ac74fba44c tempest-VolumesTransfersV355Test-863879179 None] Created reservations ['ee4eaeeb-1544-4128-806a-079f539e92f3', 'd6952844-4239-4a2c-a679-7af6ef536849', '7190b265-8674-43a0-8196-7768be776749', '15b5249b-52d2-4d69-bcf5-605e45200cd6'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:41:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-ca9c2577-7b5d-421f-827e-37ac74fba44c tempest-VolumesTransfersV355Test-863879179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:41:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-ca9c2577-7b5d-421f-827e-37ac74fba44c tempest-VolumesTransfersV355Test-863879179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:41:24 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-ca9c2577-7b5d-421f-827e-37ac74fba44c tempest-VolumesTransfersV355Test-863879179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:41:24 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-ca9c2577-7b5d-421f-827e-37ac74fba44c tempest-VolumesTransfersV355Test-863879179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:41:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-ca9c2577-7b5d-421f-827e-37ac74fba44c tempest-VolumesTransfersV355Test-863879179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:41:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ca9c2577-7b5d-421f-827e-37ac74fba44c tempest-VolumesTransfersV355Test-863879179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:41:24 devstack sudo[96102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:41:24 devstack sudo[96102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:41:24 devstack sudo[96102]: pam_unix(sudo:session): session closed for user root Sep 18 21:41:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ca9c2577-7b5d-421f-827e-37ac74fba44c tempest-VolumesTransfersV355Test-863879179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.314s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:41:24 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-ca9c2577-7b5d-421f-827e-37ac74fba44c tempest-VolumesTransfersV355Test-863879179 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:41:24 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-ca9c2577-7b5d-421f-827e-37ac74fba44c tempest-VolumesTransfersV355Test-863879179 None] Deleted volume successfully. Sep 18 21:41:24 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-ca9c2577-7b5d-421f-827e-37ac74fba44c tempest-VolumesTransfersV355Test-863879179 None] Lock "cinder-3f2b37b7-9993-496d-b5c8-bdc5f226bcbe-delete_volume" released by "delete_volume" :: held 1.411s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:41:28 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff46611c-cf63-49d8-afba-968256067eae tempest-AbsoluteLimitsTests-639510160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:41:28 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ff46611c-cf63-49d8-afba-968256067eae tempest-AbsoluteLimitsTests-639510160 None] Flow 'volume_create_manager' (cdc659fa-83a2-4955-89d2-814749abe36f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:41:28 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ff46611c-cf63-49d8-afba-968256067eae tempest-AbsoluteLimitsTests-639510160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3c46c65-390e-4986-820a-e78c8b252059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:41:28 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ff46611c-cf63-49d8-afba-968256067eae tempest-AbsoluteLimitsTests-639510160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3c46c65-390e-4986-820a-e78c8b252059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:41:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-682016900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21387c22-7262-4a8f-96ef-dec4f9cce53d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1d5ca228c924e21bf86a94c679f7879',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:41:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:41:28Z,use_quota=True,user_id='e895897073d14ae4a4f80400e21d48e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:41:28 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ff46611c-cf63-49d8-afba-968256067eae tempest-AbsoluteLimitsTests-639510160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b07dd89-1df3-40db-8504-d0f7b2078eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:41:28 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ff46611c-cf63-49d8-afba-968256067eae tempest-AbsoluteLimitsTests-639510160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b07dd89-1df3-40db-8504-d0f7b2078eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:41:28 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ff46611c-cf63-49d8-afba-968256067eae tempest-AbsoluteLimitsTests-639510160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d9ecb3d-81ec-44ad-abc0-9f83772e4222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:41:28 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ff46611c-cf63-49d8-afba-968256067eae tempest-AbsoluteLimitsTests-639510160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d9ecb3d-81ec-44ad-abc0-9f83772e4222) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21387c22-7262-4a8f-96ef-dec4f9cce53d', 'volume_name': 'volume-21387c22-7262-4a8f-96ef-dec4f9cce53d', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:41:28 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ff46611c-cf63-49d8-afba-968256067eae tempest-AbsoluteLimitsTests-639510160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c73ee44-cfed-4159-b7bc-ce6c08491e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:41:28 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ff46611c-cf63-49d8-afba-968256067eae tempest-AbsoluteLimitsTests-639510160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c73ee44-cfed-4159-b7bc-ce6c08491e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:41:28 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ff46611c-cf63-49d8-afba-968256067eae tempest-AbsoluteLimitsTests-639510160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6e0a61c-e67f-42f9-85d9-c4cbfdd5ad7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:41:28 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-ff46611c-cf63-49d8-afba-968256067eae tempest-AbsoluteLimitsTests-639510160 None] Volume 21387c22-7262-4a8f-96ef-dec4f9cce53d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21387c22-7262-4a8f-96ef-dec4f9cce53d', 'volume_size': 1} Sep 18 21:41:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-ff46611c-cf63-49d8-afba-968256067eae tempest-AbsoluteLimitsTests-639510160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:41:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-ff46611c-cf63-49d8-afba-968256067eae tempest-AbsoluteLimitsTests-639510160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:41:28 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-ff46611c-cf63-49d8-afba-968256067eae tempest-AbsoluteLimitsTests-639510160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:41:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-682016900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21387c22-7262-4a8f-96ef-dec4f9cce53d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1d5ca228c924e21bf86a94c679f7879',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:41:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:41:28Z,use_quota=True,user_id='e895897073d14ae4a4f80400e21d48e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:41:28 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-ff46611c-cf63-49d8-afba-968256067eae tempest-AbsoluteLimitsTests-639510160 None] Creating volume 21387c22-7262-4a8f-96ef-dec4f9cce53d {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:41:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-ff46611c-cf63-49d8-afba-968256067eae tempest-AbsoluteLimitsTests-639510160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:41:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-ff46611c-cf63-49d8-afba-968256067eae tempest-AbsoluteLimitsTests-639510160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:41:28 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-ff46611c-cf63-49d8-afba-968256067eae tempest-AbsoluteLimitsTests-639510160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:41:28 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-ff46611c-cf63-49d8-afba-968256067eae tempest-AbsoluteLimitsTests-639510160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:41:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-ff46611c-cf63-49d8-afba-968256067eae tempest-AbsoluteLimitsTests-639510160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:41:28 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-ff46611c-cf63-49d8-afba-968256067eae tempest-AbsoluteLimitsTests-639510160 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:41:28 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-ff46611c-cf63-49d8-afba-968256067eae tempest-AbsoluteLimitsTests-639510160 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:41:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ff46611c-cf63-49d8-afba-968256067eae tempest-AbsoluteLimitsTests-639510160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-21387c22-7262-4a8f-96ef-dec4f9cce53d 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:41:28 devstack sudo[96111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-21387c22-7262-4a8f-96ef-dec4f9cce53d 1073741824 Sep 18 21:41:28 devstack sudo[96111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:41:29 devstack sudo[96111]: pam_unix(sudo:session): session closed for user root Sep 18 21:41:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ff46611c-cf63-49d8-afba-968256067eae tempest-AbsoluteLimitsTests-639510160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-21387c22-7262-4a8f-96ef-dec4f9cce53d 1073741824" returned: 0 in 0.556s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:41:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ff46611c-cf63-49d8-afba-968256067eae tempest-AbsoluteLimitsTests-639510160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-21387c22-7262-4a8f-96ef-dec4f9cce53d {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:41:29 devstack sudo[96117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-21387c22-7262-4a8f-96ef-dec4f9cce53d Sep 18 21:41:29 devstack sudo[96117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:41:29 devstack sudo[96117]: pam_unix(sudo:session): session closed for user root Sep 18 21:41:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ff46611c-cf63-49d8-afba-968256067eae tempest-AbsoluteLimitsTests-639510160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-21387c22-7262-4a8f-96ef-dec4f9cce53d" returned: 0 in 0.318s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:41:29 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-ff46611c-cf63-49d8-afba-968256067eae tempest-AbsoluteLimitsTests-639510160 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:41:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-ff46611c-cf63-49d8-afba-968256067eae tempest-AbsoluteLimitsTests-639510160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:41:29 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ff46611c-cf63-49d8-afba-968256067eae tempest-AbsoluteLimitsTests-639510160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6e0a61c-e67f-42f9-85d9-c4cbfdd5ad7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21387c22-7262-4a8f-96ef-dec4f9cce53d', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:41:29 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ff46611c-cf63-49d8-afba-968256067eae tempest-AbsoluteLimitsTests-639510160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab7da739-614d-4e59-8f21-531c99a014a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:41:29 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-ff46611c-cf63-49d8-afba-968256067eae tempest-AbsoluteLimitsTests-639510160 None] Volume volume-21387c22-7262-4a8f-96ef-dec4f9cce53d (21387c22-7262-4a8f-96ef-dec4f9cce53d): created successfully Sep 18 21:41:29 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ff46611c-cf63-49d8-afba-968256067eae tempest-AbsoluteLimitsTests-639510160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab7da739-614d-4e59-8f21-531c99a014a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:41:29 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ff46611c-cf63-49d8-afba-968256067eae tempest-AbsoluteLimitsTests-639510160 None] Flow 'volume_create_manager' (cdc659fa-83a2-4955-89d2-814749abe36f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:41:29 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-ff46611c-cf63-49d8-afba-968256067eae tempest-AbsoluteLimitsTests-639510160 None] Created volume successfully. Sep 18 21:41:31 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-7bd45dfc-ba5d-4b5a-bb03-5097b273200a tempest-AbsoluteLimitsTests-639510160 None] Acquiring lock "cinder-21387c22-7262-4a8f-96ef-dec4f9cce53d-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:41:31 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-7bd45dfc-ba5d-4b5a-bb03-5097b273200a tempest-AbsoluteLimitsTests-639510160 None] Lock "cinder-21387c22-7262-4a8f-96ef-dec4f9cce53d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:41:31 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-7bd45dfc-ba5d-4b5a-bb03-5097b273200a tempest-AbsoluteLimitsTests-639510160 None] Acquiring lock "cinder-quobyte-21387c22-7262-4a8f-96ef-dec4f9cce53d" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:41:31 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-7bd45dfc-ba5d-4b5a-bb03-5097b273200a tempest-AbsoluteLimitsTests-639510160 None] Lock "cinder-quobyte-21387c22-7262-4a8f-96ef-dec4f9cce53d" acquired by "delete_volume" :: waited 0.026s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:41:31 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc0895b-24b9-40d0-b5ef-e04c7987fd27]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:41:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-7bd45dfc-ba5d-4b5a-bb03-5097b273200a tempest-AbsoluteLimitsTests-639510160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-21387c22-7262-4a8f-96ef-dec4f9cce53d {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:41:31 devstack sudo[96124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-21387c22-7262-4a8f-96ef-dec4f9cce53d Sep 18 21:41:31 devstack sudo[96124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:41:32 devstack sudo[96124]: pam_unix(sudo:session): session closed for user root Sep 18 21:41:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-7bd45dfc-ba5d-4b5a-bb03-5097b273200a tempest-AbsoluteLimitsTests-639510160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-21387c22-7262-4a8f-96ef-dec4f9cce53d" returned: 0 in 0.584s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:41:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-7bd45dfc-ba5d-4b5a-bb03-5097b273200a tempest-AbsoluteLimitsTests-639510160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-21387c22-7262-4a8f-96ef-dec4f9cce53d {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:41:32 devstack sudo[96136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-21387c22-7262-4a8f-96ef-dec4f9cce53d Sep 18 21:41:32 devstack sudo[96136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:41:32 devstack sudo[96136]: pam_unix(sudo:session): session closed for user root Sep 18 21:41:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-7bd45dfc-ba5d-4b5a-bb03-5097b273200a tempest-AbsoluteLimitsTests-639510160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-21387c22-7262-4a8f-96ef-dec4f9cce53d" returned: 0 in 0.527s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:41:32 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-7bd45dfc-ba5d-4b5a-bb03-5097b273200a tempest-AbsoluteLimitsTests-639510160 None] Lock "cinder-quobyte-21387c22-7262-4a8f-96ef-dec4f9cce53d" released by "delete_volume" :: held 1.212s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:41:32 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-7bd45dfc-ba5d-4b5a-bb03-5097b273200a tempest-AbsoluteLimitsTests-639510160 None] Created reservations ['c3ff79e3-11da-4ab2-989d-ca77da6fdcdc', 'ab83f9fe-54c8-4446-b786-661657727305', '198c5852-191f-46d0-a038-f3ba3affeca6', '36b8292d-0740-4185-a02d-3b42a62eaee2'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:41:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-7bd45dfc-ba5d-4b5a-bb03-5097b273200a tempest-AbsoluteLimitsTests-639510160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:41:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-7bd45dfc-ba5d-4b5a-bb03-5097b273200a tempest-AbsoluteLimitsTests-639510160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:41:32 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-7bd45dfc-ba5d-4b5a-bb03-5097b273200a tempest-AbsoluteLimitsTests-639510160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:41:32 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-7bd45dfc-ba5d-4b5a-bb03-5097b273200a tempest-AbsoluteLimitsTests-639510160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:41:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-7bd45dfc-ba5d-4b5a-bb03-5097b273200a tempest-AbsoluteLimitsTests-639510160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:41:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-7bd45dfc-ba5d-4b5a-bb03-5097b273200a tempest-AbsoluteLimitsTests-639510160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:41:32 devstack sudo[96148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:41:32 devstack sudo[96148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:41:33 devstack sudo[96148]: pam_unix(sudo:session): session closed for user root Sep 18 21:41:33 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-7bd45dfc-ba5d-4b5a-bb03-5097b273200a tempest-AbsoluteLimitsTests-639510160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.379s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:41:33 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-7bd45dfc-ba5d-4b5a-bb03-5097b273200a tempest-AbsoluteLimitsTests-639510160 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:41:33 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-7bd45dfc-ba5d-4b5a-bb03-5097b273200a tempest-AbsoluteLimitsTests-639510160 None] Deleted volume successfully. Sep 18 21:41:33 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-7bd45dfc-ba5d-4b5a-bb03-5097b273200a tempest-AbsoluteLimitsTests-639510160 None] Lock "cinder-21387c22-7262-4a8f-96ef-dec4f9cce53d-delete_volume" released by "delete_volume" :: held 1.957s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:41:42 devstack cinder-volume[86136]: DEBUG dbcounter [-] [86136] Writing DB stats cinder:SELECT=76,cinder:UPDATE=106,cinder:INSERT=20,cinder:DELETE=5 {{(pid=86136) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 21:41:43 devstack cinder-volume[86136]: DEBUG dbcounter [-] [86136] Writing DB stats cinder:SELECT=76,cinder:INSERT=25,cinder:UPDATE=79,cinder:DELETE=11 {{(pid=86136) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 21:41:43 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-6573ca38-c901-4ca7-a40a-c7174751f6e6 tempest-VolumesListTestJSON-705065235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:41:43 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6573ca38-c901-4ca7-a40a-c7174751f6e6 tempest-VolumesListTestJSON-705065235 None] Flow 'volume_create_manager' (5abe1074-3a5d-4516-a9b7-6bfa68671ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:41:43 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6573ca38-c901-4ca7-a40a-c7174751f6e6 tempest-VolumesListTestJSON-705065235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55bbe0c3-ce36-468d-9d8e-4e21ed57b800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:41:43 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6573ca38-c901-4ca7-a40a-c7174751f6e6 tempest-VolumesListTestJSON-705065235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55bbe0c3-ce36-468d-9d8e-4e21ed57b800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:41:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-704683587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=038e1b8b-b56e-4161-b4d3-1569d7cb9b52,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a8b6bc3daa744ff3862cdbfd3c65655d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:41:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:41:43Z,use_quota=True,user_id='e3ada659b6154dd9a920cbb809f9e45c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:41:43 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6573ca38-c901-4ca7-a40a-c7174751f6e6 tempest-VolumesListTestJSON-705065235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef0cc5ec-f840-4a22-b044-d6e9532eb092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:41:43 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6573ca38-c901-4ca7-a40a-c7174751f6e6 tempest-VolumesListTestJSON-705065235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef0cc5ec-f840-4a22-b044-d6e9532eb092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:41:43 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6573ca38-c901-4ca7-a40a-c7174751f6e6 tempest-VolumesListTestJSON-705065235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (625f8447-c86e-4e58-be0a-3dc051c38085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:41:43 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6573ca38-c901-4ca7-a40a-c7174751f6e6 tempest-VolumesListTestJSON-705065235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (625f8447-c86e-4e58-be0a-3dc051c38085) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '038e1b8b-b56e-4161-b4d3-1569d7cb9b52', 'volume_name': 'volume-038e1b8b-b56e-4161-b4d3-1569d7cb9b52', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:41:43 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6573ca38-c901-4ca7-a40a-c7174751f6e6 tempest-VolumesListTestJSON-705065235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06dbf538-26c4-4bb6-8cad-c5228301dafa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:41:43 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6573ca38-c901-4ca7-a40a-c7174751f6e6 tempest-VolumesListTestJSON-705065235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06dbf538-26c4-4bb6-8cad-c5228301dafa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:41:43 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6573ca38-c901-4ca7-a40a-c7174751f6e6 tempest-VolumesListTestJSON-705065235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78c91620-4ca4-4d8b-9768-0d12bdd48a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:41:43 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-6573ca38-c901-4ca7-a40a-c7174751f6e6 tempest-VolumesListTestJSON-705065235 None] Volume 038e1b8b-b56e-4161-b4d3-1569d7cb9b52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-038e1b8b-b56e-4161-b4d3-1569d7cb9b52', 'volume_size': 1} Sep 18 21:41:43 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6573ca38-c901-4ca7-a40a-c7174751f6e6 tempest-VolumesListTestJSON-705065235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:41:43 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6573ca38-c901-4ca7-a40a-c7174751f6e6 tempest-VolumesListTestJSON-705065235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:41:43 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-6573ca38-c901-4ca7-a40a-c7174751f6e6 tempest-VolumesListTestJSON-705065235 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:41:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-704683587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=038e1b8b-b56e-4161-b4d3-1569d7cb9b52,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a8b6bc3daa744ff3862cdbfd3c65655d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:41:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:41:43Z,use_quota=True,user_id='e3ada659b6154dd9a920cbb809f9e45c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:41:43 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-6573ca38-c901-4ca7-a40a-c7174751f6e6 tempest-VolumesListTestJSON-705065235 None] Creating volume 038e1b8b-b56e-4161-b4d3-1569d7cb9b52 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:41:43 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6573ca38-c901-4ca7-a40a-c7174751f6e6 tempest-VolumesListTestJSON-705065235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:41:43 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6573ca38-c901-4ca7-a40a-c7174751f6e6 tempest-VolumesListTestJSON-705065235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:41:43 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-6573ca38-c901-4ca7-a40a-c7174751f6e6 tempest-VolumesListTestJSON-705065235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:41:43 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-6573ca38-c901-4ca7-a40a-c7174751f6e6 tempest-VolumesListTestJSON-705065235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:41:43 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6573ca38-c901-4ca7-a40a-c7174751f6e6 tempest-VolumesListTestJSON-705065235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:41:43 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-6573ca38-c901-4ca7-a40a-c7174751f6e6 tempest-VolumesListTestJSON-705065235 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:41:43 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-6573ca38-c901-4ca7-a40a-c7174751f6e6 tempest-VolumesListTestJSON-705065235 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:41:43 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6573ca38-c901-4ca7-a40a-c7174751f6e6 tempest-VolumesListTestJSON-705065235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-038e1b8b-b56e-4161-b4d3-1569d7cb9b52 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:41:43 devstack sudo[96154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-038e1b8b-b56e-4161-b4d3-1569d7cb9b52 1073741824 Sep 18 21:41:43 devstack sudo[96154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:41:44 devstack sudo[96154]: pam_unix(sudo:session): session closed for user root Sep 18 21:41:44 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6573ca38-c901-4ca7-a40a-c7174751f6e6 tempest-VolumesListTestJSON-705065235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-038e1b8b-b56e-4161-b4d3-1569d7cb9b52 1073741824" returned: 0 in 0.601s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:41:44 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6573ca38-c901-4ca7-a40a-c7174751f6e6 tempest-VolumesListTestJSON-705065235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-038e1b8b-b56e-4161-b4d3-1569d7cb9b52 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:41:44 devstack sudo[96160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-038e1b8b-b56e-4161-b4d3-1569d7cb9b52 Sep 18 21:41:44 devstack sudo[96160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:41:44 devstack sudo[96160]: pam_unix(sudo:session): session closed for user root Sep 18 21:41:44 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6573ca38-c901-4ca7-a40a-c7174751f6e6 tempest-VolumesListTestJSON-705065235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-038e1b8b-b56e-4161-b4d3-1569d7cb9b52" returned: 0 in 0.355s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:41:44 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-6573ca38-c901-4ca7-a40a-c7174751f6e6 tempest-VolumesListTestJSON-705065235 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:41:44 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6573ca38-c901-4ca7-a40a-c7174751f6e6 tempest-VolumesListTestJSON-705065235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:41:44 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6573ca38-c901-4ca7-a40a-c7174751f6e6 tempest-VolumesListTestJSON-705065235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78c91620-4ca4-4d8b-9768-0d12bdd48a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-038e1b8b-b56e-4161-b4d3-1569d7cb9b52', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:41:44 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6573ca38-c901-4ca7-a40a-c7174751f6e6 tempest-VolumesListTestJSON-705065235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fb711b3-fb65-432b-884e-b9a4a31ec77a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:41:44 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-6573ca38-c901-4ca7-a40a-c7174751f6e6 tempest-VolumesListTestJSON-705065235 None] Volume volume-038e1b8b-b56e-4161-b4d3-1569d7cb9b52 (038e1b8b-b56e-4161-b4d3-1569d7cb9b52): created successfully Sep 18 21:41:44 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6573ca38-c901-4ca7-a40a-c7174751f6e6 tempest-VolumesListTestJSON-705065235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fb711b3-fb65-432b-884e-b9a4a31ec77a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:41:44 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6573ca38-c901-4ca7-a40a-c7174751f6e6 tempest-VolumesListTestJSON-705065235 None] Flow 'volume_create_manager' (5abe1074-3a5d-4516-a9b7-6bfa68671ec1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:41:44 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-6573ca38-c901-4ca7-a40a-c7174751f6e6 tempest-VolumesListTestJSON-705065235 None] Created volume successfully. Sep 18 21:41:46 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-836b045d-8ab4-4500-9c74-29ec2a52b57f tempest-VolumesListTestJSON-705065235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:41:46 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-836b045d-8ab4-4500-9c74-29ec2a52b57f tempest-VolumesListTestJSON-705065235 None] Flow 'volume_create_manager' (f8f8b116-dc11-40af-833a-e79b205e8c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:41:46 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-836b045d-8ab4-4500-9c74-29ec2a52b57f tempest-VolumesListTestJSON-705065235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bee53da7-907d-4035-9214-a0e94a86f747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:41:46 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-836b045d-8ab4-4500-9c74-29ec2a52b57f tempest-VolumesListTestJSON-705065235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bee53da7-907d-4035-9214-a0e94a86f747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:41:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1004820536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92df38e0-4d14-4a1a-a8fe-ba826f550257,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a8b6bc3daa744ff3862cdbfd3c65655d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:41:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:41:46Z,use_quota=True,user_id='e3ada659b6154dd9a920cbb809f9e45c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:41:46 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-836b045d-8ab4-4500-9c74-29ec2a52b57f tempest-VolumesListTestJSON-705065235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53559e7b-080f-4de3-899c-15fe9226cfde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:41:46 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-836b045d-8ab4-4500-9c74-29ec2a52b57f tempest-VolumesListTestJSON-705065235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53559e7b-080f-4de3-899c-15fe9226cfde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:41:46 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-836b045d-8ab4-4500-9c74-29ec2a52b57f tempest-VolumesListTestJSON-705065235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f30f071-1047-440d-bc85-68dd8fef8401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:41:46 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-836b045d-8ab4-4500-9c74-29ec2a52b57f tempest-VolumesListTestJSON-705065235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f30f071-1047-440d-bc85-68dd8fef8401) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92df38e0-4d14-4a1a-a8fe-ba826f550257', 'volume_name': 'volume-92df38e0-4d14-4a1a-a8fe-ba826f550257', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:41:46 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-836b045d-8ab4-4500-9c74-29ec2a52b57f tempest-VolumesListTestJSON-705065235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c2e4039-fdc9-4fb3-b1c0-bce6b28e0ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:41:46 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-836b045d-8ab4-4500-9c74-29ec2a52b57f tempest-VolumesListTestJSON-705065235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c2e4039-fdc9-4fb3-b1c0-bce6b28e0ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:41:46 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-836b045d-8ab4-4500-9c74-29ec2a52b57f tempest-VolumesListTestJSON-705065235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74bbcd78-e037-44cc-8830-5a4fa58537e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:41:46 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-836b045d-8ab4-4500-9c74-29ec2a52b57f tempest-VolumesListTestJSON-705065235 None] Volume 92df38e0-4d14-4a1a-a8fe-ba826f550257: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92df38e0-4d14-4a1a-a8fe-ba826f550257', 'volume_size': 1} Sep 18 21:41:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-836b045d-8ab4-4500-9c74-29ec2a52b57f tempest-VolumesListTestJSON-705065235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:41:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-836b045d-8ab4-4500-9c74-29ec2a52b57f tempest-VolumesListTestJSON-705065235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:41:46 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-836b045d-8ab4-4500-9c74-29ec2a52b57f tempest-VolumesListTestJSON-705065235 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:41:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1004820536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92df38e0-4d14-4a1a-a8fe-ba826f550257,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a8b6bc3daa744ff3862cdbfd3c65655d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:41:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:41:46Z,use_quota=True,user_id='e3ada659b6154dd9a920cbb809f9e45c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:41:46 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-836b045d-8ab4-4500-9c74-29ec2a52b57f tempest-VolumesListTestJSON-705065235 None] Creating volume 92df38e0-4d14-4a1a-a8fe-ba826f550257 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:41:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-836b045d-8ab4-4500-9c74-29ec2a52b57f tempest-VolumesListTestJSON-705065235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:41:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-836b045d-8ab4-4500-9c74-29ec2a52b57f tempest-VolumesListTestJSON-705065235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:41:46 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-836b045d-8ab4-4500-9c74-29ec2a52b57f tempest-VolumesListTestJSON-705065235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:41:46 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-836b045d-8ab4-4500-9c74-29ec2a52b57f tempest-VolumesListTestJSON-705065235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:41:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-836b045d-8ab4-4500-9c74-29ec2a52b57f tempest-VolumesListTestJSON-705065235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:41:46 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-836b045d-8ab4-4500-9c74-29ec2a52b57f tempest-VolumesListTestJSON-705065235 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:41:46 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-836b045d-8ab4-4500-9c74-29ec2a52b57f tempest-VolumesListTestJSON-705065235 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:41:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-836b045d-8ab4-4500-9c74-29ec2a52b57f tempest-VolumesListTestJSON-705065235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-92df38e0-4d14-4a1a-a8fe-ba826f550257 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:41:46 devstack sudo[96163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-92df38e0-4d14-4a1a-a8fe-ba826f550257 1073741824 Sep 18 21:41:46 devstack sudo[96163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:41:47 devstack sudo[96163]: pam_unix(sudo:session): session closed for user root Sep 18 21:41:47 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-836b045d-8ab4-4500-9c74-29ec2a52b57f tempest-VolumesListTestJSON-705065235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-92df38e0-4d14-4a1a-a8fe-ba826f550257 1073741824" returned: 0 in 0.930s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:41:47 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-836b045d-8ab4-4500-9c74-29ec2a52b57f tempest-VolumesListTestJSON-705065235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-92df38e0-4d14-4a1a-a8fe-ba826f550257 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:41:47 devstack sudo[96210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-92df38e0-4d14-4a1a-a8fe-ba826f550257 Sep 18 21:41:47 devstack sudo[96210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:41:47 devstack sudo[96210]: pam_unix(sudo:session): session closed for user root Sep 18 21:41:47 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-836b045d-8ab4-4500-9c74-29ec2a52b57f tempest-VolumesListTestJSON-705065235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-92df38e0-4d14-4a1a-a8fe-ba826f550257" returned: 0 in 0.614s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:41:47 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-836b045d-8ab4-4500-9c74-29ec2a52b57f tempest-VolumesListTestJSON-705065235 None] <== create_volume: return (1624ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:41:47 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-836b045d-8ab4-4500-9c74-29ec2a52b57f tempest-VolumesListTestJSON-705065235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.627s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:41:48 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-836b045d-8ab4-4500-9c74-29ec2a52b57f tempest-VolumesListTestJSON-705065235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74bbcd78-e037-44cc-8830-5a4fa58537e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92df38e0-4d14-4a1a-a8fe-ba826f550257', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:41:48 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-836b045d-8ab4-4500-9c74-29ec2a52b57f tempest-VolumesListTestJSON-705065235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a7975d9-4e85-4df4-8886-36794b96bc11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:41:48 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-836b045d-8ab4-4500-9c74-29ec2a52b57f tempest-VolumesListTestJSON-705065235 None] Volume volume-92df38e0-4d14-4a1a-a8fe-ba826f550257 (92df38e0-4d14-4a1a-a8fe-ba826f550257): created successfully Sep 18 21:41:48 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-836b045d-8ab4-4500-9c74-29ec2a52b57f tempest-VolumesListTestJSON-705065235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a7975d9-4e85-4df4-8886-36794b96bc11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:41:48 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-836b045d-8ab4-4500-9c74-29ec2a52b57f tempest-VolumesListTestJSON-705065235 None] Flow 'volume_create_manager' (f8f8b116-dc11-40af-833a-e79b205e8c9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:41:48 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-836b045d-8ab4-4500-9c74-29ec2a52b57f tempest-VolumesListTestJSON-705065235 None] Created volume successfully. Sep 18 21:41:49 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-22a4e202-53da-421f-b709-abb6901ef312 tempest-VolumesActionsTest-2137630509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:41:49 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-22a4e202-53da-421f-b709-abb6901ef312 tempest-VolumesActionsTest-2137630509 None] Flow 'volume_create_manager' (2f362b07-d613-45a1-8653-a092d2edfc61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:41:49 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-22a4e202-53da-421f-b709-abb6901ef312 tempest-VolumesActionsTest-2137630509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7df880c-13a7-4a45-84a7-c49753d86f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:41:49 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-22a4e202-53da-421f-b709-abb6901ef312 tempest-VolumesActionsTest-2137630509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7df880c-13a7-4a45-84a7-c49753d86f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:41:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-666682852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d13f471-bb17-42dc-ba2d-ba62328501e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9414b121740d4ad6888309ca1d306eba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:41:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:41:49Z,use_quota=True,user_id='5f77daaec2194e8ca6dbde4d94abd803',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:41:49 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-22a4e202-53da-421f-b709-abb6901ef312 tempest-VolumesActionsTest-2137630509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9bb43e4-2c2f-4aa1-a1a0-77c1cde6dd84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:41:49 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-22a4e202-53da-421f-b709-abb6901ef312 tempest-VolumesActionsTest-2137630509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9bb43e4-2c2f-4aa1-a1a0-77c1cde6dd84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:41:49 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-22a4e202-53da-421f-b709-abb6901ef312 tempest-VolumesActionsTest-2137630509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb728488-edd5-4b32-8dcd-782be73b9dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:41:49 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-22a4e202-53da-421f-b709-abb6901ef312 tempest-VolumesActionsTest-2137630509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb728488-edd5-4b32-8dcd-782be73b9dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d13f471-bb17-42dc-ba2d-ba62328501e6', 'volume_name': 'volume-7d13f471-bb17-42dc-ba2d-ba62328501e6', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:41:49 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-22a4e202-53da-421f-b709-abb6901ef312 tempest-VolumesActionsTest-2137630509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5205fd40-c8a1-4c77-b65a-c10e74efc16c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:41:49 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-22a4e202-53da-421f-b709-abb6901ef312 tempest-VolumesActionsTest-2137630509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5205fd40-c8a1-4c77-b65a-c10e74efc16c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:41:49 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-22a4e202-53da-421f-b709-abb6901ef312 tempest-VolumesActionsTest-2137630509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6da122c-e1fc-4abe-8f13-a70614dbad57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:41:49 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-22a4e202-53da-421f-b709-abb6901ef312 tempest-VolumesActionsTest-2137630509 None] Volume 7d13f471-bb17-42dc-ba2d-ba62328501e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d13f471-bb17-42dc-ba2d-ba62328501e6', 'volume_size': 1} Sep 18 21:41:49 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-22a4e202-53da-421f-b709-abb6901ef312 tempest-VolumesActionsTest-2137630509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:41:49 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-22a4e202-53da-421f-b709-abb6901ef312 tempest-VolumesActionsTest-2137630509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:41:49 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-22a4e202-53da-421f-b709-abb6901ef312 tempest-VolumesActionsTest-2137630509 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:41:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-666682852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d13f471-bb17-42dc-ba2d-ba62328501e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9414b121740d4ad6888309ca1d306eba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:41:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:41:49Z,use_quota=True,user_id='5f77daaec2194e8ca6dbde4d94abd803',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:41:49 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-22a4e202-53da-421f-b709-abb6901ef312 tempest-VolumesActionsTest-2137630509 None] Creating volume 7d13f471-bb17-42dc-ba2d-ba62328501e6 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:41:49 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-22a4e202-53da-421f-b709-abb6901ef312 tempest-VolumesActionsTest-2137630509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:41:49 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-22a4e202-53da-421f-b709-abb6901ef312 tempest-VolumesActionsTest-2137630509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:41:49 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-22a4e202-53da-421f-b709-abb6901ef312 tempest-VolumesActionsTest-2137630509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:41:49 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-22a4e202-53da-421f-b709-abb6901ef312 tempest-VolumesActionsTest-2137630509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:41:49 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-22a4e202-53da-421f-b709-abb6901ef312 tempest-VolumesActionsTest-2137630509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:41:49 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-22a4e202-53da-421f-b709-abb6901ef312 tempest-VolumesActionsTest-2137630509 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:41:49 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-22a4e202-53da-421f-b709-abb6901ef312 tempest-VolumesActionsTest-2137630509 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:41:49 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-22a4e202-53da-421f-b709-abb6901ef312 tempest-VolumesActionsTest-2137630509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7d13f471-bb17-42dc-ba2d-ba62328501e6 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:41:49 devstack sudo[96243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7d13f471-bb17-42dc-ba2d-ba62328501e6 1073741824 Sep 18 21:41:49 devstack sudo[96243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:41:49 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a12eb50-c084-4678-a882-707662475b48 tempest-VolumesListTestJSON-705065235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:41:50 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6a12eb50-c084-4678-a882-707662475b48 tempest-VolumesListTestJSON-705065235 None] Flow 'volume_create_manager' (1d8d15c3-f2cc-406c-a869-8aee977f9a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:41:50 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6a12eb50-c084-4678-a882-707662475b48 tempest-VolumesListTestJSON-705065235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (971e349c-079b-41b3-9b28-b3fa7dcccd1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:41:50 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6a12eb50-c084-4678-a882-707662475b48 tempest-VolumesListTestJSON-705065235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (971e349c-079b-41b3-9b28-b3fa7dcccd1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:41:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1084732747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7687243-8671-4a09-9089-515490d14198,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a8b6bc3daa744ff3862cdbfd3c65655d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:41:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:41:50Z,use_quota=True,user_id='e3ada659b6154dd9a920cbb809f9e45c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:41:50 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6a12eb50-c084-4678-a882-707662475b48 tempest-VolumesListTestJSON-705065235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71c23eea-02de-4dcb-b533-98316fbb59d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:41:50 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6a12eb50-c084-4678-a882-707662475b48 tempest-VolumesListTestJSON-705065235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71c23eea-02de-4dcb-b533-98316fbb59d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:41:50 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6a12eb50-c084-4678-a882-707662475b48 tempest-VolumesListTestJSON-705065235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (836252e4-3c55-472c-a0e7-1f5ae5839ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:41:50 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6a12eb50-c084-4678-a882-707662475b48 tempest-VolumesListTestJSON-705065235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (836252e4-3c55-472c-a0e7-1f5ae5839ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7687243-8671-4a09-9089-515490d14198', 'volume_name': 'volume-b7687243-8671-4a09-9089-515490d14198', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:41:50 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6a12eb50-c084-4678-a882-707662475b48 tempest-VolumesListTestJSON-705065235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1275f814-592f-4f47-8f2f-1b491e3b2168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:41:50 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6a12eb50-c084-4678-a882-707662475b48 tempest-VolumesListTestJSON-705065235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1275f814-592f-4f47-8f2f-1b491e3b2168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:41:50 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6a12eb50-c084-4678-a882-707662475b48 tempest-VolumesListTestJSON-705065235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d605262d-50b0-4a13-a5d4-6447e8a16862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:41:50 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-6a12eb50-c084-4678-a882-707662475b48 tempest-VolumesListTestJSON-705065235 None] Volume b7687243-8671-4a09-9089-515490d14198: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7687243-8671-4a09-9089-515490d14198', 'volume_size': 1} Sep 18 21:41:50 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6a12eb50-c084-4678-a882-707662475b48 tempest-VolumesListTestJSON-705065235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:41:50 devstack sudo[96243]: pam_unix(sudo:session): session closed for user root Sep 18 21:41:50 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-22a4e202-53da-421f-b709-abb6901ef312 tempest-VolumesActionsTest-2137630509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7d13f471-bb17-42dc-ba2d-ba62328501e6 1073741824" returned: 0 in 0.879s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:41:50 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-22a4e202-53da-421f-b709-abb6901ef312 tempest-VolumesActionsTest-2137630509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7d13f471-bb17-42dc-ba2d-ba62328501e6 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:41:50 devstack sudo[96251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7d13f471-bb17-42dc-ba2d-ba62328501e6 Sep 18 21:41:50 devstack sudo[96251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:41:50 devstack sudo[96251]: pam_unix(sudo:session): session closed for user root Sep 18 21:41:50 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-22a4e202-53da-421f-b709-abb6901ef312 tempest-VolumesActionsTest-2137630509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7d13f471-bb17-42dc-ba2d-ba62328501e6" returned: 0 in 0.371s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:41:50 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-22a4e202-53da-421f-b709-abb6901ef312 tempest-VolumesActionsTest-2137630509 None] <== create_volume: return (1377ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:41:50 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-22a4e202-53da-421f-b709-abb6901ef312 tempest-VolumesActionsTest-2137630509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.385s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:41:50 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6a12eb50-c084-4678-a882-707662475b48 tempest-VolumesListTestJSON-705065235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.822s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:41:50 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-6a12eb50-c084-4678-a882-707662475b48 tempest-VolumesListTestJSON-705065235 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:41:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1084732747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7687243-8671-4a09-9089-515490d14198,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a8b6bc3daa744ff3862cdbfd3c65655d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:41:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:41:50Z,use_quota=True,user_id='e3ada659b6154dd9a920cbb809f9e45c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:41:50 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-6a12eb50-c084-4678-a882-707662475b48 tempest-VolumesListTestJSON-705065235 None] Creating volume b7687243-8671-4a09-9089-515490d14198 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:41:50 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6a12eb50-c084-4678-a882-707662475b48 tempest-VolumesListTestJSON-705065235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:41:50 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6a12eb50-c084-4678-a882-707662475b48 tempest-VolumesListTestJSON-705065235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:41:50 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-6a12eb50-c084-4678-a882-707662475b48 tempest-VolumesListTestJSON-705065235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:41:50 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-6a12eb50-c084-4678-a882-707662475b48 tempest-VolumesListTestJSON-705065235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:41:50 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6a12eb50-c084-4678-a882-707662475b48 tempest-VolumesListTestJSON-705065235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:41:50 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-6a12eb50-c084-4678-a882-707662475b48 tempest-VolumesListTestJSON-705065235 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:41:50 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-6a12eb50-c084-4678-a882-707662475b48 tempest-VolumesListTestJSON-705065235 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:41:50 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6a12eb50-c084-4678-a882-707662475b48 tempest-VolumesListTestJSON-705065235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7687243-8671-4a09-9089-515490d14198 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:41:51 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-22a4e202-53da-421f-b709-abb6901ef312 tempest-VolumesActionsTest-2137630509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6da122c-e1fc-4abe-8f13-a70614dbad57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d13f471-bb17-42dc-ba2d-ba62328501e6', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:41:51 devstack sudo[96254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7687243-8671-4a09-9089-515490d14198 1073741824 Sep 18 21:41:51 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-22a4e202-53da-421f-b709-abb6901ef312 tempest-VolumesActionsTest-2137630509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a874303-66c0-4be7-b8a0-701b715c1055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:41:51 devstack sudo[96254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:41:51 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-22a4e202-53da-421f-b709-abb6901ef312 tempest-VolumesActionsTest-2137630509 None] Volume volume-7d13f471-bb17-42dc-ba2d-ba62328501e6 (7d13f471-bb17-42dc-ba2d-ba62328501e6): created successfully Sep 18 21:41:51 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-22a4e202-53da-421f-b709-abb6901ef312 tempest-VolumesActionsTest-2137630509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a874303-66c0-4be7-b8a0-701b715c1055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:41:51 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-22a4e202-53da-421f-b709-abb6901ef312 tempest-VolumesActionsTest-2137630509 None] Flow 'volume_create_manager' (2f362b07-d613-45a1-8653-a092d2edfc61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:41:51 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-22a4e202-53da-421f-b709-abb6901ef312 tempest-VolumesActionsTest-2137630509 None] Created volume successfully. Sep 18 21:41:51 devstack sudo[96254]: pam_unix(sudo:session): session closed for user root Sep 18 21:41:51 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6a12eb50-c084-4678-a882-707662475b48 tempest-VolumesListTestJSON-705065235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7687243-8671-4a09-9089-515490d14198 1073741824" returned: 0 in 0.928s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:41:51 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6a12eb50-c084-4678-a882-707662475b48 tempest-VolumesListTestJSON-705065235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7687243-8671-4a09-9089-515490d14198 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:41:51 devstack sudo[96260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7687243-8671-4a09-9089-515490d14198 Sep 18 21:41:51 devstack sudo[96260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:41:52 devstack sudo[96260]: pam_unix(sudo:session): session closed for user root Sep 18 21:41:52 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6a12eb50-c084-4678-a882-707662475b48 tempest-VolumesListTestJSON-705065235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7687243-8671-4a09-9089-515490d14198" returned: 0 in 0.358s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:41:52 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-6a12eb50-c084-4678-a882-707662475b48 tempest-VolumesListTestJSON-705065235 None] <== create_volume: return (1351ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:41:52 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6a12eb50-c084-4678-a882-707662475b48 tempest-VolumesListTestJSON-705065235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.355s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:41:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6a12eb50-c084-4678-a882-707662475b48 tempest-VolumesListTestJSON-705065235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d605262d-50b0-4a13-a5d4-6447e8a16862) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7687243-8671-4a09-9089-515490d14198', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:41:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6a12eb50-c084-4678-a882-707662475b48 tempest-VolumesListTestJSON-705065235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a8e0ca8-181e-4920-b702-0dda261c0396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:41:52 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-6a12eb50-c084-4678-a882-707662475b48 tempest-VolumesListTestJSON-705065235 None] Volume volume-b7687243-8671-4a09-9089-515490d14198 (b7687243-8671-4a09-9089-515490d14198): created successfully Sep 18 21:41:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6a12eb50-c084-4678-a882-707662475b48 tempest-VolumesListTestJSON-705065235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a8e0ca8-181e-4920-b702-0dda261c0396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:41:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6a12eb50-c084-4678-a882-707662475b48 tempest-VolumesListTestJSON-705065235 None] Flow 'volume_create_manager' (1d8d15c3-f2cc-406c-a869-8aee977f9a07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:41:52 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-6a12eb50-c084-4678-a882-707662475b48 tempest-VolumesListTestJSON-705065235 None] Created volume successfully. Sep 18 21:41:54 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-84df4dc8-d52e-45fa-a847-d5ef908f8817 tempest-TestServerVolumeAttachmentScenario-735605229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:41:54 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-84df4dc8-d52e-45fa-a847-d5ef908f8817 tempest-TestServerVolumeAttachmentScenario-735605229 None] Flow 'volume_create_manager' (07b34416-f792-44b0-8030-6ee72521b3c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:41:54 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-84df4dc8-d52e-45fa-a847-d5ef908f8817 tempest-TestServerVolumeAttachmentScenario-735605229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d454d53a-0e8c-43a6-a743-978e554513d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:41:54 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-84df4dc8-d52e-45fa-a847-d5ef908f8817 tempest-TestServerVolumeAttachmentScenario-735605229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d454d53a-0e8c-43a6-a743-978e554513d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:41:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1475949094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfeb9879-d81d-43b7-8ecf-bb45599f7db4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff6df63eb6784f52907ca4a8b8eed3bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:41:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:41:55Z,use_quota=True,user_id='2fea4f7baaec4d16b59f82ce07843f46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:41:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-84df4dc8-d52e-45fa-a847-d5ef908f8817 tempest-TestServerVolumeAttachmentScenario-735605229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (034caede-85fb-4351-a8bb-3718a3783f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:41:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-84df4dc8-d52e-45fa-a847-d5ef908f8817 tempest-TestServerVolumeAttachmentScenario-735605229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (034caede-85fb-4351-a8bb-3718a3783f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:41:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-84df4dc8-d52e-45fa-a847-d5ef908f8817 tempest-TestServerVolumeAttachmentScenario-735605229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1792a164-d8ea-4400-bd1f-645b97b54ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:41:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-84df4dc8-d52e-45fa-a847-d5ef908f8817 tempest-TestServerVolumeAttachmentScenario-735605229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1792a164-d8ea-4400-bd1f-645b97b54ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfeb9879-d81d-43b7-8ecf-bb45599f7db4', 'volume_name': 'volume-bfeb9879-d81d-43b7-8ecf-bb45599f7db4', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:41:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-84df4dc8-d52e-45fa-a847-d5ef908f8817 tempest-TestServerVolumeAttachmentScenario-735605229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1abbfd6d-c4bc-4702-8270-e16cf069073b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:41:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-84df4dc8-d52e-45fa-a847-d5ef908f8817 tempest-TestServerVolumeAttachmentScenario-735605229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1abbfd6d-c4bc-4702-8270-e16cf069073b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:41:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-84df4dc8-d52e-45fa-a847-d5ef908f8817 tempest-TestServerVolumeAttachmentScenario-735605229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb600acb-71f5-4f0f-840d-a7f8fa214f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:41:55 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-84df4dc8-d52e-45fa-a847-d5ef908f8817 tempest-TestServerVolumeAttachmentScenario-735605229 None] Volume bfeb9879-d81d-43b7-8ecf-bb45599f7db4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfeb9879-d81d-43b7-8ecf-bb45599f7db4', 'volume_size': 1} Sep 18 21:41:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-84df4dc8-d52e-45fa-a847-d5ef908f8817 tempest-TestServerVolumeAttachmentScenario-735605229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:41:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-84df4dc8-d52e-45fa-a847-d5ef908f8817 tempest-TestServerVolumeAttachmentScenario-735605229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:41:55 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-84df4dc8-d52e-45fa-a847-d5ef908f8817 tempest-TestServerVolumeAttachmentScenario-735605229 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:41:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1475949094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfeb9879-d81d-43b7-8ecf-bb45599f7db4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff6df63eb6784f52907ca4a8b8eed3bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:41:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:41:55Z,use_quota=True,user_id='2fea4f7baaec4d16b59f82ce07843f46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:41:55 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-84df4dc8-d52e-45fa-a847-d5ef908f8817 tempest-TestServerVolumeAttachmentScenario-735605229 None] Creating volume bfeb9879-d81d-43b7-8ecf-bb45599f7db4 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:41:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-84df4dc8-d52e-45fa-a847-d5ef908f8817 tempest-TestServerVolumeAttachmentScenario-735605229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:41:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-84df4dc8-d52e-45fa-a847-d5ef908f8817 tempest-TestServerVolumeAttachmentScenario-735605229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:41:55 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-84df4dc8-d52e-45fa-a847-d5ef908f8817 tempest-TestServerVolumeAttachmentScenario-735605229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:41:55 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-84df4dc8-d52e-45fa-a847-d5ef908f8817 tempest-TestServerVolumeAttachmentScenario-735605229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:41:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-84df4dc8-d52e-45fa-a847-d5ef908f8817 tempest-TestServerVolumeAttachmentScenario-735605229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:41:55 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-84df4dc8-d52e-45fa-a847-d5ef908f8817 tempest-TestServerVolumeAttachmentScenario-735605229 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:41:55 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-84df4dc8-d52e-45fa-a847-d5ef908f8817 tempest-TestServerVolumeAttachmentScenario-735605229 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:41:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-84df4dc8-d52e-45fa-a847-d5ef908f8817 tempest-TestServerVolumeAttachmentScenario-735605229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-bfeb9879-d81d-43b7-8ecf-bb45599f7db4 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:41:55 devstack sudo[96268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-bfeb9879-d81d-43b7-8ecf-bb45599f7db4 1073741824 Sep 18 21:41:55 devstack sudo[96268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:41:55 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1dd65b6-9524-4476-aab5-f7bad30765a2 tempest-TestServerVolumeAttachmentScenario-735605229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:41:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-a1dd65b6-9524-4476-aab5-f7bad30765a2 tempest-TestServerVolumeAttachmentScenario-735605229 None] Flow 'volume_create_manager' (12626fdf-249e-47a8-aeed-aa49f879b380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:41:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-a1dd65b6-9524-4476-aab5-f7bad30765a2 tempest-TestServerVolumeAttachmentScenario-735605229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (259e7e83-e39f-4ca8-96f7-49d27bd2961a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:41:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-a1dd65b6-9524-4476-aab5-f7bad30765a2 tempest-TestServerVolumeAttachmentScenario-735605229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (259e7e83-e39f-4ca8-96f7-49d27bd2961a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:41:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-357084326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0a22dd5-118a-43a0-99e5-0f8f3186a712,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff6df63eb6784f52907ca4a8b8eed3bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:41:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:41:55Z,use_quota=True,user_id='2fea4f7baaec4d16b59f82ce07843f46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:41:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-a1dd65b6-9524-4476-aab5-f7bad30765a2 tempest-TestServerVolumeAttachmentScenario-735605229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5393cf6-78dc-46e0-af1d-5fd9dd857e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:41:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-a1dd65b6-9524-4476-aab5-f7bad30765a2 tempest-TestServerVolumeAttachmentScenario-735605229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5393cf6-78dc-46e0-af1d-5fd9dd857e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:41:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-a1dd65b6-9524-4476-aab5-f7bad30765a2 tempest-TestServerVolumeAttachmentScenario-735605229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cc36588-16cc-4d41-8157-688cad21d296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:41:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-a1dd65b6-9524-4476-aab5-f7bad30765a2 tempest-TestServerVolumeAttachmentScenario-735605229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cc36588-16cc-4d41-8157-688cad21d296) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0a22dd5-118a-43a0-99e5-0f8f3186a712', 'volume_name': 'volume-c0a22dd5-118a-43a0-99e5-0f8f3186a712', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:41:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-a1dd65b6-9524-4476-aab5-f7bad30765a2 tempest-TestServerVolumeAttachmentScenario-735605229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4dbab0b-1b26-4067-8018-c2617d8f881b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:41:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-a1dd65b6-9524-4476-aab5-f7bad30765a2 tempest-TestServerVolumeAttachmentScenario-735605229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4dbab0b-1b26-4067-8018-c2617d8f881b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:41:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-a1dd65b6-9524-4476-aab5-f7bad30765a2 tempest-TestServerVolumeAttachmentScenario-735605229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3634554-d7e5-416f-a4bc-b2ed76d7a714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:41:55 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-a1dd65b6-9524-4476-aab5-f7bad30765a2 tempest-TestServerVolumeAttachmentScenario-735605229 None] Volume c0a22dd5-118a-43a0-99e5-0f8f3186a712: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0a22dd5-118a-43a0-99e5-0f8f3186a712', 'volume_size': 1} Sep 18 21:41:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-a1dd65b6-9524-4476-aab5-f7bad30765a2 tempest-TestServerVolumeAttachmentScenario-735605229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:41:56 devstack sudo[96268]: pam_unix(sudo:session): session closed for user root Sep 18 21:41:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-84df4dc8-d52e-45fa-a847-d5ef908f8817 tempest-TestServerVolumeAttachmentScenario-735605229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-bfeb9879-d81d-43b7-8ecf-bb45599f7db4 1073741824" returned: 0 in 1.014s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:41:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-84df4dc8-d52e-45fa-a847-d5ef908f8817 tempest-TestServerVolumeAttachmentScenario-735605229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-bfeb9879-d81d-43b7-8ecf-bb45599f7db4 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:41:56 devstack sudo[96274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-bfeb9879-d81d-43b7-8ecf-bb45599f7db4 Sep 18 21:41:56 devstack sudo[96274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:41:56 devstack sudo[96274]: pam_unix(sudo:session): session closed for user root Sep 18 21:41:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-84df4dc8-d52e-45fa-a847-d5ef908f8817 tempest-TestServerVolumeAttachmentScenario-735605229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-bfeb9879-d81d-43b7-8ecf-bb45599f7db4" returned: 0 in 0.420s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:41:56 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-84df4dc8-d52e-45fa-a847-d5ef908f8817 tempest-TestServerVolumeAttachmentScenario-735605229 None] <== create_volume: return (1524ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:41:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-84df4dc8-d52e-45fa-a847-d5ef908f8817 tempest-TestServerVolumeAttachmentScenario-735605229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.526s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:41:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-a1dd65b6-9524-4476-aab5-f7bad30765a2 tempest-TestServerVolumeAttachmentScenario-735605229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.111s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:41:56 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-a1dd65b6-9524-4476-aab5-f7bad30765a2 tempest-TestServerVolumeAttachmentScenario-735605229 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:41:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-357084326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0a22dd5-118a-43a0-99e5-0f8f3186a712,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff6df63eb6784f52907ca4a8b8eed3bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:41:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:41:55Z,use_quota=True,user_id='2fea4f7baaec4d16b59f82ce07843f46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:41:56 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-a1dd65b6-9524-4476-aab5-f7bad30765a2 tempest-TestServerVolumeAttachmentScenario-735605229 None] Creating volume c0a22dd5-118a-43a0-99e5-0f8f3186a712 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:41:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-a1dd65b6-9524-4476-aab5-f7bad30765a2 tempest-TestServerVolumeAttachmentScenario-735605229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:41:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-a1dd65b6-9524-4476-aab5-f7bad30765a2 tempest-TestServerVolumeAttachmentScenario-735605229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:41:56 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-a1dd65b6-9524-4476-aab5-f7bad30765a2 tempest-TestServerVolumeAttachmentScenario-735605229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:41:56 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-a1dd65b6-9524-4476-aab5-f7bad30765a2 tempest-TestServerVolumeAttachmentScenario-735605229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:41:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-a1dd65b6-9524-4476-aab5-f7bad30765a2 tempest-TestServerVolumeAttachmentScenario-735605229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:41:56 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-a1dd65b6-9524-4476-aab5-f7bad30765a2 tempest-TestServerVolumeAttachmentScenario-735605229 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:41:56 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-a1dd65b6-9524-4476-aab5-f7bad30765a2 tempest-TestServerVolumeAttachmentScenario-735605229 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:41:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-a1dd65b6-9524-4476-aab5-f7bad30765a2 tempest-TestServerVolumeAttachmentScenario-735605229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c0a22dd5-118a-43a0-99e5-0f8f3186a712 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:41:56 devstack sudo[96277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c0a22dd5-118a-43a0-99e5-0f8f3186a712 1073741824 Sep 18 21:41:56 devstack sudo[96277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:41:56 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-84df4dc8-d52e-45fa-a847-d5ef908f8817 tempest-TestServerVolumeAttachmentScenario-735605229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb600acb-71f5-4f0f-840d-a7f8fa214f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfeb9879-d81d-43b7-8ecf-bb45599f7db4', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:41:56 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-84df4dc8-d52e-45fa-a847-d5ef908f8817 tempest-TestServerVolumeAttachmentScenario-735605229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (679b553e-d5a5-437e-b43b-77fb7d30b9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:41:56 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-84df4dc8-d52e-45fa-a847-d5ef908f8817 tempest-TestServerVolumeAttachmentScenario-735605229 None] Volume volume-bfeb9879-d81d-43b7-8ecf-bb45599f7db4 (bfeb9879-d81d-43b7-8ecf-bb45599f7db4): created successfully Sep 18 21:41:56 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-84df4dc8-d52e-45fa-a847-d5ef908f8817 tempest-TestServerVolumeAttachmentScenario-735605229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (679b553e-d5a5-437e-b43b-77fb7d30b9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:41:56 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-84df4dc8-d52e-45fa-a847-d5ef908f8817 tempest-TestServerVolumeAttachmentScenario-735605229 None] Flow 'volume_create_manager' (07b34416-f792-44b0-8030-6ee72521b3c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:41:56 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-84df4dc8-d52e-45fa-a847-d5ef908f8817 tempest-TestServerVolumeAttachmentScenario-735605229 None] Created volume successfully. Sep 18 21:41:57 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d9221af7-9231-482a-9736-759655d9b9aa tempest-VolumesListTestJSON-705065235 None] Acquiring lock "cinder-b7687243-8671-4a09-9089-515490d14198-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:41:57 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d9221af7-9231-482a-9736-759655d9b9aa tempest-VolumesListTestJSON-705065235 None] Lock "cinder-b7687243-8671-4a09-9089-515490d14198-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:41:57 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d9221af7-9231-482a-9736-759655d9b9aa tempest-VolumesListTestJSON-705065235 None] Acquiring lock "cinder-quobyte-b7687243-8671-4a09-9089-515490d14198" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:41:57 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d9221af7-9231-482a-9736-759655d9b9aa tempest-VolumesListTestJSON-705065235 None] Lock "cinder-quobyte-b7687243-8671-4a09-9089-515490d14198" acquired by "delete_volume" :: waited 0.047s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:41:57 devstack sudo[96277]: pam_unix(sudo:session): session closed for user root Sep 18 21:41:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-a1dd65b6-9524-4476-aab5-f7bad30765a2 tempest-TestServerVolumeAttachmentScenario-735605229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c0a22dd5-118a-43a0-99e5-0f8f3186a712 1073741824" returned: 0 in 1.186s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:41:57 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ddc3da-db61-4c6a-8917-4b67d5a69cc3]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:41:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d9221af7-9231-482a-9736-759655d9b9aa tempest-VolumesListTestJSON-705065235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7687243-8671-4a09-9089-515490d14198 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:41:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-a1dd65b6-9524-4476-aab5-f7bad30765a2 tempest-TestServerVolumeAttachmentScenario-735605229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c0a22dd5-118a-43a0-99e5-0f8f3186a712 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:41:58 devstack sudo[96287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c0a22dd5-118a-43a0-99e5-0f8f3186a712 Sep 18 21:41:58 devstack sudo[96287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:41:58 devstack sudo[96285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7687243-8671-4a09-9089-515490d14198 Sep 18 21:41:58 devstack sudo[96285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:41:58 devstack sudo[96287]: pam_unix(sudo:session): session closed for user root Sep 18 21:41:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-a1dd65b6-9524-4476-aab5-f7bad30765a2 tempest-TestServerVolumeAttachmentScenario-735605229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c0a22dd5-118a-43a0-99e5-0f8f3186a712" returned: 0 in 0.713s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:41:58 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-a1dd65b6-9524-4476-aab5-f7bad30765a2 tempest-TestServerVolumeAttachmentScenario-735605229 None] <== create_volume: return (2048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:41:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-a1dd65b6-9524-4476-aab5-f7bad30765a2 tempest-TestServerVolumeAttachmentScenario-735605229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.055s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:41:58 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-a1dd65b6-9524-4476-aab5-f7bad30765a2 tempest-TestServerVolumeAttachmentScenario-735605229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3634554-d7e5-416f-a4bc-b2ed76d7a714) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0a22dd5-118a-43a0-99e5-0f8f3186a712', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:41:58 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-a1dd65b6-9524-4476-aab5-f7bad30765a2 tempest-TestServerVolumeAttachmentScenario-735605229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8f1ea12-7f24-4cbd-b6cf-363a47417070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:41:58 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-a1dd65b6-9524-4476-aab5-f7bad30765a2 tempest-TestServerVolumeAttachmentScenario-735605229 None] Volume volume-c0a22dd5-118a-43a0-99e5-0f8f3186a712 (c0a22dd5-118a-43a0-99e5-0f8f3186a712): created successfully Sep 18 21:41:58 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-a1dd65b6-9524-4476-aab5-f7bad30765a2 tempest-TestServerVolumeAttachmentScenario-735605229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8f1ea12-7f24-4cbd-b6cf-363a47417070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:41:58 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-a1dd65b6-9524-4476-aab5-f7bad30765a2 tempest-TestServerVolumeAttachmentScenario-735605229 None] Flow 'volume_create_manager' (12626fdf-249e-47a8-aeed-aa49f879b380) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:41:58 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-a1dd65b6-9524-4476-aab5-f7bad30765a2 tempest-TestServerVolumeAttachmentScenario-735605229 None] Created volume successfully. Sep 18 21:41:58 devstack sudo[96285]: pam_unix(sudo:session): session closed for user root Sep 18 21:41:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d9221af7-9231-482a-9736-759655d9b9aa tempest-VolumesListTestJSON-705065235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7687243-8671-4a09-9089-515490d14198" returned: 0 in 0.975s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:41:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d9221af7-9231-482a-9736-759655d9b9aa tempest-VolumesListTestJSON-705065235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7687243-8671-4a09-9089-515490d14198 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:41:58 devstack sudo[96308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7687243-8671-4a09-9089-515490d14198 Sep 18 21:41:58 devstack sudo[96308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:41:59 devstack sudo[96308]: pam_unix(sudo:session): session closed for user root Sep 18 21:41:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d9221af7-9231-482a-9736-759655d9b9aa tempest-VolumesListTestJSON-705065235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7687243-8671-4a09-9089-515490d14198" returned: 0 in 0.493s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:41:59 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d9221af7-9231-482a-9736-759655d9b9aa tempest-VolumesListTestJSON-705065235 None] Lock "cinder-quobyte-b7687243-8671-4a09-9089-515490d14198" released by "delete_volume" :: held 1.576s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:41:59 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-d9221af7-9231-482a-9736-759655d9b9aa tempest-VolumesListTestJSON-705065235 None] Created reservations ['dffffad7-25b2-4fa3-b393-881ce41b2c59', 'bee0d959-b3e5-4057-8d1b-7137578bbedf', 'd1cd6d22-22e0-4f9c-8b42-2385359d8f44', '82a22d27-1419-4842-a509-8a69447372c1'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:41:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-d9221af7-9231-482a-9736-759655d9b9aa tempest-VolumesListTestJSON-705065235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:41:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-d9221af7-9231-482a-9736-759655d9b9aa tempest-VolumesListTestJSON-705065235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:41:59 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-d9221af7-9231-482a-9736-759655d9b9aa tempest-VolumesListTestJSON-705065235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:41:59 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-d9221af7-9231-482a-9736-759655d9b9aa tempest-VolumesListTestJSON-705065235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:41:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-d9221af7-9231-482a-9736-759655d9b9aa tempest-VolumesListTestJSON-705065235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:41:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d9221af7-9231-482a-9736-759655d9b9aa tempest-VolumesListTestJSON-705065235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:41:59 devstack sudo[96319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:41:59 devstack sudo[96319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:42:00 devstack sudo[96319]: pam_unix(sudo:session): session closed for user root Sep 18 21:42:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d9221af7-9231-482a-9736-759655d9b9aa tempest-VolumesListTestJSON-705065235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.384s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:42:00 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-d9221af7-9231-482a-9736-759655d9b9aa tempest-VolumesListTestJSON-705065235 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:42:00 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-d9221af7-9231-482a-9736-759655d9b9aa tempest-VolumesListTestJSON-705065235 None] Deleted volume successfully. Sep 18 21:42:00 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d9221af7-9231-482a-9736-759655d9b9aa tempest-VolumesListTestJSON-705065235 None] Lock "cinder-b7687243-8671-4a09-9089-515490d14198-delete_volume" released by "delete_volume" :: held 2.410s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:42:00 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-88593bdf-5f3c-46a1-b731-0d41c8e00369 tempest-VolumesListTestJSON-705065235 None] Acquiring lock "cinder-92df38e0-4d14-4a1a-a8fe-ba826f550257-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:42:00 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-88593bdf-5f3c-46a1-b731-0d41c8e00369 tempest-VolumesListTestJSON-705065235 None] Lock "cinder-92df38e0-4d14-4a1a-a8fe-ba826f550257-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:42:00 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-88593bdf-5f3c-46a1-b731-0d41c8e00369 tempest-VolumesListTestJSON-705065235 None] Acquiring lock "cinder-quobyte-92df38e0-4d14-4a1a-a8fe-ba826f550257" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:42:00 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-88593bdf-5f3c-46a1-b731-0d41c8e00369 tempest-VolumesListTestJSON-705065235 None] Lock "cinder-quobyte-92df38e0-4d14-4a1a-a8fe-ba826f550257" acquired by "delete_volume" :: waited 0.021s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:42:00 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5228de-465c-44da-a838-f2cb89239dfb]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:42:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-88593bdf-5f3c-46a1-b731-0d41c8e00369 tempest-VolumesListTestJSON-705065235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-92df38e0-4d14-4a1a-a8fe-ba826f550257 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:42:00 devstack sudo[96323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-92df38e0-4d14-4a1a-a8fe-ba826f550257 Sep 18 21:42:00 devstack sudo[96323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:42:00 devstack sudo[96323]: pam_unix(sudo:session): session closed for user root Sep 18 21:42:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-88593bdf-5f3c-46a1-b731-0d41c8e00369 tempest-VolumesListTestJSON-705065235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-92df38e0-4d14-4a1a-a8fe-ba826f550257" returned: 0 in 0.484s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:42:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-88593bdf-5f3c-46a1-b731-0d41c8e00369 tempest-VolumesListTestJSON-705065235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-92df38e0-4d14-4a1a-a8fe-ba826f550257 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:42:00 devstack sudo[96328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-92df38e0-4d14-4a1a-a8fe-ba826f550257 Sep 18 21:42:00 devstack sudo[96328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:42:01 devstack sudo[96328]: pam_unix(sudo:session): session closed for user root Sep 18 21:42:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-88593bdf-5f3c-46a1-b731-0d41c8e00369 tempest-VolumesListTestJSON-705065235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-92df38e0-4d14-4a1a-a8fe-ba826f550257" returned: 0 in 0.527s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:42:01 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-88593bdf-5f3c-46a1-b731-0d41c8e00369 tempest-VolumesListTestJSON-705065235 None] Lock "cinder-quobyte-92df38e0-4d14-4a1a-a8fe-ba826f550257" released by "delete_volume" :: held 1.087s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:42:01 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-88593bdf-5f3c-46a1-b731-0d41c8e00369 tempest-VolumesListTestJSON-705065235 None] Created reservations ['06f8f2af-3150-4a72-afd0-0d2ab82a1585', '64ae91bb-8f8b-4f9d-ba58-83fb7e1046e7', 'b0cb44b0-fa69-403e-b810-0c5f1f0f69e2', '467c978c-7c58-4e7f-9968-8049156d5158'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:42:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-88593bdf-5f3c-46a1-b731-0d41c8e00369 tempest-VolumesListTestJSON-705065235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:42:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-88593bdf-5f3c-46a1-b731-0d41c8e00369 tempest-VolumesListTestJSON-705065235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:42:01 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-88593bdf-5f3c-46a1-b731-0d41c8e00369 tempest-VolumesListTestJSON-705065235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:42:01 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-88593bdf-5f3c-46a1-b731-0d41c8e00369 tempest-VolumesListTestJSON-705065235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:42:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-88593bdf-5f3c-46a1-b731-0d41c8e00369 tempest-VolumesListTestJSON-705065235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:42:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-88593bdf-5f3c-46a1-b731-0d41c8e00369 tempest-VolumesListTestJSON-705065235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:42:01 devstack sudo[96361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:42:01 devstack sudo[96361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:42:02 devstack sudo[96361]: pam_unix(sudo:session): session closed for user root Sep 18 21:42:02 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-88593bdf-5f3c-46a1-b731-0d41c8e00369 tempest-VolumesListTestJSON-705065235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.319s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:42:02 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-88593bdf-5f3c-46a1-b731-0d41c8e00369 tempest-VolumesListTestJSON-705065235 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:42:02 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-88593bdf-5f3c-46a1-b731-0d41c8e00369 tempest-VolumesListTestJSON-705065235 None] Deleted volume successfully. Sep 18 21:42:02 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-88593bdf-5f3c-46a1-b731-0d41c8e00369 tempest-VolumesListTestJSON-705065235 None] Lock "cinder-92df38e0-4d14-4a1a-a8fe-ba826f550257-delete_volume" released by "delete_volume" :: held 1.816s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:42:02 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-9c7a7c32-a1d3-4c9a-b786-bbb8c2b595e9 tempest-VolumesListTestJSON-705065235 None] Acquiring lock "cinder-038e1b8b-b56e-4161-b4d3-1569d7cb9b52-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:42:02 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-9c7a7c32-a1d3-4c9a-b786-bbb8c2b595e9 tempest-VolumesListTestJSON-705065235 None] Lock "cinder-038e1b8b-b56e-4161-b4d3-1569d7cb9b52-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:42:03 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-9c7a7c32-a1d3-4c9a-b786-bbb8c2b595e9 tempest-VolumesListTestJSON-705065235 None] Acquiring lock "cinder-quobyte-038e1b8b-b56e-4161-b4d3-1569d7cb9b52" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:42:03 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-9c7a7c32-a1d3-4c9a-b786-bbb8c2b595e9 tempest-VolumesListTestJSON-705065235 None] Lock "cinder-quobyte-038e1b8b-b56e-4161-b4d3-1569d7cb9b52" acquired by "delete_volume" :: waited 0.036s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:42:03 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe06450-8946-4f18-b9f6-042556a1bcd4]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:42:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9c7a7c32-a1d3-4c9a-b786-bbb8c2b595e9 tempest-VolumesListTestJSON-705065235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-038e1b8b-b56e-4161-b4d3-1569d7cb9b52 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:42:03 devstack sudo[96419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-038e1b8b-b56e-4161-b4d3-1569d7cb9b52 Sep 18 21:42:03 devstack sudo[96419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:42:03 devstack sudo[96419]: pam_unix(sudo:session): session closed for user root Sep 18 21:42:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9c7a7c32-a1d3-4c9a-b786-bbb8c2b595e9 tempest-VolumesListTestJSON-705065235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-038e1b8b-b56e-4161-b4d3-1569d7cb9b52" returned: 0 in 0.842s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:42:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9c7a7c32-a1d3-4c9a-b786-bbb8c2b595e9 tempest-VolumesListTestJSON-705065235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-038e1b8b-b56e-4161-b4d3-1569d7cb9b52 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:42:04 devstack sudo[96439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-038e1b8b-b56e-4161-b4d3-1569d7cb9b52 Sep 18 21:42:04 devstack sudo[96439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:42:04 devstack sudo[96439]: pam_unix(sudo:session): session closed for user root Sep 18 21:42:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9c7a7c32-a1d3-4c9a-b786-bbb8c2b595e9 tempest-VolumesListTestJSON-705065235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-038e1b8b-b56e-4161-b4d3-1569d7cb9b52" returned: 0 in 0.508s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:42:04 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-9c7a7c32-a1d3-4c9a-b786-bbb8c2b595e9 tempest-VolumesListTestJSON-705065235 None] Lock "cinder-quobyte-038e1b8b-b56e-4161-b4d3-1569d7cb9b52" released by "delete_volume" :: held 1.475s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:42:04 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-9c7a7c32-a1d3-4c9a-b786-bbb8c2b595e9 tempest-VolumesListTestJSON-705065235 None] Created reservations ['eb5009db-0f01-41f0-a184-50d1433a1be8', '4bd1b841-265b-4e9b-9913-7c52e8e39177', '27206999-7eaf-4dfa-990b-4decf1e764c0', 'a04d03d3-fd3c-476b-bd6a-5292ea64df60'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:42:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-9c7a7c32-a1d3-4c9a-b786-bbb8c2b595e9 tempest-VolumesListTestJSON-705065235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:42:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-9c7a7c32-a1d3-4c9a-b786-bbb8c2b595e9 tempest-VolumesListTestJSON-705065235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:42:04 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-9c7a7c32-a1d3-4c9a-b786-bbb8c2b595e9 tempest-VolumesListTestJSON-705065235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:42:04 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-9c7a7c32-a1d3-4c9a-b786-bbb8c2b595e9 tempest-VolumesListTestJSON-705065235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:42:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-9c7a7c32-a1d3-4c9a-b786-bbb8c2b595e9 tempest-VolumesListTestJSON-705065235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:42:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9c7a7c32-a1d3-4c9a-b786-bbb8c2b595e9 tempest-VolumesListTestJSON-705065235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:42:04 devstack sudo[96455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:42:04 devstack sudo[96455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:42:05 devstack cinder-volume[86136]: DEBUG oslo_service.periodic_task [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86136) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 21:42:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:42:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:42:05 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:42:05 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:42:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:42:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:42:05 devstack sudo[96455]: pam_unix(sudo:session): session closed for user root Sep 18 21:42:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9c7a7c32-a1d3-4c9a-b786-bbb8c2b595e9 tempest-VolumesListTestJSON-705065235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.432s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:42:05 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-9c7a7c32-a1d3-4c9a-b786-bbb8c2b595e9 tempest-VolumesListTestJSON-705065235 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:42:05 devstack sudo[96460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:42:05 devstack sudo[96460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:42:05 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-9c7a7c32-a1d3-4c9a-b786-bbb8c2b595e9 tempest-VolumesListTestJSON-705065235 None] Deleted volume successfully. Sep 18 21:42:05 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-9c7a7c32-a1d3-4c9a-b786-bbb8c2b595e9 tempest-VolumesListTestJSON-705065235 None] Lock "cinder-038e1b8b-b56e-4161-b4d3-1569d7cb9b52-delete_volume" released by "delete_volume" :: held 2.482s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:42:05 devstack sudo[96460]: pam_unix(sudo:session): session closed for user root Sep 18 21:42:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.512s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:42:05 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:42:05 devstack cinder-volume[86136]: DEBUG oslo_service.periodic_task [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Running periodic task VolumeManager._thread_info {{(pid=86136) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 21:42:05 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] thread count: 28 {{(pid=86136) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 18 21:42:05 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] thread info: [<_MainThread(MainThread, started 138548347871360)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86136) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 18 21:42:06 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-dd563e2b-3635-4e44-99d6-e020a622bada tempest-VolumesActionsTest-2137630509 None] Acquiring lock "cinder-7d13f471-bb17-42dc-ba2d-ba62328501e6" by "attach_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:42:06 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-dd563e2b-3635-4e44-99d6-e020a622bada tempest-VolumesActionsTest-2137630509 None] Lock "cinder-7d13f471-bb17-42dc-ba2d-ba62328501e6" acquired by "attach_volume" :: waited 0.049s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:42:06 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-dd563e2b-3635-4e44-99d6-e020a622bada tempest-VolumesActionsTest-2137630509 None] Attaching volume 7d13f471-bb17-42dc-ba2d-ba62328501e6 to instance 5ad12678-583e-4d9a-8155-d3dfac72b557 at mountpoint /dev/vdb on host None. Sep 18 21:42:06 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-dd563e2b-3635-4e44-99d6-e020a622bada tempest-VolumesActionsTest-2137630509 None] Attach volume completed successfully. Sep 18 21:42:06 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-dd563e2b-3635-4e44-99d6-e020a622bada tempest-VolumesActionsTest-2137630509 None] Lock "cinder-7d13f471-bb17-42dc-ba2d-ba62328501e6" released by "attach_volume" :: held 0.136s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:42:06 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-f5190fb8-bbf4-48ce-a123-7633ce1886a6 tempest-VolumesActionsTest-2137630509 None] Acquiring lock "cinder-7d13f471-bb17-42dc-ba2d-ba62328501e6-detach_volume" by "detach_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:42:06 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-f5190fb8-bbf4-48ce-a123-7633ce1886a6 tempest-VolumesActionsTest-2137630509 None] Lock "cinder-7d13f471-bb17-42dc-ba2d-ba62328501e6-detach_volume" acquired by "detach_volume" :: waited 0.020s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:42:06 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-f5190fb8-bbf4-48ce-a123-7633ce1886a6 tempest-VolumesActionsTest-2137630509 None] Detaching volume 7d13f471-bb17-42dc-ba2d-ba62328501e6 from instance 5ad12678-583e-4d9a-8155-d3dfac72b557. Sep 18 21:42:06 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-f5190fb8-bbf4-48ce-a123-7633ce1886a6 tempest-VolumesActionsTest-2137630509 None] Detach volume completed successfully. Sep 18 21:42:06 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-f5190fb8-bbf4-48ce-a123-7633ce1886a6 tempest-VolumesActionsTest-2137630509 None] Lock "cinder-7d13f471-bb17-42dc-ba2d-ba62328501e6-detach_volume" released by "detach_volume" :: held 0.078s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:42:11 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-934a6be7-10ec-41ad-a50d-dd3c97b858a1 tempest-VolumesSnapshotListTestJSON-2100830015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:42:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-934a6be7-10ec-41ad-a50d-dd3c97b858a1 tempest-VolumesSnapshotListTestJSON-2100830015 None] Flow 'volume_create_manager' (f46dbde6-aabb-4cb2-8d00-85cc96b02bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:42:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-934a6be7-10ec-41ad-a50d-dd3c97b858a1 tempest-VolumesSnapshotListTestJSON-2100830015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75b5a019-eaa5-481c-a113-2d9b066e2828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:42:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-934a6be7-10ec-41ad-a50d-dd3c97b858a1 tempest-VolumesSnapshotListTestJSON-2100830015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75b5a019-eaa5-481c-a113-2d9b066e2828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:42:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1105685764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=136d3779-a375-4515-8fdc-f242c1b4eaca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c1f397aa31444109bfe08c3cfea22a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:42:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:42:12Z,use_quota=True,user_id='11692a4e7eb84922bd5cb0d801cc143a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:42:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-934a6be7-10ec-41ad-a50d-dd3c97b858a1 tempest-VolumesSnapshotListTestJSON-2100830015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b339647e-8cbe-45f0-93ad-75941220d865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:42:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-934a6be7-10ec-41ad-a50d-dd3c97b858a1 tempest-VolumesSnapshotListTestJSON-2100830015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b339647e-8cbe-45f0-93ad-75941220d865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:42:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-934a6be7-10ec-41ad-a50d-dd3c97b858a1 tempest-VolumesSnapshotListTestJSON-2100830015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5bc82e8-0f39-450e-ab13-71138d4bbe67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:42:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-934a6be7-10ec-41ad-a50d-dd3c97b858a1 tempest-VolumesSnapshotListTestJSON-2100830015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5bc82e8-0f39-450e-ab13-71138d4bbe67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '136d3779-a375-4515-8fdc-f242c1b4eaca', 'volume_name': 'volume-136d3779-a375-4515-8fdc-f242c1b4eaca', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:42:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-934a6be7-10ec-41ad-a50d-dd3c97b858a1 tempest-VolumesSnapshotListTestJSON-2100830015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6f6c473-bba9-443c-a054-b0e371cac5ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:42:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-934a6be7-10ec-41ad-a50d-dd3c97b858a1 tempest-VolumesSnapshotListTestJSON-2100830015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6f6c473-bba9-443c-a054-b0e371cac5ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:42:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-934a6be7-10ec-41ad-a50d-dd3c97b858a1 tempest-VolumesSnapshotListTestJSON-2100830015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (516f1ced-09d3-47fe-9f86-aaa570c66eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:42:11 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-934a6be7-10ec-41ad-a50d-dd3c97b858a1 tempest-VolumesSnapshotListTestJSON-2100830015 None] Volume 136d3779-a375-4515-8fdc-f242c1b4eaca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-136d3779-a375-4515-8fdc-f242c1b4eaca', 'volume_size': 1} Sep 18 21:42:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-934a6be7-10ec-41ad-a50d-dd3c97b858a1 tempest-VolumesSnapshotListTestJSON-2100830015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:42:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-934a6be7-10ec-41ad-a50d-dd3c97b858a1 tempest-VolumesSnapshotListTestJSON-2100830015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:42:11 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-934a6be7-10ec-41ad-a50d-dd3c97b858a1 tempest-VolumesSnapshotListTestJSON-2100830015 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:42:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1105685764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=136d3779-a375-4515-8fdc-f242c1b4eaca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c1f397aa31444109bfe08c3cfea22a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:42:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:42:12Z,use_quota=True,user_id='11692a4e7eb84922bd5cb0d801cc143a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:42:11 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-934a6be7-10ec-41ad-a50d-dd3c97b858a1 tempest-VolumesSnapshotListTestJSON-2100830015 None] Creating volume 136d3779-a375-4515-8fdc-f242c1b4eaca {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:42:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-934a6be7-10ec-41ad-a50d-dd3c97b858a1 tempest-VolumesSnapshotListTestJSON-2100830015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:42:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-934a6be7-10ec-41ad-a50d-dd3c97b858a1 tempest-VolumesSnapshotListTestJSON-2100830015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:42:11 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-934a6be7-10ec-41ad-a50d-dd3c97b858a1 tempest-VolumesSnapshotListTestJSON-2100830015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:42:11 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-934a6be7-10ec-41ad-a50d-dd3c97b858a1 tempest-VolumesSnapshotListTestJSON-2100830015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:42:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-934a6be7-10ec-41ad-a50d-dd3c97b858a1 tempest-VolumesSnapshotListTestJSON-2100830015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:42:11 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-934a6be7-10ec-41ad-a50d-dd3c97b858a1 tempest-VolumesSnapshotListTestJSON-2100830015 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:42:11 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-934a6be7-10ec-41ad-a50d-dd3c97b858a1 tempest-VolumesSnapshotListTestJSON-2100830015 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:42:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-934a6be7-10ec-41ad-a50d-dd3c97b858a1 tempest-VolumesSnapshotListTestJSON-2100830015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:42:11 devstack sudo[96554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca 1073741824 Sep 18 21:42:11 devstack sudo[96554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:42:12 devstack sudo[96554]: pam_unix(sudo:session): session closed for user root Sep 18 21:42:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-934a6be7-10ec-41ad-a50d-dd3c97b858a1 tempest-VolumesSnapshotListTestJSON-2100830015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca 1073741824" returned: 0 in 0.612s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:42:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-934a6be7-10ec-41ad-a50d-dd3c97b858a1 tempest-VolumesSnapshotListTestJSON-2100830015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:42:12 devstack sudo[96560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca Sep 18 21:42:12 devstack sudo[96560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:42:12 devstack sudo[96560]: pam_unix(sudo:session): session closed for user root Sep 18 21:42:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-934a6be7-10ec-41ad-a50d-dd3c97b858a1 tempest-VolumesSnapshotListTestJSON-2100830015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca" returned: 0 in 0.350s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:42:12 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-934a6be7-10ec-41ad-a50d-dd3c97b858a1 tempest-VolumesSnapshotListTestJSON-2100830015 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:42:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-934a6be7-10ec-41ad-a50d-dd3c97b858a1 tempest-VolumesSnapshotListTestJSON-2100830015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:42:12 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-934a6be7-10ec-41ad-a50d-dd3c97b858a1 tempest-VolumesSnapshotListTestJSON-2100830015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (516f1ced-09d3-47fe-9f86-aaa570c66eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-136d3779-a375-4515-8fdc-f242c1b4eaca', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:42:12 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-934a6be7-10ec-41ad-a50d-dd3c97b858a1 tempest-VolumesSnapshotListTestJSON-2100830015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ff18b4c-dc94-4262-be45-0b4eb578689c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:42:12 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-934a6be7-10ec-41ad-a50d-dd3c97b858a1 tempest-VolumesSnapshotListTestJSON-2100830015 None] Volume volume-136d3779-a375-4515-8fdc-f242c1b4eaca (136d3779-a375-4515-8fdc-f242c1b4eaca): created successfully Sep 18 21:42:12 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-934a6be7-10ec-41ad-a50d-dd3c97b858a1 tempest-VolumesSnapshotListTestJSON-2100830015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ff18b4c-dc94-4262-be45-0b4eb578689c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:42:12 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-934a6be7-10ec-41ad-a50d-dd3c97b858a1 tempest-VolumesSnapshotListTestJSON-2100830015 None] Flow 'volume_create_manager' (f46dbde6-aabb-4cb2-8d00-85cc96b02bb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:42:12 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-934a6be7-10ec-41ad-a50d-dd3c97b858a1 tempest-VolumesSnapshotListTestJSON-2100830015 None] Created volume successfully. Sep 18 21:42:14 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-0af5aa01-0d9f-4aee-9036-b2ea4e889ba2 tempest-AttachVolumeNegativeTest-605821046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:42:14 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-0af5aa01-0d9f-4aee-9036-b2ea4e889ba2 tempest-AttachVolumeNegativeTest-605821046 None] Flow 'volume_create_manager' (6f1c00f8-3706-4a45-adc1-699a75980bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:42:14 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-0af5aa01-0d9f-4aee-9036-b2ea4e889ba2 tempest-AttachVolumeNegativeTest-605821046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdae1844-4b56-44f8-8ad5-ac8505c4eb3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:42:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-66b9ef06-f4b1-44e0-a0fe-2a1c42846f0b tempest-VolumesSnapshotListTestJSON-2100830015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:42:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-66b9ef06-f4b1-44e0-a0fe-2a1c42846f0b tempest-VolumesSnapshotListTestJSON-2100830015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:42:14 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-0af5aa01-0d9f-4aee-9036-b2ea4e889ba2 tempest-AttachVolumeNegativeTest-605821046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdae1844-4b56-44f8-8ad5-ac8505c4eb3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:42:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1604464483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8351963b-4e32-44de-bd3d-2eec4a802b12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30df0b9dab9e41068c0b4f9907624377',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:42:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:42:14Z,use_quota=True,user_id='cd990a60d4a840228debec9b50923d6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:42:14 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-0af5aa01-0d9f-4aee-9036-b2ea4e889ba2 tempest-AttachVolumeNegativeTest-605821046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33ecbf62-c876-48ab-8e12-f459d45e3b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:42:14 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-0af5aa01-0d9f-4aee-9036-b2ea4e889ba2 tempest-AttachVolumeNegativeTest-605821046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33ecbf62-c876-48ab-8e12-f459d45e3b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:42:14 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-0af5aa01-0d9f-4aee-9036-b2ea4e889ba2 tempest-AttachVolumeNegativeTest-605821046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8121330e-a484-4f37-a6e4-3005ec4192f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:42:14 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-0af5aa01-0d9f-4aee-9036-b2ea4e889ba2 tempest-AttachVolumeNegativeTest-605821046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8121330e-a484-4f37-a6e4-3005ec4192f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8351963b-4e32-44de-bd3d-2eec4a802b12', 'volume_name': 'volume-8351963b-4e32-44de-bd3d-2eec4a802b12', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:42:14 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-0af5aa01-0d9f-4aee-9036-b2ea4e889ba2 tempest-AttachVolumeNegativeTest-605821046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0dc861b-2620-4e98-a520-3847d7872f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:42:14 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-0af5aa01-0d9f-4aee-9036-b2ea4e889ba2 tempest-AttachVolumeNegativeTest-605821046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0dc861b-2620-4e98-a520-3847d7872f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:42:14 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-0af5aa01-0d9f-4aee-9036-b2ea4e889ba2 tempest-AttachVolumeNegativeTest-605821046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02c5e091-662a-47f2-8fa2-77a8862d6bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:42:14 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-0af5aa01-0d9f-4aee-9036-b2ea4e889ba2 tempest-AttachVolumeNegativeTest-605821046 None] Volume 8351963b-4e32-44de-bd3d-2eec4a802b12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8351963b-4e32-44de-bd3d-2eec4a802b12', 'volume_size': 1} Sep 18 21:42:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-0af5aa01-0d9f-4aee-9036-b2ea4e889ba2 tempest-AttachVolumeNegativeTest-605821046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:42:14 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-66b9ef06-f4b1-44e0-a0fe-2a1c42846f0b tempest-VolumesSnapshotListTestJSON-2100830015 None] Creating offline snapshot 1c4048e0-dbcd-48ac-a988-27ac379dd9d3 of volume 136d3779-a375-4515-8fdc-f242c1b4eaca {{(pid=86136) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 21:42:14 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[756216f6-21af-48eb-a9ed-88b506fb2141]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:42:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-66b9ef06-f4b1-44e0-a0fe-2a1c42846f0b tempest-VolumesSnapshotListTestJSON-2100830015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:42:14 devstack sudo[96571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca Sep 18 21:42:14 devstack sudo[96571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:42:15 devstack sudo[96571]: pam_unix(sudo:session): session closed for user root Sep 18 21:42:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-66b9ef06-f4b1-44e0-a0fe-2a1c42846f0b tempest-VolumesSnapshotListTestJSON-2100830015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca" returned: 0 in 0.615s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:42:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-66b9ef06-f4b1-44e0-a0fe-2a1c42846f0b tempest-VolumesSnapshotListTestJSON-2100830015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca.1c4048e0-dbcd-48ac-a988-27ac379dd9d3 1G {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:42:15 devstack sudo[96577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca.1c4048e0-dbcd-48ac-a988-27ac379dd9d3 1G Sep 18 21:42:15 devstack sudo[96577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:42:15 devstack sudo[96577]: pam_unix(sudo:session): session closed for user root Sep 18 21:42:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-66b9ef06-f4b1-44e0-a0fe-2a1c42846f0b tempest-VolumesSnapshotListTestJSON-2100830015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca.1c4048e0-dbcd-48ac-a988-27ac379dd9d3 1G" returned: 0 in 0.661s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:42:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-66b9ef06-f4b1-44e0-a0fe-2a1c42846f0b tempest-VolumesSnapshotListTestJSON-2100830015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-136d3779-a375-4515-8fdc-f242c1b4eaca -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca.1c4048e0-dbcd-48ac-a988-27ac379dd9d3 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:42:15 devstack sudo[96600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-136d3779-a375-4515-8fdc-f242c1b4eaca -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca.1c4048e0-dbcd-48ac-a988-27ac379dd9d3 Sep 18 21:42:15 devstack sudo[96600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:42:16 devstack sudo[96600]: pam_unix(sudo:session): session closed for user root Sep 18 21:42:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-66b9ef06-f4b1-44e0-a0fe-2a1c42846f0b tempest-VolumesSnapshotListTestJSON-2100830015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-136d3779-a375-4515-8fdc-f242c1b4eaca -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca.1c4048e0-dbcd-48ac-a988-27ac379dd9d3" returned: 0 in 0.470s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:42:16 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-66b9ef06-f4b1-44e0-a0fe-2a1c42846f0b tempest-VolumesSnapshotListTestJSON-2100830015 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca.1c4048e0-dbcd-48ac-a988-27ac379dd9d3 is being set with open permissions: ugo+rw Sep 18 21:42:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-66b9ef06-f4b1-44e0-a0fe-2a1c42846f0b tempest-VolumesSnapshotListTestJSON-2100830015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca.1c4048e0-dbcd-48ac-a988-27ac379dd9d3 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:42:16 devstack sudo[96607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca.1c4048e0-dbcd-48ac-a988-27ac379dd9d3 Sep 18 21:42:16 devstack sudo[96607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:42:16 devstack sudo[96607]: pam_unix(sudo:session): session closed for user root Sep 18 21:42:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-66b9ef06-f4b1-44e0-a0fe-2a1c42846f0b tempest-VolumesSnapshotListTestJSON-2100830015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca.1c4048e0-dbcd-48ac-a988-27ac379dd9d3" returned: 0 in 0.277s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:42:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-66b9ef06-f4b1-44e0-a0fe-2a1c42846f0b tempest-VolumesSnapshotListTestJSON-2100830015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:42:16 devstack sudo[96610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca.info Sep 18 21:42:16 devstack sudo[96610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:42:17 devstack sudo[96610]: pam_unix(sudo:session): session closed for user root Sep 18 21:42:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-66b9ef06-f4b1-44e0-a0fe-2a1c42846f0b tempest-VolumesSnapshotListTestJSON-2100830015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca.info" returned: 0 in 0.321s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:42:17 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-66b9ef06-f4b1-44e0-a0fe-2a1c42846f0b tempest-VolumesSnapshotListTestJSON-2100830015 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca.info is being set with open permissions: ugo+rw Sep 18 21:42:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-66b9ef06-f4b1-44e0-a0fe-2a1c42846f0b tempest-VolumesSnapshotListTestJSON-2100830015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:42:17 devstack sudo[96614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca.info Sep 18 21:42:17 devstack sudo[96614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:42:17 devstack sudo[96614]: pam_unix(sudo:session): session closed for user root Sep 18 21:42:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-66b9ef06-f4b1-44e0-a0fe-2a1c42846f0b tempest-VolumesSnapshotListTestJSON-2100830015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca.info" returned: 0 in 0.330s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:42:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-66b9ef06-f4b1-44e0-a0fe-2a1c42846f0b tempest-VolumesSnapshotListTestJSON-2100830015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.877s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:42:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-0af5aa01-0d9f-4aee-9036-b2ea4e889ba2 tempest-AttachVolumeNegativeTest-605821046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.817s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:42:17 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-0af5aa01-0d9f-4aee-9036-b2ea4e889ba2 tempest-AttachVolumeNegativeTest-605821046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:42:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1604464483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8351963b-4e32-44de-bd3d-2eec4a802b12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30df0b9dab9e41068c0b4f9907624377',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:42:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:42:14Z,use_quota=True,user_id='cd990a60d4a840228debec9b50923d6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:42:17 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-0af5aa01-0d9f-4aee-9036-b2ea4e889ba2 tempest-AttachVolumeNegativeTest-605821046 None] Creating volume 8351963b-4e32-44de-bd3d-2eec4a802b12 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:42:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-0af5aa01-0d9f-4aee-9036-b2ea4e889ba2 tempest-AttachVolumeNegativeTest-605821046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:42:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-0af5aa01-0d9f-4aee-9036-b2ea4e889ba2 tempest-AttachVolumeNegativeTest-605821046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:42:17 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-0af5aa01-0d9f-4aee-9036-b2ea4e889ba2 tempest-AttachVolumeNegativeTest-605821046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:42:17 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-0af5aa01-0d9f-4aee-9036-b2ea4e889ba2 tempest-AttachVolumeNegativeTest-605821046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:42:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-0af5aa01-0d9f-4aee-9036-b2ea4e889ba2 tempest-AttachVolumeNegativeTest-605821046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:42:17 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-0af5aa01-0d9f-4aee-9036-b2ea4e889ba2 tempest-AttachVolumeNegativeTest-605821046 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:42:17 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-0af5aa01-0d9f-4aee-9036-b2ea4e889ba2 tempest-AttachVolumeNegativeTest-605821046 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:42:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0af5aa01-0d9f-4aee-9036-b2ea4e889ba2 tempest-AttachVolumeNegativeTest-605821046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-8351963b-4e32-44de-bd3d-2eec4a802b12 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:42:17 devstack sudo[96617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-8351963b-4e32-44de-bd3d-2eec4a802b12 1073741824 Sep 18 21:42:17 devstack sudo[96617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:42:17 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-66b9ef06-f4b1-44e0-a0fe-2a1c42846f0b tempest-VolumesSnapshotListTestJSON-2100830015 None] Create snapshot completed successfully Sep 18 21:42:18 devstack sudo[96617]: pam_unix(sudo:session): session closed for user root Sep 18 21:42:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0af5aa01-0d9f-4aee-9036-b2ea4e889ba2 tempest-AttachVolumeNegativeTest-605821046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-8351963b-4e32-44de-bd3d-2eec4a802b12 1073741824" returned: 0 in 0.644s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:42:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0af5aa01-0d9f-4aee-9036-b2ea4e889ba2 tempest-AttachVolumeNegativeTest-605821046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-8351963b-4e32-44de-bd3d-2eec4a802b12 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:42:18 devstack sudo[96660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-8351963b-4e32-44de-bd3d-2eec4a802b12 Sep 18 21:42:18 devstack sudo[96660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:42:18 devstack sudo[96660]: pam_unix(sudo:session): session closed for user root Sep 18 21:42:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0af5aa01-0d9f-4aee-9036-b2ea4e889ba2 tempest-AttachVolumeNegativeTest-605821046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-8351963b-4e32-44de-bd3d-2eec4a802b12" returned: 0 in 0.520s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:42:18 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-0af5aa01-0d9f-4aee-9036-b2ea4e889ba2 tempest-AttachVolumeNegativeTest-605821046 None] <== create_volume: return (1252ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:42:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-0af5aa01-0d9f-4aee-9036-b2ea4e889ba2 tempest-AttachVolumeNegativeTest-605821046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.258s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:42:18 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-0af5aa01-0d9f-4aee-9036-b2ea4e889ba2 tempest-AttachVolumeNegativeTest-605821046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02c5e091-662a-47f2-8fa2-77a8862d6bea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8351963b-4e32-44de-bd3d-2eec4a802b12', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:42:18 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-0af5aa01-0d9f-4aee-9036-b2ea4e889ba2 tempest-AttachVolumeNegativeTest-605821046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (209bef3b-fa46-4375-8b58-792c2b1ece8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:42:18 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-0af5aa01-0d9f-4aee-9036-b2ea4e889ba2 tempest-AttachVolumeNegativeTest-605821046 None] Volume volume-8351963b-4e32-44de-bd3d-2eec4a802b12 (8351963b-4e32-44de-bd3d-2eec4a802b12): created successfully Sep 18 21:42:18 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-0af5aa01-0d9f-4aee-9036-b2ea4e889ba2 tempest-AttachVolumeNegativeTest-605821046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (209bef3b-fa46-4375-8b58-792c2b1ece8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:42:18 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-0af5aa01-0d9f-4aee-9036-b2ea4e889ba2 tempest-AttachVolumeNegativeTest-605821046 None] Flow 'volume_create_manager' (6f1c00f8-3706-4a45-adc1-699a75980bcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:42:18 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-0af5aa01-0d9f-4aee-9036-b2ea4e889ba2 tempest-AttachVolumeNegativeTest-605821046 None] Created volume successfully. Sep 18 21:42:19 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-2cb38ab9-7351-48db-b83d-564e4c2f8000 tempest-VolumesSnapshotListTestJSON-2100830015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:42:19 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-2cb38ab9-7351-48db-b83d-564e4c2f8000 tempest-VolumesSnapshotListTestJSON-2100830015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:42:19 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-2cb38ab9-7351-48db-b83d-564e4c2f8000 tempest-VolumesSnapshotListTestJSON-2100830015 None] Creating offline snapshot 43f8781b-8b90-424a-be20-0c4ac2bb473e of volume 136d3779-a375-4515-8fdc-f242c1b4eaca {{(pid=86136) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 21:42:19 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ca7933-5668-419d-a7a1-b59047041664]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:42:19 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-2cb38ab9-7351-48db-b83d-564e4c2f8000 tempest-VolumesSnapshotListTestJSON-2100830015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca.1c4048e0-dbcd-48ac-a988-27ac379dd9d3 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:42:19 devstack sudo[96716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca.1c4048e0-dbcd-48ac-a988-27ac379dd9d3 Sep 18 21:42:19 devstack sudo[96716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:42:20 devstack sudo[96716]: pam_unix(sudo:session): session closed for user root Sep 18 21:42:20 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-2cb38ab9-7351-48db-b83d-564e4c2f8000 tempest-VolumesSnapshotListTestJSON-2100830015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca.1c4048e0-dbcd-48ac-a988-27ac379dd9d3" returned: 0 in 0.883s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:42:20 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-2cb38ab9-7351-48db-b83d-564e4c2f8000 tempest-VolumesSnapshotListTestJSON-2100830015 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-136d3779-a375-4515-8fdc-f242c1b4eaca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86136) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 21:42:20 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-2cb38ab9-7351-48db-b83d-564e4c2f8000 tempest-VolumesSnapshotListTestJSON-2100830015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca.1c4048e0-dbcd-48ac-a988-27ac379dd9d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca.43f8781b-8b90-424a-be20-0c4ac2bb473e 1G {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:42:20 devstack sudo[96738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca.1c4048e0-dbcd-48ac-a988-27ac379dd9d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca.43f8781b-8b90-424a-be20-0c4ac2bb473e 1G Sep 18 21:42:20 devstack sudo[96738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:42:21 devstack sudo[96738]: pam_unix(sudo:session): session closed for user root Sep 18 21:42:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-2cb38ab9-7351-48db-b83d-564e4c2f8000 tempest-VolumesSnapshotListTestJSON-2100830015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca.1c4048e0-dbcd-48ac-a988-27ac379dd9d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca.43f8781b-8b90-424a-be20-0c4ac2bb473e 1G" returned: 0 in 1.010s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:42:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-2cb38ab9-7351-48db-b83d-564e4c2f8000 tempest-VolumesSnapshotListTestJSON-2100830015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-136d3779-a375-4515-8fdc-f242c1b4eaca.1c4048e0-dbcd-48ac-a988-27ac379dd9d3 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca.43f8781b-8b90-424a-be20-0c4ac2bb473e {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:42:21 devstack sudo[96756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-136d3779-a375-4515-8fdc-f242c1b4eaca.1c4048e0-dbcd-48ac-a988-27ac379dd9d3 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca.43f8781b-8b90-424a-be20-0c4ac2bb473e Sep 18 21:42:21 devstack sudo[96756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:42:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-f529e012-b43e-48f0-ad62-30374392e45a req-3170623f-2f55-4411-9c45-67dedf8a6322 tempest-AttachVolumeNegativeTest-605821046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:42:21 devstack sudo[96756]: pam_unix(sudo:session): session closed for user root Sep 18 21:42:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-2cb38ab9-7351-48db-b83d-564e4c2f8000 tempest-VolumesSnapshotListTestJSON-2100830015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-136d3779-a375-4515-8fdc-f242c1b4eaca.1c4048e0-dbcd-48ac-a988-27ac379dd9d3 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca.43f8781b-8b90-424a-be20-0c4ac2bb473e" returned: 0 in 0.513s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:42:21 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-2cb38ab9-7351-48db-b83d-564e4c2f8000 tempest-VolumesSnapshotListTestJSON-2100830015 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca.43f8781b-8b90-424a-be20-0c4ac2bb473e is being set with open permissions: ugo+rw Sep 18 21:42:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-2cb38ab9-7351-48db-b83d-564e4c2f8000 tempest-VolumesSnapshotListTestJSON-2100830015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca.43f8781b-8b90-424a-be20-0c4ac2bb473e {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:42:21 devstack sudo[96761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca.43f8781b-8b90-424a-be20-0c4ac2bb473e Sep 18 21:42:21 devstack sudo[96761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:42:22 devstack sudo[96761]: pam_unix(sudo:session): session closed for user root Sep 18 21:42:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-2cb38ab9-7351-48db-b83d-564e4c2f8000 tempest-VolumesSnapshotListTestJSON-2100830015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca.43f8781b-8b90-424a-be20-0c4ac2bb473e" returned: 0 in 0.363s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:42:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-2cb38ab9-7351-48db-b83d-564e4c2f8000 tempest-VolumesSnapshotListTestJSON-2100830015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.948s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:42:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-f529e012-b43e-48f0-ad62-30374392e45a req-3170623f-2f55-4411-9c45-67dedf8a6322 tempest-AttachVolumeNegativeTest-605821046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.819s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:42:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-f529e012-b43e-48f0-ad62-30374392e45a req-3170623f-2f55-4411-9c45-67dedf8a6322 tempest-AttachVolumeNegativeTest-605821046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:42:22 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-2cb38ab9-7351-48db-b83d-564e4c2f8000 tempest-VolumesSnapshotListTestJSON-2100830015 None] Create snapshot completed successfully Sep 18 21:42:22 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [req-f529e012-b43e-48f0-ad62-30374392e45a req-3170623f-2f55-4411-9c45-67dedf8a6322 tempest-AttachVolumeNegativeTest-605821046 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff', 'name': 'volume-8351963b-4e32-44de-bd3d-2eec4a802b12', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'eaab126d-b8f3-4264-b710-9f3a52be0f55', 'enforce_multipath': True} {{(pid=86136) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 18 21:42:22 devstack cinder-volume[86136]: INFO cinder.volume.manager [req-f529e012-b43e-48f0-ad62-30374392e45a req-3170623f-2f55-4411-9c45-67dedf8a6322 tempest-AttachVolumeNegativeTest-605821046 None] attachment_update completed successfully. Sep 18 21:42:22 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-453e8126-da4e-47cf-bcd5-c83ce6b6546c tempest-VolumesActionsTest-2137630509 None] Acquiring lock "cinder-7d13f471-bb17-42dc-ba2d-ba62328501e6" by "attach_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:42:22 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-453e8126-da4e-47cf-bcd5-c83ce6b6546c tempest-VolumesActionsTest-2137630509 None] Lock "cinder-7d13f471-bb17-42dc-ba2d-ba62328501e6" acquired by "attach_volume" :: waited 0.043s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:42:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-28d59296-373f-41d3-8bdc-7cca9a2f56dc tempest-VolumesSnapshotListTestJSON-2100830015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:42:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-28d59296-373f-41d3-8bdc-7cca9a2f56dc tempest-VolumesSnapshotListTestJSON-2100830015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:42:22 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-28d59296-373f-41d3-8bdc-7cca9a2f56dc tempest-VolumesSnapshotListTestJSON-2100830015 None] Creating offline snapshot 1df1a2a7-834c-40c8-b699-a9531e75149b of volume 136d3779-a375-4515-8fdc-f242c1b4eaca {{(pid=86136) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 21:42:23 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d083784-cbe8-432b-b515-52502ec64c9c]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:42:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-28d59296-373f-41d3-8bdc-7cca9a2f56dc tempest-VolumesSnapshotListTestJSON-2100830015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca.43f8781b-8b90-424a-be20-0c4ac2bb473e {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:42:23 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-453e8126-da4e-47cf-bcd5-c83ce6b6546c tempest-VolumesActionsTest-2137630509 None] Attaching volume 7d13f471-bb17-42dc-ba2d-ba62328501e6 to instance 3865ebab-84b3-45c8-858d-f63e9998c744 at mountpoint /dev/vdb on host None. Sep 18 21:42:23 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-453e8126-da4e-47cf-bcd5-c83ce6b6546c tempest-VolumesActionsTest-2137630509 None] Attach volume completed successfully. Sep 18 21:42:23 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-453e8126-da4e-47cf-bcd5-c83ce6b6546c tempest-VolumesActionsTest-2137630509 None] Lock "cinder-7d13f471-bb17-42dc-ba2d-ba62328501e6" released by "attach_volume" :: held 0.444s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:42:23 devstack sudo[96917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca.43f8781b-8b90-424a-be20-0c4ac2bb473e Sep 18 21:42:23 devstack sudo[96917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:42:23 devstack sudo[96917]: pam_unix(sudo:session): session closed for user root Sep 18 21:42:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-28d59296-373f-41d3-8bdc-7cca9a2f56dc tempest-VolumesSnapshotListTestJSON-2100830015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca.43f8781b-8b90-424a-be20-0c4ac2bb473e" returned: 0 in 0.708s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:42:23 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-28d59296-373f-41d3-8bdc-7cca9a2f56dc tempest-VolumesSnapshotListTestJSON-2100830015 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-136d3779-a375-4515-8fdc-f242c1b4eaca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86136) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 21:42:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-28d59296-373f-41d3-8bdc-7cca9a2f56dc tempest-VolumesSnapshotListTestJSON-2100830015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca.43f8781b-8b90-424a-be20-0c4ac2bb473e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca.1df1a2a7-834c-40c8-b699-a9531e75149b 1G {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:42:23 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d22d9dee-c4b6-4513-99dc-b7f678d556f6 tempest-VolumesActionsTest-2137630509 None] Acquiring lock "cinder-7d13f471-bb17-42dc-ba2d-ba62328501e6-detach_volume" by "detach_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:42:23 devstack sudo[97226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca.43f8781b-8b90-424a-be20-0c4ac2bb473e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca.1df1a2a7-834c-40c8-b699-a9531e75149b 1G Sep 18 21:42:23 devstack sudo[97226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:42:23 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d22d9dee-c4b6-4513-99dc-b7f678d556f6 tempest-VolumesActionsTest-2137630509 None] Lock "cinder-7d13f471-bb17-42dc-ba2d-ba62328501e6-detach_volume" acquired by "detach_volume" :: waited 0.046s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:42:23 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-d22d9dee-c4b6-4513-99dc-b7f678d556f6 tempest-VolumesActionsTest-2137630509 None] Detaching volume 7d13f471-bb17-42dc-ba2d-ba62328501e6 from instance 3865ebab-84b3-45c8-858d-f63e9998c744. Sep 18 21:42:23 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-d22d9dee-c4b6-4513-99dc-b7f678d556f6 tempest-VolumesActionsTest-2137630509 None] Detach volume completed successfully. Sep 18 21:42:24 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d22d9dee-c4b6-4513-99dc-b7f678d556f6 tempest-VolumesActionsTest-2137630509 None] Lock "cinder-7d13f471-bb17-42dc-ba2d-ba62328501e6-detach_volume" released by "detach_volume" :: held 0.167s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:42:24 devstack sudo[97226]: pam_unix(sudo:session): session closed for user root Sep 18 21:42:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-28d59296-373f-41d3-8bdc-7cca9a2f56dc tempest-VolumesSnapshotListTestJSON-2100830015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca.43f8781b-8b90-424a-be20-0c4ac2bb473e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca.1df1a2a7-834c-40c8-b699-a9531e75149b 1G" returned: 0 in 0.929s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:42:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-28d59296-373f-41d3-8bdc-7cca9a2f56dc tempest-VolumesSnapshotListTestJSON-2100830015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-136d3779-a375-4515-8fdc-f242c1b4eaca.43f8781b-8b90-424a-be20-0c4ac2bb473e -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca.1df1a2a7-834c-40c8-b699-a9531e75149b {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:42:24 devstack sudo[97234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-136d3779-a375-4515-8fdc-f242c1b4eaca.43f8781b-8b90-424a-be20-0c4ac2bb473e -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca.1df1a2a7-834c-40c8-b699-a9531e75149b Sep 18 21:42:24 devstack sudo[97234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:42:25 devstack sudo[97234]: pam_unix(sudo:session): session closed for user root Sep 18 21:42:25 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-28d59296-373f-41d3-8bdc-7cca9a2f56dc tempest-VolumesSnapshotListTestJSON-2100830015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-136d3779-a375-4515-8fdc-f242c1b4eaca.43f8781b-8b90-424a-be20-0c4ac2bb473e -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca.1df1a2a7-834c-40c8-b699-a9531e75149b" returned: 0 in 0.566s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:42:25 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-28d59296-373f-41d3-8bdc-7cca9a2f56dc tempest-VolumesSnapshotListTestJSON-2100830015 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca.1df1a2a7-834c-40c8-b699-a9531e75149b is being set with open permissions: ugo+rw Sep 18 21:42:25 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-28d59296-373f-41d3-8bdc-7cca9a2f56dc tempest-VolumesSnapshotListTestJSON-2100830015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca.1df1a2a7-834c-40c8-b699-a9531e75149b {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:42:25 devstack sudo[97257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca.1df1a2a7-834c-40c8-b699-a9531e75149b Sep 18 21:42:25 devstack sudo[97257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:42:25 devstack sudo[97257]: pam_unix(sudo:session): session closed for user root Sep 18 21:42:25 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-28d59296-373f-41d3-8bdc-7cca9a2f56dc tempest-VolumesSnapshotListTestJSON-2100830015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca.1df1a2a7-834c-40c8-b699-a9531e75149b" returned: 0 in 0.327s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:42:25 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-28d59296-373f-41d3-8bdc-7cca9a2f56dc tempest-VolumesSnapshotListTestJSON-2100830015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.763s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:42:25 devstack cinder-volume[86136]: INFO cinder.volume.manager [req-6d50f517-ce0a-43c1-923c-25cfa8a03f0c req-f2965f08-f57f-4149-9a56-ad2484ba288c tempest-AttachVolumeNegativeTest-605821046 None] Terminate volume connection completed successfully. Sep 18 21:42:25 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [req-6d50f517-ce0a-43c1-923c-25cfa8a03f0c req-f2965f08-f57f-4149-9a56-ad2484ba288c tempest-AttachVolumeNegativeTest-605821046 None] Deleting attachment eaab126d-b8f3-4264-b710-9f3a52be0f55. {{(pid=86136) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 18 21:42:25 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-28d59296-373f-41d3-8bdc-7cca9a2f56dc tempest-VolumesSnapshotListTestJSON-2100830015 None] Create snapshot completed successfully Sep 18 21:42:27 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-833de8f9-c240-475d-9634-d6cc5af47596 tempest-VolumesSnapshotListTestJSON-2100830015 None] Acquiring lock "cinder-1df1a2a7-834c-40c8-b699-a9531e75149b-delete_snapshot" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:42:27 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-833de8f9-c240-475d-9634-d6cc5af47596 tempest-VolumesSnapshotListTestJSON-2100830015 None] Lock "cinder-1df1a2a7-834c-40c8-b699-a9531e75149b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:42:27 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-833de8f9-c240-475d-9634-d6cc5af47596 tempest-VolumesSnapshotListTestJSON-2100830015 None] Acquiring lock "cinder-quobyte-136d3779-a375-4515-8fdc-f242c1b4eaca" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:42:27 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-833de8f9-c240-475d-9634-d6cc5af47596 tempest-VolumesSnapshotListTestJSON-2100830015 None] Lock "cinder-quobyte-136d3779-a375-4515-8fdc-f242c1b4eaca" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:42:27 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-833de8f9-c240-475d-9634-d6cc5af47596 tempest-VolumesSnapshotListTestJSON-2100830015 None] Acquiring lock "cinder-quobyte-1df1a2a7-834c-40c8-b699-a9531e75149b" by "_delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:42:27 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-833de8f9-c240-475d-9634-d6cc5af47596 tempest-VolumesSnapshotListTestJSON-2100830015 None] Lock "cinder-quobyte-1df1a2a7-834c-40c8-b699-a9531e75149b" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:42:27 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-833de8f9-c240-475d-9634-d6cc5af47596 tempest-VolumesSnapshotListTestJSON-2100830015 None] Deleting offline snapshot 1df1a2a7-834c-40c8-b699-a9531e75149b of volume 136d3779-a375-4515-8fdc-f242c1b4eaca {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 21:42:27 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-833de8f9-c240-475d-9634-d6cc5af47596 tempest-VolumesSnapshotListTestJSON-2100830015 None] snapshot_file for this snap is: volume-136d3779-a375-4515-8fdc-f242c1b4eaca.1df1a2a7-834c-40c8-b699-a9531e75149b {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 21:42:27 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c281a6-473e-44f6-af40-72455e605e1f]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:42:27 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-833de8f9-c240-475d-9634-d6cc5af47596 tempest-VolumesSnapshotListTestJSON-2100830015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca.1df1a2a7-834c-40c8-b699-a9531e75149b {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:42:27 devstack sudo[97313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca.1df1a2a7-834c-40c8-b699-a9531e75149b Sep 18 21:42:27 devstack sudo[97313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:42:27 devstack sudo[97313]: pam_unix(sudo:session): session closed for user root Sep 18 21:42:27 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-833de8f9-c240-475d-9634-d6cc5af47596 tempest-VolumesSnapshotListTestJSON-2100830015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca.1df1a2a7-834c-40c8-b699-a9531e75149b" returned: 0 in 0.458s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:42:27 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-833de8f9-c240-475d-9634-d6cc5af47596 tempest-VolumesSnapshotListTestJSON-2100830015 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-136d3779-a375-4515-8fdc-f242c1b4eaca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86136) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 21:42:27 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[0685fcf0-5016-4c56-b164-1e04d62f0b1a]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:42:27 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-833de8f9-c240-475d-9634-d6cc5af47596 tempest-VolumesSnapshotListTestJSON-2100830015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca.43f8781b-8b90-424a-be20-0c4ac2bb473e {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:42:28 devstack sudo[97320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca.43f8781b-8b90-424a-be20-0c4ac2bb473e Sep 18 21:42:28 devstack sudo[97320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:42:28 devstack sudo[97320]: pam_unix(sudo:session): session closed for user root Sep 18 21:42:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-833de8f9-c240-475d-9634-d6cc5af47596 tempest-VolumesSnapshotListTestJSON-2100830015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca.43f8781b-8b90-424a-be20-0c4ac2bb473e" returned: 0 in 0.509s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:42:28 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-833de8f9-c240-475d-9634-d6cc5af47596 tempest-VolumesSnapshotListTestJSON-2100830015 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-136d3779-a375-4515-8fdc-f242c1b4eaca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86136) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 21:42:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-833de8f9-c240-475d-9634-d6cc5af47596 tempest-VolumesSnapshotListTestJSON-2100830015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca.1df1a2a7-834c-40c8-b699-a9531e75149b {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:42:28 devstack sudo[97327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca.1df1a2a7-834c-40c8-b699-a9531e75149b Sep 18 21:42:28 devstack sudo[97327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:42:29 devstack sudo[97327]: pam_unix(sudo:session): session closed for user root Sep 18 21:42:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-833de8f9-c240-475d-9634-d6cc5af47596 tempest-VolumesSnapshotListTestJSON-2100830015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca.1df1a2a7-834c-40c8-b699-a9531e75149b" returned: 0 in 0.543s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:42:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-833de8f9-c240-475d-9634-d6cc5af47596 tempest-VolumesSnapshotListTestJSON-2100830015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca.1df1a2a7-834c-40c8-b699-a9531e75149b {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:42:29 devstack sudo[97333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca.1df1a2a7-834c-40c8-b699-a9531e75149b Sep 18 21:42:29 devstack sudo[97333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:42:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-cb18e378-6b68-48f2-961f-2133a3482d48 tempest-VolumesActionsTest-2137630509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:42:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-cb18e378-6b68-48f2-961f-2133a3482d48 tempest-VolumesActionsTest-2137630509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:42:29 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[18494ad1-443f-41b6-ae96-73c24d104294]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:42:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-cb18e378-6b68-48f2-961f-2133a3482d48 tempest-VolumesActionsTest-2137630509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7d13f471-bb17-42dc-ba2d-ba62328501e6 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:42:29 devstack sudo[97333]: pam_unix(sudo:session): session closed for user root Sep 18 21:42:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-833de8f9-c240-475d-9634-d6cc5af47596 tempest-VolumesSnapshotListTestJSON-2100830015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca.1df1a2a7-834c-40c8-b699-a9531e75149b" returned: 0 in 0.372s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:42:29 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-833de8f9-c240-475d-9634-d6cc5af47596 tempest-VolumesSnapshotListTestJSON-2100830015 None] Lock "cinder-quobyte-1df1a2a7-834c-40c8-b699-a9531e75149b" released by "_delete_snapshot" :: held 2.065s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:42:29 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-833de8f9-c240-475d-9634-d6cc5af47596 tempest-VolumesSnapshotListTestJSON-2100830015 None] Lock "cinder-quobyte-136d3779-a375-4515-8fdc-f242c1b4eaca" released by "delete_snapshot" :: held 2.111s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:42:29 devstack sudo[97336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7d13f471-bb17-42dc-ba2d-ba62328501e6 Sep 18 21:42:29 devstack sudo[97336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:42:29 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-833de8f9-c240-475d-9634-d6cc5af47596 tempest-VolumesSnapshotListTestJSON-2100830015 None] Created reservations ['592e495b-dde6-4101-9666-f268e412deff', '07e509c2-a4cd-41ad-b236-e27fd33b2b9f', '76d47d1c-1336-4b83-8fe4-4d569e17d34b', '78d990c5-679f-4057-9e23-03c316dba4d2'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:42:29 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-833de8f9-c240-475d-9634-d6cc5af47596 tempest-VolumesSnapshotListTestJSON-2100830015 None] Delete snapshot completed successfully. Sep 18 21:42:29 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-833de8f9-c240-475d-9634-d6cc5af47596 tempest-VolumesSnapshotListTestJSON-2100830015 None] Lock "cinder-1df1a2a7-834c-40c8-b699-a9531e75149b-delete_snapshot" released by "delete_snapshot" :: held 2.276s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:42:29 devstack sudo[97336]: pam_unix(sudo:session): session closed for user root Sep 18 21:42:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-cb18e378-6b68-48f2-961f-2133a3482d48 tempest-VolumesActionsTest-2137630509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7d13f471-bb17-42dc-ba2d-ba62328501e6" returned: 0 in 0.407s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:42:29 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[09640869-d2ad-4e8f-8f8c-cb71edbe2ba4]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:42:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-cb18e378-6b68-48f2-961f-2133a3482d48 tempest-VolumesActionsTest-2137630509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7d13f471-bb17-42dc-ba2d-ba62328501e6 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:42:29 devstack sudo[97341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7d13f471-bb17-42dc-ba2d-ba62328501e6 Sep 18 21:42:29 devstack sudo[97341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:42:30 devstack sudo[97341]: pam_unix(sudo:session): session closed for user root Sep 18 21:42:30 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-cb18e378-6b68-48f2-961f-2133a3482d48 tempest-VolumesActionsTest-2137630509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7d13f471-bb17-42dc-ba2d-ba62328501e6" returned: 0 in 0.366s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:42:30 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-cb18e378-6b68-48f2-961f-2133a3482d48 tempest-VolumesActionsTest-2137630509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7d13f471-bb17-42dc-ba2d-ba62328501e6 /opt/stack/data/cinder/conversion/7d13f471-bb17-42dc-ba2d-ba62328501e6.temp_image.27d153ad-386b-46e4-b101-0c5d41da9c98h9llv4ko.img {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:42:30 devstack sudo[97347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7d13f471-bb17-42dc-ba2d-ba62328501e6 /opt/stack/data/cinder/conversion/7d13f471-bb17-42dc-ba2d-ba62328501e6.temp_image.27d153ad-386b-46e4-b101-0c5d41da9c98h9llv4ko.img Sep 18 21:42:30 devstack sudo[97347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:42:30 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-0160e57a-10e9-474a-b8ec-4ef59e257609 tempest-VolumesSnapshotListTestJSON-2100830015 None] Acquiring lock "cinder-43f8781b-8b90-424a-be20-0c4ac2bb473e-delete_snapshot" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:42:30 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-0160e57a-10e9-474a-b8ec-4ef59e257609 tempest-VolumesSnapshotListTestJSON-2100830015 None] Lock "cinder-43f8781b-8b90-424a-be20-0c4ac2bb473e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:42:30 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-0160e57a-10e9-474a-b8ec-4ef59e257609 tempest-VolumesSnapshotListTestJSON-2100830015 None] Acquiring lock "cinder-quobyte-136d3779-a375-4515-8fdc-f242c1b4eaca" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:42:30 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-0160e57a-10e9-474a-b8ec-4ef59e257609 tempest-VolumesSnapshotListTestJSON-2100830015 None] Lock "cinder-quobyte-136d3779-a375-4515-8fdc-f242c1b4eaca" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:42:30 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-0160e57a-10e9-474a-b8ec-4ef59e257609 tempest-VolumesSnapshotListTestJSON-2100830015 None] Acquiring lock "cinder-quobyte-43f8781b-8b90-424a-be20-0c4ac2bb473e" by "_delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:42:30 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-0160e57a-10e9-474a-b8ec-4ef59e257609 tempest-VolumesSnapshotListTestJSON-2100830015 None] Lock "cinder-quobyte-43f8781b-8b90-424a-be20-0c4ac2bb473e" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:42:30 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-0160e57a-10e9-474a-b8ec-4ef59e257609 tempest-VolumesSnapshotListTestJSON-2100830015 None] Deleting offline snapshot 43f8781b-8b90-424a-be20-0c4ac2bb473e of volume 136d3779-a375-4515-8fdc-f242c1b4eaca {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 21:42:30 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-0160e57a-10e9-474a-b8ec-4ef59e257609 tempest-VolumesSnapshotListTestJSON-2100830015 None] snapshot_file for this snap is: volume-136d3779-a375-4515-8fdc-f242c1b4eaca.43f8781b-8b90-424a-be20-0c4ac2bb473e {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 21:42:30 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a05d78a-2a20-45f5-8cc1-054a1abae1fd]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:42:30 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0160e57a-10e9-474a-b8ec-4ef59e257609 tempest-VolumesSnapshotListTestJSON-2100830015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca.43f8781b-8b90-424a-be20-0c4ac2bb473e {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:42:31 devstack sudo[97360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca.43f8781b-8b90-424a-be20-0c4ac2bb473e Sep 18 21:42:31 devstack sudo[97360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:42:31 devstack sudo[97360]: pam_unix(sudo:session): session closed for user root Sep 18 21:42:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0160e57a-10e9-474a-b8ec-4ef59e257609 tempest-VolumesSnapshotListTestJSON-2100830015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca.43f8781b-8b90-424a-be20-0c4ac2bb473e" returned: 0 in 0.736s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:42:31 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-0160e57a-10e9-474a-b8ec-4ef59e257609 tempest-VolumesSnapshotListTestJSON-2100830015 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-136d3779-a375-4515-8fdc-f242c1b4eaca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86136) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 21:42:31 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[287ddef5-9948-4986-90f2-c4368053cb6b]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:42:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0160e57a-10e9-474a-b8ec-4ef59e257609 tempest-VolumesSnapshotListTestJSON-2100830015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca.1c4048e0-dbcd-48ac-a988-27ac379dd9d3 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:42:31 devstack sudo[97365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca.1c4048e0-dbcd-48ac-a988-27ac379dd9d3 Sep 18 21:42:31 devstack sudo[97365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:42:32 devstack sudo[97365]: pam_unix(sudo:session): session closed for user root Sep 18 21:42:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0160e57a-10e9-474a-b8ec-4ef59e257609 tempest-VolumesSnapshotListTestJSON-2100830015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca.1c4048e0-dbcd-48ac-a988-27ac379dd9d3" returned: 0 in 0.846s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:42:32 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-0160e57a-10e9-474a-b8ec-4ef59e257609 tempest-VolumesSnapshotListTestJSON-2100830015 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-136d3779-a375-4515-8fdc-f242c1b4eaca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86136) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 21:42:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0160e57a-10e9-474a-b8ec-4ef59e257609 tempest-VolumesSnapshotListTestJSON-2100830015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca.43f8781b-8b90-424a-be20-0c4ac2bb473e {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:42:32 devstack sudo[97370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca.43f8781b-8b90-424a-be20-0c4ac2bb473e Sep 18 21:42:32 devstack sudo[97370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:42:33 devstack sudo[97370]: pam_unix(sudo:session): session closed for user root Sep 18 21:42:33 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0160e57a-10e9-474a-b8ec-4ef59e257609 tempest-VolumesSnapshotListTestJSON-2100830015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca.43f8781b-8b90-424a-be20-0c4ac2bb473e" returned: 0 in 1.085s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:42:33 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0160e57a-10e9-474a-b8ec-4ef59e257609 tempest-VolumesSnapshotListTestJSON-2100830015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca.43f8781b-8b90-424a-be20-0c4ac2bb473e {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:42:33 devstack sudo[97377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca.43f8781b-8b90-424a-be20-0c4ac2bb473e Sep 18 21:42:33 devstack sudo[97377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:42:34 devstack sudo[97377]: pam_unix(sudo:session): session closed for user root Sep 18 21:42:34 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0160e57a-10e9-474a-b8ec-4ef59e257609 tempest-VolumesSnapshotListTestJSON-2100830015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca.43f8781b-8b90-424a-be20-0c4ac2bb473e" returned: 0 in 0.522s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:42:34 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-0160e57a-10e9-474a-b8ec-4ef59e257609 tempest-VolumesSnapshotListTestJSON-2100830015 None] Lock "cinder-quobyte-43f8781b-8b90-424a-be20-0c4ac2bb473e" released by "_delete_snapshot" :: held 3.511s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:42:34 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-0160e57a-10e9-474a-b8ec-4ef59e257609 tempest-VolumesSnapshotListTestJSON-2100830015 None] Lock "cinder-quobyte-136d3779-a375-4515-8fdc-f242c1b4eaca" released by "delete_snapshot" :: held 3.566s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:42:34 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-0160e57a-10e9-474a-b8ec-4ef59e257609 tempest-VolumesSnapshotListTestJSON-2100830015 None] Created reservations ['92cf649d-3d61-4f81-bba7-d0d0fbe94116', '28a80f92-dbf1-4a75-82a4-f9de6e449e28', '6c949f42-d267-4e6b-8039-7b96de73317e', '48c5c670-d39e-46ca-9dc1-18c7dbd66adb'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:42:34 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-0160e57a-10e9-474a-b8ec-4ef59e257609 tempest-VolumesSnapshotListTestJSON-2100830015 None] Delete snapshot completed successfully. Sep 18 21:42:34 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-0160e57a-10e9-474a-b8ec-4ef59e257609 tempest-VolumesSnapshotListTestJSON-2100830015 None] Lock "cinder-43f8781b-8b90-424a-be20-0c4ac2bb473e-delete_snapshot" released by "delete_snapshot" :: held 3.963s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:42:35 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-85d8fba2-c0ca-402f-a7c2-a18e114155f3 tempest-VolumesSnapshotListTestJSON-2100830015 None] Acquiring lock "cinder-1c4048e0-dbcd-48ac-a988-27ac379dd9d3-delete_snapshot" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:42:35 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-85d8fba2-c0ca-402f-a7c2-a18e114155f3 tempest-VolumesSnapshotListTestJSON-2100830015 None] Lock "cinder-1c4048e0-dbcd-48ac-a988-27ac379dd9d3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:42:35 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-85d8fba2-c0ca-402f-a7c2-a18e114155f3 tempest-VolumesSnapshotListTestJSON-2100830015 None] Acquiring lock "cinder-quobyte-136d3779-a375-4515-8fdc-f242c1b4eaca" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:42:35 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-85d8fba2-c0ca-402f-a7c2-a18e114155f3 tempest-VolumesSnapshotListTestJSON-2100830015 None] Lock "cinder-quobyte-136d3779-a375-4515-8fdc-f242c1b4eaca" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:42:35 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-85d8fba2-c0ca-402f-a7c2-a18e114155f3 tempest-VolumesSnapshotListTestJSON-2100830015 None] Acquiring lock "cinder-quobyte-1c4048e0-dbcd-48ac-a988-27ac379dd9d3" by "_delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:42:35 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-85d8fba2-c0ca-402f-a7c2-a18e114155f3 tempest-VolumesSnapshotListTestJSON-2100830015 None] Lock "cinder-quobyte-1c4048e0-dbcd-48ac-a988-27ac379dd9d3" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:42:35 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-85d8fba2-c0ca-402f-a7c2-a18e114155f3 tempest-VolumesSnapshotListTestJSON-2100830015 None] Deleting offline snapshot 1c4048e0-dbcd-48ac-a988-27ac379dd9d3 of volume 136d3779-a375-4515-8fdc-f242c1b4eaca {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 21:42:35 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-85d8fba2-c0ca-402f-a7c2-a18e114155f3 tempest-VolumesSnapshotListTestJSON-2100830015 None] snapshot_file for this snap is: volume-136d3779-a375-4515-8fdc-f242c1b4eaca.1c4048e0-dbcd-48ac-a988-27ac379dd9d3 {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 21:42:35 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[76436769-2155-4360-b87e-5f505a024230]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:42:35 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-85d8fba2-c0ca-402f-a7c2-a18e114155f3 tempest-VolumesSnapshotListTestJSON-2100830015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca.1c4048e0-dbcd-48ac-a988-27ac379dd9d3 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:42:35 devstack sudo[97380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca.1c4048e0-dbcd-48ac-a988-27ac379dd9d3 Sep 18 21:42:35 devstack sudo[97380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:42:36 devstack sudo[97380]: pam_unix(sudo:session): session closed for user root Sep 18 21:42:36 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-85d8fba2-c0ca-402f-a7c2-a18e114155f3 tempest-VolumesSnapshotListTestJSON-2100830015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca.1c4048e0-dbcd-48ac-a988-27ac379dd9d3" returned: 0 in 0.957s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:42:36 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-85d8fba2-c0ca-402f-a7c2-a18e114155f3 tempest-VolumesSnapshotListTestJSON-2100830015 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-136d3779-a375-4515-8fdc-f242c1b4eaca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86136) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 21:42:36 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[016040b7-15c5-432a-9d51-3e911c856361]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:42:36 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-85d8fba2-c0ca-402f-a7c2-a18e114155f3 tempest-VolumesSnapshotListTestJSON-2100830015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:42:36 devstack sudo[97388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca Sep 18 21:42:36 devstack sudo[97388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:42:37 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-e10041d1-8d31-4e7c-b972-84a884fb1480 req-d63d0836-8a0b-4ac8-a1ee-3ae4bafba0a7 tempest-TestServerVolumeAttachmentScenario-735605229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:42:37 devstack sudo[97388]: pam_unix(sudo:session): session closed for user root Sep 18 21:42:37 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-85d8fba2-c0ca-402f-a7c2-a18e114155f3 tempest-VolumesSnapshotListTestJSON-2100830015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca" returned: 0 in 0.776s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:42:37 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-85d8fba2-c0ca-402f-a7c2-a18e114155f3 tempest-VolumesSnapshotListTestJSON-2100830015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca.1c4048e0-dbcd-48ac-a988-27ac379dd9d3 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:42:37 devstack sudo[97401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca.1c4048e0-dbcd-48ac-a988-27ac379dd9d3 Sep 18 21:42:37 devstack sudo[97401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:42:38 devstack sudo[97401]: pam_unix(sudo:session): session closed for user root Sep 18 21:42:38 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-85d8fba2-c0ca-402f-a7c2-a18e114155f3 tempest-VolumesSnapshotListTestJSON-2100830015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca.1c4048e0-dbcd-48ac-a988-27ac379dd9d3" returned: 0 in 0.873s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:42:38 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-85d8fba2-c0ca-402f-a7c2-a18e114155f3 tempest-VolumesSnapshotListTestJSON-2100830015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca.1c4048e0-dbcd-48ac-a988-27ac379dd9d3 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:42:38 devstack sudo[97407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca.1c4048e0-dbcd-48ac-a988-27ac379dd9d3 Sep 18 21:42:38 devstack sudo[97407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:42:38 devstack sudo[97407]: pam_unix(sudo:session): session closed for user root Sep 18 21:42:38 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-85d8fba2-c0ca-402f-a7c2-a18e114155f3 tempest-VolumesSnapshotListTestJSON-2100830015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca.1c4048e0-dbcd-48ac-a988-27ac379dd9d3" returned: 0 in 0.447s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:42:38 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-85d8fba2-c0ca-402f-a7c2-a18e114155f3 tempest-VolumesSnapshotListTestJSON-2100830015 None] Lock "cinder-quobyte-1c4048e0-dbcd-48ac-a988-27ac379dd9d3" released by "_delete_snapshot" :: held 3.342s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:42:38 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-85d8fba2-c0ca-402f-a7c2-a18e114155f3 tempest-VolumesSnapshotListTestJSON-2100830015 None] Lock "cinder-quobyte-136d3779-a375-4515-8fdc-f242c1b4eaca" released by "delete_snapshot" :: held 3.386s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:42:38 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-85d8fba2-c0ca-402f-a7c2-a18e114155f3 tempest-VolumesSnapshotListTestJSON-2100830015 None] Created reservations ['a6b0fcee-6db9-485d-8f44-97f5b4b874b3', '3a7ce34b-2224-40b1-8ed0-91404498fc8e', '39192480-1227-4a3c-9471-575439f4ad64', '282d31f7-a655-4772-84bd-244d1fd5c6d4'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:42:39 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-85d8fba2-c0ca-402f-a7c2-a18e114155f3 tempest-VolumesSnapshotListTestJSON-2100830015 None] Delete snapshot completed successfully. Sep 18 21:42:39 devstack sudo[97347]: pam_unix(sudo:session): session closed for user root Sep 18 21:42:39 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-85d8fba2-c0ca-402f-a7c2-a18e114155f3 tempest-VolumesSnapshotListTestJSON-2100830015 None] Lock "cinder-1c4048e0-dbcd-48ac-a988-27ac379dd9d3-delete_snapshot" released by "delete_snapshot" :: held 3.726s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:42:39 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-cb18e378-6b68-48f2-961f-2133a3482d48 tempest-VolumesActionsTest-2137630509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7d13f471-bb17-42dc-ba2d-ba62328501e6 /opt/stack/data/cinder/conversion/7d13f471-bb17-42dc-ba2d-ba62328501e6.temp_image.27d153ad-386b-46e4-b101-0c5d41da9c98h9llv4ko.img" returned: 0 in 8.919s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:42:39 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[33fcd327-05f8-4eb6-b0fd-f8aa00bbab9d]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:42:39 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-cb18e378-6b68-48f2-961f-2133a3482d48 tempest-VolumesActionsTest-2137630509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7d13f471-bb17-42dc-ba2d-ba62328501e6 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:42:39 devstack sudo[97413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7d13f471-bb17-42dc-ba2d-ba62328501e6 Sep 18 21:42:39 devstack sudo[97413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:42:39 devstack sudo[97413]: pam_unix(sudo:session): session closed for user root Sep 18 21:42:39 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-cb18e378-6b68-48f2-961f-2133a3482d48 tempest-VolumesActionsTest-2137630509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7d13f471-bb17-42dc-ba2d-ba62328501e6" returned: 0 in 0.587s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:42:39 devstack cinder-volume[86136]: DEBUG cinder.image.image_utils [None req-cb18e378-6b68-48f2-961f-2133a3482d48 tempest-VolumesActionsTest-2137630509 None] Image conversion details: src /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7d13f471-bb17-42dc-ba2d-ba62328501e6, size 1024.00 MB, duration 8.92 sec, destination /opt/stack/data/cinder/conversion/7d13f471-bb17-42dc-ba2d-ba62328501e6.temp_image.27d153ad-386b-46e4-b101-0c5d41da9c98h9llv4ko.img {{(pid=86136) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 18 21:42:39 devstack cinder-volume[86136]: INFO cinder.image.image_utils [None req-cb18e378-6b68-48f2-961f-2133a3482d48 tempest-VolumesActionsTest-2137630509 None] Converted 1024.00 MB image at 114.80 MB/s Sep 18 21:42:39 devstack cinder-volume[86136]: DEBUG cinder.image.image_utils [None req-cb18e378-6b68-48f2-961f-2133a3482d48 tempest-VolumesActionsTest-2137630509 None] 27d153ad-386b-46e4-b101-0c5d41da9c98 was raw, no need to convert to raw {{(pid=86136) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 18 21:42:39 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-76781e79-2c93-4d2b-b14a-6170aacc8305 tempest-VolumesSnapshotListTestJSON-2100830015 None] Acquiring lock "cinder-136d3779-a375-4515-8fdc-f242c1b4eaca-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:42:39 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-76781e79-2c93-4d2b-b14a-6170aacc8305 tempest-VolumesSnapshotListTestJSON-2100830015 None] Lock "cinder-136d3779-a375-4515-8fdc-f242c1b4eaca-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:42:39 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-76781e79-2c93-4d2b-b14a-6170aacc8305 tempest-VolumesSnapshotListTestJSON-2100830015 None] Acquiring lock "cinder-quobyte-136d3779-a375-4515-8fdc-f242c1b4eaca" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:42:39 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-76781e79-2c93-4d2b-b14a-6170aacc8305 tempest-VolumesSnapshotListTestJSON-2100830015 None] Lock "cinder-quobyte-136d3779-a375-4515-8fdc-f242c1b4eaca" acquired by "delete_volume" :: waited 0.021s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:42:39 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc5a08c9-8a1f-4782-9d2a-a8974cebeda3]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:42:39 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-76781e79-2c93-4d2b-b14a-6170aacc8305 tempest-VolumesSnapshotListTestJSON-2100830015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:42:40 devstack sudo[97418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca Sep 18 21:42:40 devstack sudo[97418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:42:40 devstack sudo[97418]: pam_unix(sudo:session): session closed for user root Sep 18 21:42:40 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-76781e79-2c93-4d2b-b14a-6170aacc8305 tempest-VolumesSnapshotListTestJSON-2100830015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca" returned: 0 in 0.486s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:42:40 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-76781e79-2c93-4d2b-b14a-6170aacc8305 tempest-VolumesSnapshotListTestJSON-2100830015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:42:40 devstack sudo[97424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca Sep 18 21:42:40 devstack sudo[97424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:42:40 devstack sudo[97424]: pam_unix(sudo:session): session closed for user root Sep 18 21:42:40 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-76781e79-2c93-4d2b-b14a-6170aacc8305 tempest-VolumesSnapshotListTestJSON-2100830015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-136d3779-a375-4515-8fdc-f242c1b4eaca" returned: 0 in 0.356s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:42:40 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-76781e79-2c93-4d2b-b14a-6170aacc8305 tempest-VolumesSnapshotListTestJSON-2100830015 None] Lock "cinder-quobyte-136d3779-a375-4515-8fdc-f242c1b4eaca" released by "delete_volume" :: held 0.933s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:42:41 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-76781e79-2c93-4d2b-b14a-6170aacc8305 tempest-VolumesSnapshotListTestJSON-2100830015 None] Created reservations ['6c64bad0-3234-45d6-a4fb-264ea72ba843', '207867d2-51f0-4e97-9c09-eb9df94e3b98', '68089071-7380-4fa6-86c9-b0b249e85fdf', 'd35c1245-bf94-4064-b60e-31e421e71116'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:42:41 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-76781e79-2c93-4d2b-b14a-6170aacc8305 tempest-VolumesSnapshotListTestJSON-2100830015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:42:41 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-76781e79-2c93-4d2b-b14a-6170aacc8305 tempest-VolumesSnapshotListTestJSON-2100830015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:42:41 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-76781e79-2c93-4d2b-b14a-6170aacc8305 tempest-VolumesSnapshotListTestJSON-2100830015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:42:41 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-76781e79-2c93-4d2b-b14a-6170aacc8305 tempest-VolumesSnapshotListTestJSON-2100830015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:42:41 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-76781e79-2c93-4d2b-b14a-6170aacc8305 tempest-VolumesSnapshotListTestJSON-2100830015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:42:41 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-76781e79-2c93-4d2b-b14a-6170aacc8305 tempest-VolumesSnapshotListTestJSON-2100830015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:42:41 devstack sudo[97438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:42:41 devstack sudo[97438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:42:41 devstack sudo[97438]: pam_unix(sudo:session): session closed for user root Sep 18 21:42:41 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-76781e79-2c93-4d2b-b14a-6170aacc8305 tempest-VolumesSnapshotListTestJSON-2100830015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.430s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:42:41 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-76781e79-2c93-4d2b-b14a-6170aacc8305 tempest-VolumesSnapshotListTestJSON-2100830015 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:42:41 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-76781e79-2c93-4d2b-b14a-6170aacc8305 tempest-VolumesSnapshotListTestJSON-2100830015 None] Deleted volume successfully. Sep 18 21:42:41 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-76781e79-2c93-4d2b-b14a-6170aacc8305 tempest-VolumesSnapshotListTestJSON-2100830015 None] Lock "cinder-136d3779-a375-4515-8fdc-f242c1b4eaca-delete_volume" released by "delete_volume" :: held 1.723s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:42:51 devstack cinder-volume[86136]: DEBUG dbcounter [-] [86136] Writing DB stats cinder:UPDATE=78,cinder:SELECT=82,cinder:INSERT=21,cinder:DELETE=9 {{(pid=86136) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 21:42:51 devstack cinder-volume[86136]: DEBUG dbcounter [-] [86136] Writing DB stats cinder:SELECT=83,cinder:UPDATE=90,cinder:DELETE=6,cinder:INSERT=20 {{(pid=86136) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 21:43:05 devstack cinder-volume[86136]: DEBUG oslo_service.periodic_task [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Running periodic task VolumeManager._thread_info {{(pid=86136) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 21:43:05 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] thread count: 28 {{(pid=86136) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 18 21:43:05 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] thread info: [<_MainThread(MainThread, started 138548347871360)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86136) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 18 21:43:06 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-cb18e378-6b68-48f2-961f-2133a3482d48 tempest-VolumesActionsTest-2137630509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 36.772s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:43:06 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-cb18e378-6b68-48f2-961f-2133a3482d48 tempest-VolumesActionsTest-2137630509 None] Uploaded volume to glance image-id: 27d153ad-386b-46e4-b101-0c5d41da9c98. {{(pid=86136) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 18 21:43:06 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-e10041d1-8d31-4e7c-b972-84a884fb1480 req-d63d0836-8a0b-4ac8-a1ee-3ae4bafba0a7 tempest-TestServerVolumeAttachmentScenario-735605229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 28.913s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:43:06 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-e10041d1-8d31-4e7c-b972-84a884fb1480 req-d63d0836-8a0b-4ac8-a1ee-3ae4bafba0a7 tempest-TestServerVolumeAttachmentScenario-735605229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:43:06 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-cb18e378-6b68-48f2-961f-2133a3482d48 tempest-VolumesActionsTest-2137630509 None] Copy volume to image completed successfully. Sep 18 21:43:06 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [req-e10041d1-8d31-4e7c-b972-84a884fb1480 req-d63d0836-8a0b-4ac8-a1ee-3ae4bafba0a7 tempest-TestServerVolumeAttachmentScenario-735605229 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff', 'name': 'volume-bfeb9879-d81d-43b7-8ecf-bb45599f7db4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ef011eab-9f1f-4858-8e0a-a0877b698343', 'enforce_multipath': True} {{(pid=86136) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 18 21:43:06 devstack cinder-volume[86136]: INFO cinder.volume.manager [req-e10041d1-8d31-4e7c-b972-84a884fb1480 req-d63d0836-8a0b-4ac8-a1ee-3ae4bafba0a7 tempest-TestServerVolumeAttachmentScenario-735605229 None] attachment_update completed successfully. Sep 18 21:43:07 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-b83943aa-79b5-4582-b520-9065f6048d4c tempest-VolumesActionsTest-2137630509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:43:07 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-b83943aa-79b5-4582-b520-9065f6048d4c tempest-VolumesActionsTest-2137630509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:43:07 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf70fcbd-b208-4a4b-8c7d-d035e59ca19e]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:43:07 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-b83943aa-79b5-4582-b520-9065f6048d4c tempest-VolumesActionsTest-2137630509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7d13f471-bb17-42dc-ba2d-ba62328501e6 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:43:07 devstack sudo[97986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7d13f471-bb17-42dc-ba2d-ba62328501e6 Sep 18 21:43:07 devstack sudo[97986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:43:08 devstack sudo[97986]: pam_unix(sudo:session): session closed for user root Sep 18 21:43:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-b83943aa-79b5-4582-b520-9065f6048d4c tempest-VolumesActionsTest-2137630509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7d13f471-bb17-42dc-ba2d-ba62328501e6" returned: 0 in 0.417s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:43:08 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfed0850-7077-4b6e-b05d-add7e8b31e42]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:43:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-b83943aa-79b5-4582-b520-9065f6048d4c tempest-VolumesActionsTest-2137630509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7d13f471-bb17-42dc-ba2d-ba62328501e6 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:43:08 devstack sudo[97991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7d13f471-bb17-42dc-ba2d-ba62328501e6 Sep 18 21:43:08 devstack sudo[97991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:43:08 devstack sudo[97991]: pam_unix(sudo:session): session closed for user root Sep 18 21:43:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-b83943aa-79b5-4582-b520-9065f6048d4c tempest-VolumesActionsTest-2137630509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7d13f471-bb17-42dc-ba2d-ba62328501e6" returned: 0 in 0.468s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:43:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-b83943aa-79b5-4582-b520-9065f6048d4c tempest-VolumesActionsTest-2137630509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7d13f471-bb17-42dc-ba2d-ba62328501e6 /opt/stack/data/cinder/conversion/7d13f471-bb17-42dc-ba2d-ba62328501e6.temp_image.e9085541-4b6e-4a06-a7ba-e0b803139f31uwmjwu0v.img {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:43:08 devstack sudo[97996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7d13f471-bb17-42dc-ba2d-ba62328501e6 /opt/stack/data/cinder/conversion/7d13f471-bb17-42dc-ba2d-ba62328501e6.temp_image.e9085541-4b6e-4a06-a7ba-e0b803139f31uwmjwu0v.img Sep 18 21:43:08 devstack sudo[97996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:43:11 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8758d21-9f81-4278-a9c6-9b31cef9f299 tempest-AttachVolumeNegativeTest-605821046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:43:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f8758d21-9f81-4278-a9c6-9b31cef9f299 tempest-AttachVolumeNegativeTest-605821046 None] Flow 'volume_create_manager' (a9c934e9-33f4-435e-8963-21f46b927511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:43:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f8758d21-9f81-4278-a9c6-9b31cef9f299 tempest-AttachVolumeNegativeTest-605821046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4a8cc23-fb8e-4573-859a-0d78abb642d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:43:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f8758d21-9f81-4278-a9c6-9b31cef9f299 tempest-AttachVolumeNegativeTest-605821046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4a8cc23-fb8e-4573-859a-0d78abb642d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:43:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-444271454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16509596-8851-42d6-b941-39d3bae618e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30df0b9dab9e41068c0b4f9907624377',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:43:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:43:11Z,use_quota=True,user_id='cd990a60d4a840228debec9b50923d6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:43:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f8758d21-9f81-4278-a9c6-9b31cef9f299 tempest-AttachVolumeNegativeTest-605821046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b82e04e2-1f11-4651-9550-281acde2770b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:43:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f8758d21-9f81-4278-a9c6-9b31cef9f299 tempest-AttachVolumeNegativeTest-605821046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b82e04e2-1f11-4651-9550-281acde2770b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:43:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f8758d21-9f81-4278-a9c6-9b31cef9f299 tempest-AttachVolumeNegativeTest-605821046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4df0fcdd-c251-49f5-8244-006dc6db0072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:43:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f8758d21-9f81-4278-a9c6-9b31cef9f299 tempest-AttachVolumeNegativeTest-605821046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4df0fcdd-c251-49f5-8244-006dc6db0072) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16509596-8851-42d6-b941-39d3bae618e6', 'volume_name': 'volume-16509596-8851-42d6-b941-39d3bae618e6', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:43:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f8758d21-9f81-4278-a9c6-9b31cef9f299 tempest-AttachVolumeNegativeTest-605821046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2889152-733c-46de-9b7f-f988cf0b2e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:43:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f8758d21-9f81-4278-a9c6-9b31cef9f299 tempest-AttachVolumeNegativeTest-605821046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2889152-733c-46de-9b7f-f988cf0b2e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:43:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f8758d21-9f81-4278-a9c6-9b31cef9f299 tempest-AttachVolumeNegativeTest-605821046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49bc6561-53b2-4567-be03-069a1b731f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:43:11 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-f8758d21-9f81-4278-a9c6-9b31cef9f299 tempest-AttachVolumeNegativeTest-605821046 None] Volume 16509596-8851-42d6-b941-39d3bae618e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16509596-8851-42d6-b941-39d3bae618e6', 'volume_size': 1} Sep 18 21:43:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-f8758d21-9f81-4278-a9c6-9b31cef9f299 tempest-AttachVolumeNegativeTest-605821046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:43:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-338b8f62-8adb-4f0c-8cef-9451bfd24c25 req-213347ab-416a-4911-a320-54fa4e4e6d18 tempest-TestServerVolumeAttachmentScenario-735605229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:43:16 devstack sudo[97996]: pam_unix(sudo:session): session closed for user root Sep 18 21:43:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-b83943aa-79b5-4582-b520-9065f6048d4c tempest-VolumesActionsTest-2137630509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7d13f471-bb17-42dc-ba2d-ba62328501e6 /opt/stack/data/cinder/conversion/7d13f471-bb17-42dc-ba2d-ba62328501e6.temp_image.e9085541-4b6e-4a06-a7ba-e0b803139f31uwmjwu0v.img" returned: 0 in 8.314s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:43:16 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa000ceb-7758-432a-80c5-4b5a2a181261]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:43:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-b83943aa-79b5-4582-b520-9065f6048d4c tempest-VolumesActionsTest-2137630509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7d13f471-bb17-42dc-ba2d-ba62328501e6 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:43:16 devstack sudo[98024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7d13f471-bb17-42dc-ba2d-ba62328501e6 Sep 18 21:43:16 devstack sudo[98024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:43:17 devstack sudo[98024]: pam_unix(sudo:session): session closed for user root Sep 18 21:43:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-b83943aa-79b5-4582-b520-9065f6048d4c tempest-VolumesActionsTest-2137630509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7d13f471-bb17-42dc-ba2d-ba62328501e6" returned: 0 in 0.626s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:43:17 devstack cinder-volume[86136]: DEBUG cinder.image.image_utils [None req-b83943aa-79b5-4582-b520-9065f6048d4c tempest-VolumesActionsTest-2137630509 None] Image conversion details: src /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7d13f471-bb17-42dc-ba2d-ba62328501e6, size 1024.00 MB, duration 8.32 sec, destination /opt/stack/data/cinder/conversion/7d13f471-bb17-42dc-ba2d-ba62328501e6.temp_image.e9085541-4b6e-4a06-a7ba-e0b803139f31uwmjwu0v.img {{(pid=86136) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 18 21:43:17 devstack cinder-volume[86136]: INFO cinder.image.image_utils [None req-b83943aa-79b5-4582-b520-9065f6048d4c tempest-VolumesActionsTest-2137630509 None] Converted 1024.00 MB image at 123.14 MB/s Sep 18 21:43:17 devstack cinder-volume[86136]: DEBUG cinder.image.image_utils [None req-b83943aa-79b5-4582-b520-9065f6048d4c tempest-VolumesActionsTest-2137630509 None] e9085541-4b6e-4a06-a7ba-e0b803139f31 was raw, converting to qcow2 {{(pid=86136) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Sep 18 21:43:17 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[edee6aff-9222-4583-a33d-a411296efc83]: (4, 'raw') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:43:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-b83943aa-79b5-4582-b520-9065f6048d4c tempest-VolumesActionsTest-2137630509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/7d13f471-bb17-42dc-ba2d-ba62328501e6.temp_image.e9085541-4b6e-4a06-a7ba-e0b803139f31uwmjwu0v.img {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:43:17 devstack sudo[98029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/7d13f471-bb17-42dc-ba2d-ba62328501e6.temp_image.e9085541-4b6e-4a06-a7ba-e0b803139f31uwmjwu0v.img Sep 18 21:43:17 devstack sudo[98029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:43:17 devstack sudo[98029]: pam_unix(sudo:session): session closed for user root Sep 18 21:43:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-b83943aa-79b5-4582-b520-9065f6048d4c tempest-VolumesActionsTest-2137630509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/7d13f471-bb17-42dc-ba2d-ba62328501e6.temp_image.e9085541-4b6e-4a06-a7ba-e0b803139f31uwmjwu0v.img" returned: 0 in 0.328s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:43:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-b83943aa-79b5-4582-b520-9065f6048d4c tempest-VolumesActionsTest-2137630509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/7d13f471-bb17-42dc-ba2d-ba62328501e6.temp_image.e9085541-4b6e-4a06-a7ba-e0b803139f31uwmjwu0v.img {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:43:17 devstack sudo[98033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/7d13f471-bb17-42dc-ba2d-ba62328501e6.temp_image.e9085541-4b6e-4a06-a7ba-e0b803139f31uwmjwu0v.img Sep 18 21:43:17 devstack sudo[98033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:43:18 devstack sudo[98033]: pam_unix(sudo:session): session closed for user root Sep 18 21:43:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-b83943aa-79b5-4582-b520-9065f6048d4c tempest-VolumesActionsTest-2137630509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/7d13f471-bb17-42dc-ba2d-ba62328501e6.temp_image.e9085541-4b6e-4a06-a7ba-e0b803139f31uwmjwu0v.img" returned: 1 in 0.331s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:43:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-b83943aa-79b5-4582-b520-9065f6048d4c tempest-VolumesActionsTest-2137630509 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/7d13f471-bb17-42dc-ba2d-ba62328501e6.temp_image.e9085541-4b6e-4a06-a7ba-e0b803139f31uwmjwu0v.img' failed. Not Retrying. {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 18 21:43:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-b83943aa-79b5-4582-b520-9065f6048d4c tempest-VolumesActionsTest-2137630509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/7d13f471-bb17-42dc-ba2d-ba62328501e6.temp_image.e9085541-4b6e-4a06-a7ba-e0b803139f31uwmjwu0v.img /opt/stack/data/cinder/conversion/vol_upload_a4ivtk76 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:43:18 devstack sudo[98038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/7d13f471-bb17-42dc-ba2d-ba62328501e6.temp_image.e9085541-4b6e-4a06-a7ba-e0b803139f31uwmjwu0v.img /opt/stack/data/cinder/conversion/vol_upload_a4ivtk76 Sep 18 21:43:18 devstack sudo[98038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:43:18 devstack sudo[98038]: pam_unix(sudo:session): session closed for user root Sep 18 21:43:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-b83943aa-79b5-4582-b520-9065f6048d4c tempest-VolumesActionsTest-2137630509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/7d13f471-bb17-42dc-ba2d-ba62328501e6.temp_image.e9085541-4b6e-4a06-a7ba-e0b803139f31uwmjwu0v.img /opt/stack/data/cinder/conversion/vol_upload_a4ivtk76" returned: 0 in 0.287s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:43:18 devstack cinder-volume[86136]: DEBUG cinder.image.image_utils [None req-b83943aa-79b5-4582-b520-9065f6048d4c tempest-VolumesActionsTest-2137630509 None] Image conversion details: src /opt/stack/data/cinder/conversion/7d13f471-bb17-42dc-ba2d-ba62328501e6.temp_image.e9085541-4b6e-4a06-a7ba-e0b803139f31uwmjwu0v.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_a4ivtk76 {{(pid=86136) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 18 21:43:18 devstack cinder-volume[86136]: INFO cinder.image.image_utils [None req-b83943aa-79b5-4582-b520-9065f6048d4c tempest-VolumesActionsTest-2137630509 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 18 21:43:18 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b5cd11-f4ae-4ba1-aa19-9e9ee0c6073e]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:43:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-b83943aa-79b5-4582-b520-9065f6048d4c tempest-VolumesActionsTest-2137630509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_a4ivtk76 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:43:18 devstack sudo[98077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_a4ivtk76 Sep 18 21:43:18 devstack sudo[98077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:43:18 devstack sudo[98077]: pam_unix(sudo:session): session closed for user root Sep 18 21:43:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-b83943aa-79b5-4582-b520-9065f6048d4c tempest-VolumesActionsTest-2137630509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_a4ivtk76" returned: 0 in 0.355s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:43:20 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-b83943aa-79b5-4582-b520-9065f6048d4c tempest-VolumesActionsTest-2137630509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.562s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:43:20 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b83943aa-79b5-4582-b520-9065f6048d4c tempest-VolumesActionsTest-2137630509 None] Uploaded volume to glance image-id: e9085541-4b6e-4a06-a7ba-e0b803139f31. {{(pid=86136) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 18 21:43:20 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-f8758d21-9f81-4278-a9c6-9b31cef9f299 tempest-AttachVolumeNegativeTest-605821046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.886s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:43:20 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-f8758d21-9f81-4278-a9c6-9b31cef9f299 tempest-AttachVolumeNegativeTest-605821046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:43:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-444271454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16509596-8851-42d6-b941-39d3bae618e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30df0b9dab9e41068c0b4f9907624377',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:43:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:43:11Z,use_quota=True,user_id='cd990a60d4a840228debec9b50923d6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:43:20 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-f8758d21-9f81-4278-a9c6-9b31cef9f299 tempest-AttachVolumeNegativeTest-605821046 None] Creating volume 16509596-8851-42d6-b941-39d3bae618e6 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:43:20 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-f8758d21-9f81-4278-a9c6-9b31cef9f299 tempest-AttachVolumeNegativeTest-605821046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:43:20 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-f8758d21-9f81-4278-a9c6-9b31cef9f299 tempest-AttachVolumeNegativeTest-605821046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:43:20 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-f8758d21-9f81-4278-a9c6-9b31cef9f299 tempest-AttachVolumeNegativeTest-605821046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:43:20 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-f8758d21-9f81-4278-a9c6-9b31cef9f299 tempest-AttachVolumeNegativeTest-605821046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:43:20 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-f8758d21-9f81-4278-a9c6-9b31cef9f299 tempest-AttachVolumeNegativeTest-605821046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:43:20 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-f8758d21-9f81-4278-a9c6-9b31cef9f299 tempest-AttachVolumeNegativeTest-605821046 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:43:20 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-f8758d21-9f81-4278-a9c6-9b31cef9f299 tempest-AttachVolumeNegativeTest-605821046 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:43:20 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f8758d21-9f81-4278-a9c6-9b31cef9f299 tempest-AttachVolumeNegativeTest-605821046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-16509596-8851-42d6-b941-39d3bae618e6 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:43:20 devstack sudo[98085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-16509596-8851-42d6-b941-39d3bae618e6 1073741824 Sep 18 21:43:20 devstack sudo[98085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:43:20 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-b83943aa-79b5-4582-b520-9065f6048d4c tempest-VolumesActionsTest-2137630509 None] Copy volume to image completed successfully. Sep 18 21:43:20 devstack sudo[98085]: pam_unix(sudo:session): session closed for user root Sep 18 21:43:20 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f8758d21-9f81-4278-a9c6-9b31cef9f299 tempest-AttachVolumeNegativeTest-605821046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-16509596-8851-42d6-b941-39d3bae618e6 1073741824" returned: 0 in 0.450s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:43:20 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f8758d21-9f81-4278-a9c6-9b31cef9f299 tempest-AttachVolumeNegativeTest-605821046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-16509596-8851-42d6-b941-39d3bae618e6 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:43:20 devstack sudo[98092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-16509596-8851-42d6-b941-39d3bae618e6 Sep 18 21:43:20 devstack sudo[98092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:43:20 devstack sudo[98092]: pam_unix(sudo:session): session closed for user root Sep 18 21:43:20 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f8758d21-9f81-4278-a9c6-9b31cef9f299 tempest-AttachVolumeNegativeTest-605821046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-16509596-8851-42d6-b941-39d3bae618e6" returned: 0 in 0.262s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:43:20 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-f8758d21-9f81-4278-a9c6-9b31cef9f299 tempest-AttachVolumeNegativeTest-605821046 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:43:20 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-f8758d21-9f81-4278-a9c6-9b31cef9f299 tempest-AttachVolumeNegativeTest-605821046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:43:20 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-338b8f62-8adb-4f0c-8cef-9451bfd24c25 req-213347ab-416a-4911-a320-54fa4e4e6d18 tempest-TestServerVolumeAttachmentScenario-735605229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.404s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:43:20 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-338b8f62-8adb-4f0c-8cef-9451bfd24c25 req-213347ab-416a-4911-a320-54fa4e4e6d18 tempest-TestServerVolumeAttachmentScenario-735605229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:43:20 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f8758d21-9f81-4278-a9c6-9b31cef9f299 tempest-AttachVolumeNegativeTest-605821046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49bc6561-53b2-4567-be03-069a1b731f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16509596-8851-42d6-b941-39d3bae618e6', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:43:20 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f8758d21-9f81-4278-a9c6-9b31cef9f299 tempest-AttachVolumeNegativeTest-605821046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9304482d-d80c-4280-be37-c470965ba356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:43:20 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-f8758d21-9f81-4278-a9c6-9b31cef9f299 tempest-AttachVolumeNegativeTest-605821046 None] Volume volume-16509596-8851-42d6-b941-39d3bae618e6 (16509596-8851-42d6-b941-39d3bae618e6): created successfully Sep 18 21:43:21 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f8758d21-9f81-4278-a9c6-9b31cef9f299 tempest-AttachVolumeNegativeTest-605821046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9304482d-d80c-4280-be37-c470965ba356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:43:21 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f8758d21-9f81-4278-a9c6-9b31cef9f299 tempest-AttachVolumeNegativeTest-605821046 None] Flow 'volume_create_manager' (a9c934e9-33f4-435e-8963-21f46b927511) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:43:21 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [req-338b8f62-8adb-4f0c-8cef-9451bfd24c25 req-213347ab-416a-4911-a320-54fa4e4e6d18 tempest-TestServerVolumeAttachmentScenario-735605229 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff', 'name': 'volume-c0a22dd5-118a-43a0-99e5-0f8f3186a712', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fd0b6066-4ad4-4614-9166-cd3bc45201c1', 'enforce_multipath': True} {{(pid=86136) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 18 21:43:21 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-f8758d21-9f81-4278-a9c6-9b31cef9f299 tempest-AttachVolumeNegativeTest-605821046 None] Created volume successfully. Sep 18 21:43:21 devstack cinder-volume[86136]: INFO cinder.volume.manager [req-338b8f62-8adb-4f0c-8cef-9451bfd24c25 req-213347ab-416a-4911-a320-54fa4e4e6d18 tempest-TestServerVolumeAttachmentScenario-735605229 None] attachment_update completed successfully. Sep 18 21:43:21 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-525eee9d-a155-442d-860b-dc63484535f5 tempest-TestInstancesWithCinderVolumes-34987593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:43:21 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-525eee9d-a155-442d-860b-dc63484535f5 tempest-TestInstancesWithCinderVolumes-34987593 None] Flow 'volume_create_manager' (bb8d4d6d-4317-48ae-91fc-d744aab0741a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:43:21 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-525eee9d-a155-442d-860b-dc63484535f5 tempest-TestInstancesWithCinderVolumes-34987593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ca6c102-b4d8-4a8b-b578-c2c5cc5eda0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:43:21 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-525eee9d-a155-442d-860b-dc63484535f5 tempest-TestInstancesWithCinderVolumes-34987593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ca6c102-b4d8-4a8b-b578-c2c5cc5eda0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:43:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-505816225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84a2b4c6-6677-4b37-9c7e-271b0d9c5aad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ef7f03caecd4fd69acbe26157891fb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:43:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:43:21Z,use_quota=True,user_id='bac1913499e240e4a2e5441614850415',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f3a14e9-f309-4da0-8d0e-3272957feac9),volume_type_id=2f3a14e9-f309-4da0-8d0e-3272957feac9)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:43:21 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-525eee9d-a155-442d-860b-dc63484535f5 tempest-TestInstancesWithCinderVolumes-34987593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d0bbcde-dec4-44a1-91fb-a75b79dd5ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:43:21 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-525eee9d-a155-442d-860b-dc63484535f5 tempest-TestInstancesWithCinderVolumes-34987593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d0bbcde-dec4-44a1-91fb-a75b79dd5ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:43:21 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-525eee9d-a155-442d-860b-dc63484535f5 tempest-TestInstancesWithCinderVolumes-34987593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df3f9fb6-c231-47cd-b67d-aaeaaf166c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:43:21 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-525eee9d-a155-442d-860b-dc63484535f5 tempest-TestInstancesWithCinderVolumes-34987593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df3f9fb6-c231-47cd-b67d-aaeaaf166c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84a2b4c6-6677-4b37-9c7e-271b0d9c5aad', 'volume_name': 'volume-84a2b4c6-6677-4b37-9c7e-271b0d9c5aad', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:43:21 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-525eee9d-a155-442d-860b-dc63484535f5 tempest-TestInstancesWithCinderVolumes-34987593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6e8b429-3bbb-4200-86f2-3b098e7b13ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:43:21 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-525eee9d-a155-442d-860b-dc63484535f5 tempest-TestInstancesWithCinderVolumes-34987593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6e8b429-3bbb-4200-86f2-3b098e7b13ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:43:21 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-525eee9d-a155-442d-860b-dc63484535f5 tempest-TestInstancesWithCinderVolumes-34987593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba6b5637-1065-421d-9e98-7b85e7db1a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:43:21 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-525eee9d-a155-442d-860b-dc63484535f5 tempest-TestInstancesWithCinderVolumes-34987593 None] Volume 84a2b4c6-6677-4b37-9c7e-271b0d9c5aad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84a2b4c6-6677-4b37-9c7e-271b0d9c5aad', 'volume_size': 1} Sep 18 21:43:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-525eee9d-a155-442d-860b-dc63484535f5 tempest-TestInstancesWithCinderVolumes-34987593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:43:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-525eee9d-a155-442d-860b-dc63484535f5 tempest-TestInstancesWithCinderVolumes-34987593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:43:21 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-525eee9d-a155-442d-860b-dc63484535f5 tempest-TestInstancesWithCinderVolumes-34987593 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:43:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-505816225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84a2b4c6-6677-4b37-9c7e-271b0d9c5aad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ef7f03caecd4fd69acbe26157891fb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:43:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:43:21Z,use_quota=True,user_id='bac1913499e240e4a2e5441614850415',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f3a14e9-f309-4da0-8d0e-3272957feac9),volume_type_id=2f3a14e9-f309-4da0-8d0e-3272957feac9)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:43:21 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-525eee9d-a155-442d-860b-dc63484535f5 tempest-TestInstancesWithCinderVolumes-34987593 None] Creating volume 84a2b4c6-6677-4b37-9c7e-271b0d9c5aad {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:43:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-525eee9d-a155-442d-860b-dc63484535f5 tempest-TestInstancesWithCinderVolumes-34987593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:43:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-525eee9d-a155-442d-860b-dc63484535f5 tempest-TestInstancesWithCinderVolumes-34987593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:43:21 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-525eee9d-a155-442d-860b-dc63484535f5 tempest-TestInstancesWithCinderVolumes-34987593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:43:21 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-525eee9d-a155-442d-860b-dc63484535f5 tempest-TestInstancesWithCinderVolumes-34987593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:43:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-525eee9d-a155-442d-860b-dc63484535f5 tempest-TestInstancesWithCinderVolumes-34987593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:43:21 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-525eee9d-a155-442d-860b-dc63484535f5 tempest-TestInstancesWithCinderVolumes-34987593 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:43:21 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-525eee9d-a155-442d-860b-dc63484535f5 tempest-TestInstancesWithCinderVolumes-34987593 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:43:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-525eee9d-a155-442d-860b-dc63484535f5 tempest-TestInstancesWithCinderVolumes-34987593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-84a2b4c6-6677-4b37-9c7e-271b0d9c5aad 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:43:21 devstack sudo[98097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-84a2b4c6-6677-4b37-9c7e-271b0d9c5aad 1073741824 Sep 18 21:43:21 devstack sudo[98097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:43:21 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ab7b0a6-86ad-4958-a8f0-2bc0cbd48cb8 tempest-TestInstancesWithCinderVolumes-34987593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:43:21 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6ab7b0a6-86ad-4958-a8f0-2bc0cbd48cb8 tempest-TestInstancesWithCinderVolumes-34987593 None] Flow 'volume_create_manager' (740b7494-b6ab-4c56-8c29-df121a09a871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:43:21 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6ab7b0a6-86ad-4958-a8f0-2bc0cbd48cb8 tempest-TestInstancesWithCinderVolumes-34987593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (275a950d-931b-4fe6-8886-6a678fcbf095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:43:21 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6ab7b0a6-86ad-4958-a8f0-2bc0cbd48cb8 tempest-TestInstancesWithCinderVolumes-34987593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (275a950d-931b-4fe6-8886-6a678fcbf095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:43:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-259089131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=120b2523-d362-4bb1-a2b0-e0e3eea65b01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ef7f03caecd4fd69acbe26157891fb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:43:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:43:22Z,use_quota=True,user_id='bac1913499e240e4a2e5441614850415',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(48761f51-129b-4ef0-ae0e-1bb55b65bfa6),volume_type_id=48761f51-129b-4ef0-ae0e-1bb55b65bfa6)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:43:21 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6ab7b0a6-86ad-4958-a8f0-2bc0cbd48cb8 tempest-TestInstancesWithCinderVolumes-34987593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cef740b-6139-43ed-8c0a-cdbc5d6723bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:43:21 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6ab7b0a6-86ad-4958-a8f0-2bc0cbd48cb8 tempest-TestInstancesWithCinderVolumes-34987593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cef740b-6139-43ed-8c0a-cdbc5d6723bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:43:21 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6ab7b0a6-86ad-4958-a8f0-2bc0cbd48cb8 tempest-TestInstancesWithCinderVolumes-34987593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (341eee15-0ac0-4464-a07c-53417fad4087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:43:21 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6ab7b0a6-86ad-4958-a8f0-2bc0cbd48cb8 tempest-TestInstancesWithCinderVolumes-34987593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (341eee15-0ac0-4464-a07c-53417fad4087) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '120b2523-d362-4bb1-a2b0-e0e3eea65b01', 'volume_name': 'volume-120b2523-d362-4bb1-a2b0-e0e3eea65b01', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:43:21 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6ab7b0a6-86ad-4958-a8f0-2bc0cbd48cb8 tempest-TestInstancesWithCinderVolumes-34987593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93205de8-2dd9-402e-816b-dd93b83e8344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:43:21 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6ab7b0a6-86ad-4958-a8f0-2bc0cbd48cb8 tempest-TestInstancesWithCinderVolumes-34987593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93205de8-2dd9-402e-816b-dd93b83e8344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:43:21 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6ab7b0a6-86ad-4958-a8f0-2bc0cbd48cb8 tempest-TestInstancesWithCinderVolumes-34987593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a405a10e-73fa-4293-a4de-602322498ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:43:21 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-6ab7b0a6-86ad-4958-a8f0-2bc0cbd48cb8 tempest-TestInstancesWithCinderVolumes-34987593 None] Volume 120b2523-d362-4bb1-a2b0-e0e3eea65b01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-120b2523-d362-4bb1-a2b0-e0e3eea65b01', 'volume_size': 1} Sep 18 21:43:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6ab7b0a6-86ad-4958-a8f0-2bc0cbd48cb8 tempest-TestInstancesWithCinderVolumes-34987593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:43:21 devstack sudo[98097]: pam_unix(sudo:session): session closed for user root Sep 18 21:43:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-525eee9d-a155-442d-860b-dc63484535f5 tempest-TestInstancesWithCinderVolumes-34987593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-84a2b4c6-6677-4b37-9c7e-271b0d9c5aad 1073741824" returned: 0 in 0.730s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:43:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-525eee9d-a155-442d-860b-dc63484535f5 tempest-TestInstancesWithCinderVolumes-34987593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-84a2b4c6-6677-4b37-9c7e-271b0d9c5aad {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:43:22 devstack sudo[98104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-84a2b4c6-6677-4b37-9c7e-271b0d9c5aad Sep 18 21:43:22 devstack sudo[98104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:43:22 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-c8a9ffc9-5334-4e29-9540-53154d09057b tempest-VolumesActionsTest-2137630509 None] Acquiring lock "cinder-7d13f471-bb17-42dc-ba2d-ba62328501e6-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:43:22 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-c8a9ffc9-5334-4e29-9540-53154d09057b tempest-VolumesActionsTest-2137630509 None] Lock "cinder-7d13f471-bb17-42dc-ba2d-ba62328501e6-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:43:22 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-c8a9ffc9-5334-4e29-9540-53154d09057b tempest-VolumesActionsTest-2137630509 None] Acquiring lock "cinder-quobyte-7d13f471-bb17-42dc-ba2d-ba62328501e6" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:43:22 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-c8a9ffc9-5334-4e29-9540-53154d09057b tempest-VolumesActionsTest-2137630509 None] Lock "cinder-quobyte-7d13f471-bb17-42dc-ba2d-ba62328501e6" acquired by "delete_volume" :: waited 0.036s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:43:22 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1f3a29-a759-4820-9fee-185523e45b08]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:43:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c8a9ffc9-5334-4e29-9540-53154d09057b tempest-VolumesActionsTest-2137630509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7d13f471-bb17-42dc-ba2d-ba62328501e6 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:43:22 devstack sudo[98104]: pam_unix(sudo:session): session closed for user root Sep 18 21:43:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-525eee9d-a155-442d-860b-dc63484535f5 tempest-TestInstancesWithCinderVolumes-34987593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-84a2b4c6-6677-4b37-9c7e-271b0d9c5aad" returned: 0 in 0.376s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:43:22 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-525eee9d-a155-442d-860b-dc63484535f5 tempest-TestInstancesWithCinderVolumes-34987593 None] <== create_volume: return (1180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:43:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-525eee9d-a155-442d-860b-dc63484535f5 tempest-TestInstancesWithCinderVolumes-34987593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.182s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:43:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6ab7b0a6-86ad-4958-a8f0-2bc0cbd48cb8 tempest-TestInstancesWithCinderVolumes-34987593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.540s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:43:22 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-6ab7b0a6-86ad-4958-a8f0-2bc0cbd48cb8 tempest-TestInstancesWithCinderVolumes-34987593 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:43:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-259089131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=120b2523-d362-4bb1-a2b0-e0e3eea65b01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ef7f03caecd4fd69acbe26157891fb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:43:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:43:22Z,use_quota=True,user_id='bac1913499e240e4a2e5441614850415',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(48761f51-129b-4ef0-ae0e-1bb55b65bfa6),volume_type_id=48761f51-129b-4ef0-ae0e-1bb55b65bfa6)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:43:22 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-6ab7b0a6-86ad-4958-a8f0-2bc0cbd48cb8 tempest-TestInstancesWithCinderVolumes-34987593 None] Creating volume 120b2523-d362-4bb1-a2b0-e0e3eea65b01 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:43:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6ab7b0a6-86ad-4958-a8f0-2bc0cbd48cb8 tempest-TestInstancesWithCinderVolumes-34987593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:43:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6ab7b0a6-86ad-4958-a8f0-2bc0cbd48cb8 tempest-TestInstancesWithCinderVolumes-34987593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:43:22 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-6ab7b0a6-86ad-4958-a8f0-2bc0cbd48cb8 tempest-TestInstancesWithCinderVolumes-34987593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:43:22 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-6ab7b0a6-86ad-4958-a8f0-2bc0cbd48cb8 tempest-TestInstancesWithCinderVolumes-34987593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:43:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6ab7b0a6-86ad-4958-a8f0-2bc0cbd48cb8 tempest-TestInstancesWithCinderVolumes-34987593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:43:22 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-6ab7b0a6-86ad-4958-a8f0-2bc0cbd48cb8 tempest-TestInstancesWithCinderVolumes-34987593 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:43:22 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-6ab7b0a6-86ad-4958-a8f0-2bc0cbd48cb8 tempest-TestInstancesWithCinderVolumes-34987593 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:43:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6ab7b0a6-86ad-4958-a8f0-2bc0cbd48cb8 tempest-TestInstancesWithCinderVolumes-34987593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-120b2523-d362-4bb1-a2b0-e0e3eea65b01 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:43:22 devstack sudo[98106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7d13f471-bb17-42dc-ba2d-ba62328501e6 Sep 18 21:43:22 devstack sudo[98106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:43:22 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-525eee9d-a155-442d-860b-dc63484535f5 tempest-TestInstancesWithCinderVolumes-34987593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba6b5637-1065-421d-9e98-7b85e7db1a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84a2b4c6-6677-4b37-9c7e-271b0d9c5aad', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:43:22 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-525eee9d-a155-442d-860b-dc63484535f5 tempest-TestInstancesWithCinderVolumes-34987593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c3e8c6f-42b0-4a6b-85b0-8ba7f71a88a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:43:22 devstack sudo[98111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-120b2523-d362-4bb1-a2b0-e0e3eea65b01 1073741824 Sep 18 21:43:22 devstack sudo[98111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:43:22 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-525eee9d-a155-442d-860b-dc63484535f5 tempest-TestInstancesWithCinderVolumes-34987593 None] Volume volume-84a2b4c6-6677-4b37-9c7e-271b0d9c5aad (84a2b4c6-6677-4b37-9c7e-271b0d9c5aad): created successfully Sep 18 21:43:22 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-525eee9d-a155-442d-860b-dc63484535f5 tempest-TestInstancesWithCinderVolumes-34987593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c3e8c6f-42b0-4a6b-85b0-8ba7f71a88a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:43:22 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-525eee9d-a155-442d-860b-dc63484535f5 tempest-TestInstancesWithCinderVolumes-34987593 None] Flow 'volume_create_manager' (bb8d4d6d-4317-48ae-91fc-d744aab0741a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:43:22 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-525eee9d-a155-442d-860b-dc63484535f5 tempest-TestInstancesWithCinderVolumes-34987593 None] Created volume successfully. Sep 18 21:43:22 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc502c31-cb33-48bf-8b6b-f7c5b1cc3940 tempest-TestInstancesWithCinderVolumes-34987593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:43:22 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-cc502c31-cb33-48bf-8b6b-f7c5b1cc3940 tempest-TestInstancesWithCinderVolumes-34987593 None] Flow 'volume_create_manager' (3e1de16e-656d-45d4-a844-60c50d189e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:43:22 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-cc502c31-cb33-48bf-8b6b-f7c5b1cc3940 tempest-TestInstancesWithCinderVolumes-34987593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (560ac529-2d6a-461d-8500-41d85d7d0798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:43:22 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-cc502c31-cb33-48bf-8b6b-f7c5b1cc3940 tempest-TestInstancesWithCinderVolumes-34987593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (560ac529-2d6a-461d-8500-41d85d7d0798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:43:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1855826928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49dfec77-2112-4d6b-8f22-0406b3ffa3d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ef7f03caecd4fd69acbe26157891fb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:43:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:43:23Z,use_quota=True,user_id='bac1913499e240e4a2e5441614850415',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe175009-7f51-4b7f-8c82-3132fbea072f),volume_type_id=fe175009-7f51-4b7f-8c82-3132fbea072f)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:43:22 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-cc502c31-cb33-48bf-8b6b-f7c5b1cc3940 tempest-TestInstancesWithCinderVolumes-34987593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fe90704-e1a5-4151-87f2-5c4b63684bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:43:22 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-cc502c31-cb33-48bf-8b6b-f7c5b1cc3940 tempest-TestInstancesWithCinderVolumes-34987593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fe90704-e1a5-4151-87f2-5c4b63684bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:43:22 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-cc502c31-cb33-48bf-8b6b-f7c5b1cc3940 tempest-TestInstancesWithCinderVolumes-34987593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c4e3fcd-3bba-4e3a-828f-6f18e7e94eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:43:22 devstack cinder-volume[86136]: DEBUG cinder.image.glance [None req-cc502c31-cb33-48bf-8b6b-f7c5b1cc3940 tempest-TestInstancesWithCinderVolumes-34987593 None] Creating Keystone auth plugin from conf {{(pid=86136) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 18 21:43:22 devstack sudo[98106]: pam_unix(sudo:session): session closed for user root Sep 18 21:43:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c8a9ffc9-5334-4e29-9540-53154d09057b tempest-VolumesActionsTest-2137630509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7d13f471-bb17-42dc-ba2d-ba62328501e6" returned: 0 in 0.547s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:43:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c8a9ffc9-5334-4e29-9540-53154d09057b tempest-VolumesActionsTest-2137630509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7d13f471-bb17-42dc-ba2d-ba62328501e6 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:43:22 devstack sudo[98120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7d13f471-bb17-42dc-ba2d-ba62328501e6 Sep 18 21:43:22 devstack sudo[98120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:43:23 devstack sudo[98111]: pam_unix(sudo:session): session closed for user root Sep 18 21:43:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6ab7b0a6-86ad-4958-a8f0-2bc0cbd48cb8 tempest-TestInstancesWithCinderVolumes-34987593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-120b2523-d362-4bb1-a2b0-e0e3eea65b01 1073741824" returned: 0 in 0.679s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:43:23 devstack sudo[98120]: pam_unix(sudo:session): session closed for user root Sep 18 21:43:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c8a9ffc9-5334-4e29-9540-53154d09057b tempest-VolumesActionsTest-2137630509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7d13f471-bb17-42dc-ba2d-ba62328501e6" returned: 0 in 0.363s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:43:23 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-cc502c31-cb33-48bf-8b6b-f7c5b1cc3940 tempest-TestInstancesWithCinderVolumes-34987593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c4e3fcd-3bba-4e3a-828f-6f18e7e94eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '49dfec77-2112-4d6b-8f22-0406b3ffa3d2', 'volume_name': 'volume-49dfec77-2112-4d6b-8f22-0406b3ffa3d2', 'volume_size': 1, 'image_id': '9edf2e55-adc3-46b6-aa7d-50af07f1c9b6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9edf2e55-adc3-46b6-aa7d-50af07f1c9b6', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--278201025', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0ef7f03caecd4fd69acbe26157891fb9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9edf2e55-adc3-46b6-aa7d-50af07f1c9b6', 'created_at': datetime.datetime(2026, 9, 18, 19, 43, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 18, 19, 43, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9edf2e55-adc3-46b6-aa7d-50af07f1c9b6/file', 'properties': {}}, 'image_service': }' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:43:23 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-cc502c31-cb33-48bf-8b6b-f7c5b1cc3940 tempest-TestInstancesWithCinderVolumes-34987593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca28bbe3-79de-47bf-a145-8ef1f23f207c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:43:23 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-cc502c31-cb33-48bf-8b6b-f7c5b1cc3940 tempest-TestInstancesWithCinderVolumes-34987593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca28bbe3-79de-47bf-a145-8ef1f23f207c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:43:23 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-cc502c31-cb33-48bf-8b6b-f7c5b1cc3940 tempest-TestInstancesWithCinderVolumes-34987593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d533178a-824d-48ae-bc95-f98d02e4601e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:43:23 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-cc502c31-cb33-48bf-8b6b-f7c5b1cc3940 tempest-TestInstancesWithCinderVolumes-34987593 None] Volume 49dfec77-2112-4d6b-8f22-0406b3ffa3d2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-49dfec77-2112-4d6b-8f22-0406b3ffa3d2', 'volume_size': 1, 'image_id': '9edf2e55-adc3-46b6-aa7d-50af07f1c9b6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9edf2e55-adc3-46b6-aa7d-50af07f1c9b6', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--278201025', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0ef7f03caecd4fd69acbe26157891fb9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9edf2e55-adc3-46b6-aa7d-50af07f1c9b6', 'created_at': datetime.datetime(2026, 9, 18, 19, 43, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 18, 19, 43, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9edf2e55-adc3-46b6-aa7d-50af07f1c9b6/file', 'properties': {}}, 'image_service': } Sep 18 21:43:23 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc502c31-cb33-48bf-8b6b-f7c5b1cc3940 tempest-TestInstancesWithCinderVolumes-34987593 None] Trying to clone 49dfec77-2112-4d6b-8f22-0406b3ffa3d2 from image 9edf2e55-adc3-46b6-aa7d-50af07f1c9b6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9edf2e55-adc3-46b6-aa7d-50af07f1c9b6', 'metadata': {}}]). {{(pid=86136) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 18 21:43:23 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-c8a9ffc9-5334-4e29-9540-53154d09057b tempest-VolumesActionsTest-2137630509 None] Lock "cinder-quobyte-7d13f471-bb17-42dc-ba2d-ba62328501e6" released by "delete_volume" :: held 1.020s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:43:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6ab7b0a6-86ad-4958-a8f0-2bc0cbd48cb8 tempest-TestInstancesWithCinderVolumes-34987593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-120b2523-d362-4bb1-a2b0-e0e3eea65b01 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:43:23 devstack sudo[98132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-120b2523-d362-4bb1-a2b0-e0e3eea65b01 Sep 18 21:43:23 devstack sudo[98132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:43:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-574afcb2-f466-470a-8d39-6135147a6ab3 req-b88f6c6b-ff63-4c62-a93d-de8bb89fad96 tempest-AttachVolumeNegativeTest-605821046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:43:23 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-c8a9ffc9-5334-4e29-9540-53154d09057b tempest-VolumesActionsTest-2137630509 None] Created reservations ['adc4ef38-1553-472b-a691-8808e1cea48b', '0a1d5639-c921-4ddf-a921-995cccfd50e2', 'd5b7da2c-03b0-41c8-8e67-3b4927a59d49', '3024d6f8-caf4-4f92-ba40-137717de7e7f'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:43:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c8a9ffc9-5334-4e29-9540-53154d09057b tempest-VolumesActionsTest-2137630509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:43:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c8a9ffc9-5334-4e29-9540-53154d09057b tempest-VolumesActionsTest-2137630509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:43:23 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-c8a9ffc9-5334-4e29-9540-53154d09057b tempest-VolumesActionsTest-2137630509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:43:23 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-c8a9ffc9-5334-4e29-9540-53154d09057b tempest-VolumesActionsTest-2137630509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:43:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c8a9ffc9-5334-4e29-9540-53154d09057b tempest-VolumesActionsTest-2137630509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:43:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c8a9ffc9-5334-4e29-9540-53154d09057b tempest-VolumesActionsTest-2137630509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:43:23 devstack sudo[98134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:43:23 devstack sudo[98134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:43:23 devstack sudo[98132]: pam_unix(sudo:session): session closed for user root Sep 18 21:43:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6ab7b0a6-86ad-4958-a8f0-2bc0cbd48cb8 tempest-TestInstancesWithCinderVolumes-34987593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-120b2523-d362-4bb1-a2b0-e0e3eea65b01" returned: 0 in 0.402s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:43:23 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-6ab7b0a6-86ad-4958-a8f0-2bc0cbd48cb8 tempest-TestInstancesWithCinderVolumes-34987593 None] <== create_volume: return (1222ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:43:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6ab7b0a6-86ad-4958-a8f0-2bc0cbd48cb8 tempest-TestInstancesWithCinderVolumes-34987593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.225s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:43:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-574afcb2-f466-470a-8d39-6135147a6ab3 req-b88f6c6b-ff63-4c62-a93d-de8bb89fad96 tempest-AttachVolumeNegativeTest-605821046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.353s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:43:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-574afcb2-f466-470a-8d39-6135147a6ab3 req-b88f6c6b-ff63-4c62-a93d-de8bb89fad96 tempest-AttachVolumeNegativeTest-605821046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:43:23 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6ab7b0a6-86ad-4958-a8f0-2bc0cbd48cb8 tempest-TestInstancesWithCinderVolumes-34987593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a405a10e-73fa-4293-a4de-602322498ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-120b2523-d362-4bb1-a2b0-e0e3eea65b01', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:43:23 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6ab7b0a6-86ad-4958-a8f0-2bc0cbd48cb8 tempest-TestInstancesWithCinderVolumes-34987593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8c84413-60c5-44ea-b48f-4840458db536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:43:23 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-6ab7b0a6-86ad-4958-a8f0-2bc0cbd48cb8 tempest-TestInstancesWithCinderVolumes-34987593 None] Volume volume-120b2523-d362-4bb1-a2b0-e0e3eea65b01 (120b2523-d362-4bb1-a2b0-e0e3eea65b01): created successfully Sep 18 21:43:23 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6ab7b0a6-86ad-4958-a8f0-2bc0cbd48cb8 tempest-TestInstancesWithCinderVolumes-34987593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8c84413-60c5-44ea-b48f-4840458db536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:43:23 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6ab7b0a6-86ad-4958-a8f0-2bc0cbd48cb8 tempest-TestInstancesWithCinderVolumes-34987593 None] Flow 'volume_create_manager' (740b7494-b6ab-4c56-8c29-df121a09a871) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:43:23 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-6ab7b0a6-86ad-4958-a8f0-2bc0cbd48cb8 tempest-TestInstancesWithCinderVolumes-34987593 None] Created volume successfully. Sep 18 21:43:23 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [req-574afcb2-f466-470a-8d39-6135147a6ab3 req-b88f6c6b-ff63-4c62-a93d-de8bb89fad96 tempest-AttachVolumeNegativeTest-605821046 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff', 'name': 'volume-16509596-8851-42d6-b941-39d3bae618e6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '88ea64d9-efd5-4ea3-8f29-70559315caf2', 'enforce_multipath': True} {{(pid=86136) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 18 21:43:23 devstack sudo[98134]: pam_unix(sudo:session): session closed for user root Sep 18 21:43:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c8a9ffc9-5334-4e29-9540-53154d09057b tempest-VolumesActionsTest-2137630509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.297s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:43:23 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-c8a9ffc9-5334-4e29-9540-53154d09057b tempest-VolumesActionsTest-2137630509 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:43:23 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-c8a9ffc9-5334-4e29-9540-53154d09057b tempest-VolumesActionsTest-2137630509 None] Deleted volume successfully. Sep 18 21:43:23 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-c8a9ffc9-5334-4e29-9540-53154d09057b tempest-VolumesActionsTest-2137630509 None] Lock "cinder-7d13f471-bb17-42dc-ba2d-ba62328501e6-delete_volume" released by "delete_volume" :: held 1.689s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:43:23 devstack cinder-volume[86136]: INFO cinder.volume.manager [req-574afcb2-f466-470a-8d39-6135147a6ab3 req-b88f6c6b-ff63-4c62-a93d-de8bb89fad96 tempest-AttachVolumeNegativeTest-605821046 None] attachment_update completed successfully. Sep 18 21:43:23 devstack cinder-volume[86136]: INFO cinder.volume.manager [req-3a84d41c-6285-43fc-96dd-8602ae03726b req-3a7f6e7f-c3c3-4f73-a583-4c79c4cd928a tempest-TestServerVolumeAttachmentScenario-735605229 None] Terminate volume connection completed successfully. Sep 18 21:43:23 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [req-3a84d41c-6285-43fc-96dd-8602ae03726b req-3a7f6e7f-c3c3-4f73-a583-4c79c4cd928a tempest-TestServerVolumeAttachmentScenario-735605229 None] Deleting attachment fd0b6066-4ad4-4614-9166-cd3bc45201c1. {{(pid=86136) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 18 21:43:25 devstack cinder-volume[86136]: INFO cinder.volume.manager [req-e03b4038-16ad-4e42-bfe2-80a3cabf78f0 req-85fb4fe3-c88c-415a-8655-443c6cd6a7d4 tempest-TestServerVolumeAttachmentScenario-735605229 None] Terminate volume connection completed successfully. Sep 18 21:43:25 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [req-e03b4038-16ad-4e42-bfe2-80a3cabf78f0 req-85fb4fe3-c88c-415a-8655-443c6cd6a7d4 tempest-TestServerVolumeAttachmentScenario-735605229 None] Deleting attachment ef011eab-9f1f-4858-8e0a-a0877b698343. {{(pid=86136) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 18 21:43:26 devstack cinder-volume[86136]: INFO cinder.volume.manager [req-11c73a15-b3dd-4f64-aed2-d81734c34da7 req-4b3d2e5b-6aa5-4dd9-9ed7-d1abc56845e2 tempest-AttachVolumeNegativeTest-605821046 None] Terminate volume connection completed successfully. Sep 18 21:43:26 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [req-11c73a15-b3dd-4f64-aed2-d81734c34da7 req-4b3d2e5b-6aa5-4dd9-9ed7-d1abc56845e2 tempest-AttachVolumeNegativeTest-605821046 None] Deleting attachment 88ea64d9-efd5-4ea3-8f29-70559315caf2. {{(pid=86136) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 18 21:43:28 devstack cinder-volume[86136]: DEBUG cinder.image.image_utils [None req-cc502c31-cb33-48bf-8b6b-f7c5b1cc3940 tempest-TestInstancesWithCinderVolumes-34987593 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9edf2e55-adc3-46b6-aa7d-50af07f1c9b6_nylbuwnhdevstack@QuobyteHD, size 20.69 MB, duration 4.90 sec {{(pid=86136) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 18 21:43:28 devstack cinder-volume[86136]: INFO cinder.image.image_utils [None req-cc502c31-cb33-48bf-8b6b-f7c5b1cc3940 tempest-TestInstancesWithCinderVolumes-34987593 None] Image download 20.69 MB at 4.22 MB/s Sep 18 21:43:28 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[202aed4b-a0d8-4e15-89ca-2e22a561700c]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:43:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-cc502c31-cb33-48bf-8b6b-f7c5b1cc3940 tempest-TestInstancesWithCinderVolumes-34987593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9edf2e55-adc3-46b6-aa7d-50af07f1c9b6_nylbuwnhdevstack@QuobyteHD {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:43:28 devstack sudo[98217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9edf2e55-adc3-46b6-aa7d-50af07f1c9b6_nylbuwnhdevstack@QuobyteHD Sep 18 21:43:28 devstack sudo[98217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:43:28 devstack sudo[98217]: pam_unix(sudo:session): session closed for user root Sep 18 21:43:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-cc502c31-cb33-48bf-8b6b-f7c5b1cc3940 tempest-TestInstancesWithCinderVolumes-34987593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9edf2e55-adc3-46b6-aa7d-50af07f1c9b6_nylbuwnhdevstack@QuobyteHD" returned: 0 in 0.394s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:43:28 devstack cinder-volume[86136]: DEBUG cinder.image.image_utils [None req-cc502c31-cb33-48bf-8b6b-f7c5b1cc3940 tempest-TestInstancesWithCinderVolumes-34987593 None] Temporary image 9edf2e55-adc3-46b6-aa7d-50af07f1c9b6 is fetched for user bac1913499e240e4a2e5441614850415. {{(pid=86136) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 18 21:43:28 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c455ac-05f5-4d99-95b1-915d09de6aee]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:43:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-cc502c31-cb33-48bf-8b6b-f7c5b1cc3940 tempest-TestInstancesWithCinderVolumes-34987593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9edf2e55-adc3-46b6-aa7d-50af07f1c9b6_nylbuwnhdevstack@QuobyteHD {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:43:28 devstack sudo[98224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9edf2e55-adc3-46b6-aa7d-50af07f1c9b6_nylbuwnhdevstack@QuobyteHD Sep 18 21:43:28 devstack sudo[98224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:43:29 devstack sudo[98224]: pam_unix(sudo:session): session closed for user root Sep 18 21:43:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-cc502c31-cb33-48bf-8b6b-f7c5b1cc3940 tempest-TestInstancesWithCinderVolumes-34987593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9edf2e55-adc3-46b6-aa7d-50af07f1c9b6_nylbuwnhdevstack@QuobyteHD" returned: 0 in 0.377s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:43:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-cc502c31-cb33-48bf-8b6b-f7c5b1cc3940 tempest-TestInstancesWithCinderVolumes-34987593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:43:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-cc502c31-cb33-48bf-8b6b-f7c5b1cc3940 tempest-TestInstancesWithCinderVolumes-34987593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:43:29 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-cc502c31-cb33-48bf-8b6b-f7c5b1cc3940 tempest-TestInstancesWithCinderVolumes-34987593 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:43:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1855826928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49dfec77-2112-4d6b-8f22-0406b3ffa3d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ef7f03caecd4fd69acbe26157891fb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:43:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:43:23Z,use_quota=True,user_id='bac1913499e240e4a2e5441614850415',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe175009-7f51-4b7f-8c82-3132fbea072f),volume_type_id=fe175009-7f51-4b7f-8c82-3132fbea072f)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:43:29 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-cc502c31-cb33-48bf-8b6b-f7c5b1cc3940 tempest-TestInstancesWithCinderVolumes-34987593 None] Creating volume 49dfec77-2112-4d6b-8f22-0406b3ffa3d2 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:43:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-cc502c31-cb33-48bf-8b6b-f7c5b1cc3940 tempest-TestInstancesWithCinderVolumes-34987593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:43:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-cc502c31-cb33-48bf-8b6b-f7c5b1cc3940 tempest-TestInstancesWithCinderVolumes-34987593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:43:29 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-cc502c31-cb33-48bf-8b6b-f7c5b1cc3940 tempest-TestInstancesWithCinderVolumes-34987593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:43:29 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-cc502c31-cb33-48bf-8b6b-f7c5b1cc3940 tempest-TestInstancesWithCinderVolumes-34987593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:43:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-cc502c31-cb33-48bf-8b6b-f7c5b1cc3940 tempest-TestInstancesWithCinderVolumes-34987593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:43:29 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-cc502c31-cb33-48bf-8b6b-f7c5b1cc3940 tempest-TestInstancesWithCinderVolumes-34987593 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:43:29 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-cc502c31-cb33-48bf-8b6b-f7c5b1cc3940 tempest-TestInstancesWithCinderVolumes-34987593 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:43:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-cc502c31-cb33-48bf-8b6b-f7c5b1cc3940 tempest-TestInstancesWithCinderVolumes-34987593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-49dfec77-2112-4d6b-8f22-0406b3ffa3d2 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:43:29 devstack sudo[98232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-49dfec77-2112-4d6b-8f22-0406b3ffa3d2 1073741824 Sep 18 21:43:29 devstack sudo[98232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:43:29 devstack sudo[98232]: pam_unix(sudo:session): session closed for user root Sep 18 21:43:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-cc502c31-cb33-48bf-8b6b-f7c5b1cc3940 tempest-TestInstancesWithCinderVolumes-34987593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-49dfec77-2112-4d6b-8f22-0406b3ffa3d2 1073741824" returned: 0 in 0.737s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:43:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-cc502c31-cb33-48bf-8b6b-f7c5b1cc3940 tempest-TestInstancesWithCinderVolumes-34987593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-49dfec77-2112-4d6b-8f22-0406b3ffa3d2 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:43:29 devstack sudo[98238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-49dfec77-2112-4d6b-8f22-0406b3ffa3d2 Sep 18 21:43:29 devstack sudo[98238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:43:30 devstack sudo[98238]: pam_unix(sudo:session): session closed for user root Sep 18 21:43:30 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-cc502c31-cb33-48bf-8b6b-f7c5b1cc3940 tempest-TestInstancesWithCinderVolumes-34987593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-49dfec77-2112-4d6b-8f22-0406b3ffa3d2" returned: 0 in 0.298s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:43:30 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-cc502c31-cb33-48bf-8b6b-f7c5b1cc3940 tempest-TestInstancesWithCinderVolumes-34987593 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:43:30 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-cc502c31-cb33-48bf-8b6b-f7c5b1cc3940 tempest-TestInstancesWithCinderVolumes-34987593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:43:30 devstack cinder-volume[86136]: DEBUG cinder.volume.volume_utils [None req-cc502c31-cb33-48bf-8b6b-f7c5b1cc3940 tempest-TestInstancesWithCinderVolumes-34987593 None] Attempting download of 9edf2e55-adc3-46b6-aa7d-50af07f1c9b6 ((None, [{'url': 'file:///opt/stack/data/glance/images/9edf2e55-adc3-46b6-aa7d-50af07f1c9b6', 'metadata': {}}])) to volume 49dfec77-2112-4d6b-8f22-0406b3ffa3d2. {{(pid=86136) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 18 21:43:30 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfaf23d7-a12f-42ae-ac21-7bab51d0790d]: (4, 'raw') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:43:30 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-cc502c31-cb33-48bf-8b6b-f7c5b1cc3940 tempest-TestInstancesWithCinderVolumes-34987593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9edf2e55-adc3-46b6-aa7d-50af07f1c9b6_ynvzlg26 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:43:30 devstack sudo[98243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9edf2e55-adc3-46b6-aa7d-50af07f1c9b6_ynvzlg26 Sep 18 21:43:30 devstack sudo[98243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:43:30 devstack sudo[98243]: pam_unix(sudo:session): session closed for user root Sep 18 21:43:30 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-cc502c31-cb33-48bf-8b6b-f7c5b1cc3940 tempest-TestInstancesWithCinderVolumes-34987593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9edf2e55-adc3-46b6-aa7d-50af07f1c9b6_ynvzlg26" returned: 0 in 0.533s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:43:30 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-cc502c31-cb33-48bf-8b6b-f7c5b1cc3940 tempest-TestInstancesWithCinderVolumes-34987593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9edf2e55-adc3-46b6-aa7d-50af07f1c9b6_ynvzlg26 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:43:30 devstack sudo[98249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9edf2e55-adc3-46b6-aa7d-50af07f1c9b6_ynvzlg26 Sep 18 21:43:30 devstack sudo[98249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:43:31 devstack sudo[98249]: pam_unix(sudo:session): session closed for user root Sep 18 21:43:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-cc502c31-cb33-48bf-8b6b-f7c5b1cc3940 tempest-TestInstancesWithCinderVolumes-34987593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9edf2e55-adc3-46b6-aa7d-50af07f1c9b6_ynvzlg26" returned: 1 in 0.520s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:43:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-cc502c31-cb33-48bf-8b6b-f7c5b1cc3940 tempest-TestInstancesWithCinderVolumes-34987593 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9edf2e55-adc3-46b6-aa7d-50af07f1c9b6_ynvzlg26' failed. Not Retrying. {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 18 21:43:31 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3522531-09a6-42a5-82ce-fac4dea67b02]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:43:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-cc502c31-cb33-48bf-8b6b-f7c5b1cc3940 tempest-TestInstancesWithCinderVolumes-34987593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9edf2e55-adc3-46b6-aa7d-50af07f1c9b6_nylbuwnhdevstack@QuobyteHD {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:43:31 devstack sudo[98253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9edf2e55-adc3-46b6-aa7d-50af07f1c9b6_nylbuwnhdevstack@QuobyteHD Sep 18 21:43:31 devstack sudo[98253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:43:31 devstack sudo[98253]: pam_unix(sudo:session): session closed for user root Sep 18 21:43:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-cc502c31-cb33-48bf-8b6b-f7c5b1cc3940 tempest-TestInstancesWithCinderVolumes-34987593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9edf2e55-adc3-46b6-aa7d-50af07f1c9b6_nylbuwnhdevstack@QuobyteHD" returned: 0 in 0.400s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:43:31 devstack cinder-volume[86136]: DEBUG cinder.image.image_utils [None req-cc502c31-cb33-48bf-8b6b-f7c5b1cc3940 tempest-TestInstancesWithCinderVolumes-34987593 None] 9edf2e55-adc3-46b6-aa7d-50af07f1c9b6 was qcow2, converting to qcow2 {{(pid=86136) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 18 21:43:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-cc502c31-cb33-48bf-8b6b-f7c5b1cc3940 tempest-TestInstancesWithCinderVolumes-34987593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9edf2e55-adc3-46b6-aa7d-50af07f1c9b6_nylbuwnhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-49dfec77-2112-4d6b-8f22-0406b3ffa3d2 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:43:31 devstack sudo[98258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9edf2e55-adc3-46b6-aa7d-50af07f1c9b6_nylbuwnhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-49dfec77-2112-4d6b-8f22-0406b3ffa3d2 Sep 18 21:43:31 devstack sudo[98258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:43:31 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-aee59d93-9c06-416a-85bd-fde0a696fce0 tempest-TestServerVolumeAttachmentScenario-735605229 None] Acquiring lock "cinder-c0a22dd5-118a-43a0-99e5-0f8f3186a712-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:43:31 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-aee59d93-9c06-416a-85bd-fde0a696fce0 tempest-TestServerVolumeAttachmentScenario-735605229 None] Lock "cinder-c0a22dd5-118a-43a0-99e5-0f8f3186a712-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:43:31 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-aee59d93-9c06-416a-85bd-fde0a696fce0 tempest-TestServerVolumeAttachmentScenario-735605229 None] Acquiring lock "cinder-quobyte-c0a22dd5-118a-43a0-99e5-0f8f3186a712" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:43:32 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-aee59d93-9c06-416a-85bd-fde0a696fce0 tempest-TestServerVolumeAttachmentScenario-735605229 None] Lock "cinder-quobyte-c0a22dd5-118a-43a0-99e5-0f8f3186a712" acquired by "delete_volume" :: waited 0.024s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:43:32 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eebae1f-561e-4ad4-a729-814e3d4c0145]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:43:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-aee59d93-9c06-416a-85bd-fde0a696fce0 tempest-TestServerVolumeAttachmentScenario-735605229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c0a22dd5-118a-43a0-99e5-0f8f3186a712 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:43:32 devstack sudo[98260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c0a22dd5-118a-43a0-99e5-0f8f3186a712 Sep 18 21:43:32 devstack sudo[98260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:43:32 devstack sudo[98260]: pam_unix(sudo:session): session closed for user root Sep 18 21:43:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-aee59d93-9c06-416a-85bd-fde0a696fce0 tempest-TestServerVolumeAttachmentScenario-735605229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c0a22dd5-118a-43a0-99e5-0f8f3186a712" returned: 0 in 0.533s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:43:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-aee59d93-9c06-416a-85bd-fde0a696fce0 tempest-TestServerVolumeAttachmentScenario-735605229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c0a22dd5-118a-43a0-99e5-0f8f3186a712 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:43:32 devstack sudo[98271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c0a22dd5-118a-43a0-99e5-0f8f3186a712 Sep 18 21:43:32 devstack sudo[98271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:43:32 devstack sudo[98271]: pam_unix(sudo:session): session closed for user root Sep 18 21:43:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-aee59d93-9c06-416a-85bd-fde0a696fce0 tempest-TestServerVolumeAttachmentScenario-735605229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c0a22dd5-118a-43a0-99e5-0f8f3186a712" returned: 0 in 0.357s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:43:32 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-aee59d93-9c06-416a-85bd-fde0a696fce0 tempest-TestServerVolumeAttachmentScenario-735605229 None] Lock "cinder-quobyte-c0a22dd5-118a-43a0-99e5-0f8f3186a712" released by "delete_volume" :: held 0.954s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:43:33 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-e4025e83-da07-40da-bb20-41710e4b0bd2 tempest-AttachVolumeNegativeTest-605821046 None] Acquiring lock "cinder-16509596-8851-42d6-b941-39d3bae618e6-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:43:33 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-aee59d93-9c06-416a-85bd-fde0a696fce0 tempest-TestServerVolumeAttachmentScenario-735605229 None] Created reservations ['05082d7a-782e-4f07-8e00-36d19bdd095a', '79c01ff2-0205-4e58-b515-398e1fc401d4', 'bc64a654-dc70-4ece-ae91-c2884ab36ac0', 'f31febfd-e963-484e-8d16-dbc50e46e36f'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:43:33 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-e4025e83-da07-40da-bb20-41710e4b0bd2 tempest-AttachVolumeNegativeTest-605821046 None] Lock "cinder-16509596-8851-42d6-b941-39d3bae618e6-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:43:33 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-e4025e83-da07-40da-bb20-41710e4b0bd2 tempest-AttachVolumeNegativeTest-605821046 None] Acquiring lock "cinder-quobyte-16509596-8851-42d6-b941-39d3bae618e6" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:43:33 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-e4025e83-da07-40da-bb20-41710e4b0bd2 tempest-AttachVolumeNegativeTest-605821046 None] Lock "cinder-quobyte-16509596-8851-42d6-b941-39d3bae618e6" acquired by "delete_volume" :: waited 0.044s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:43:33 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-aee59d93-9c06-416a-85bd-fde0a696fce0 tempest-TestServerVolumeAttachmentScenario-735605229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:43:33 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-aee59d93-9c06-416a-85bd-fde0a696fce0 tempest-TestServerVolumeAttachmentScenario-735605229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:43:33 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-aee59d93-9c06-416a-85bd-fde0a696fce0 tempest-TestServerVolumeAttachmentScenario-735605229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:43:33 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-aee59d93-9c06-416a-85bd-fde0a696fce0 tempest-TestServerVolumeAttachmentScenario-735605229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:43:33 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-aee59d93-9c06-416a-85bd-fde0a696fce0 tempest-TestServerVolumeAttachmentScenario-735605229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:43:33 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-aee59d93-9c06-416a-85bd-fde0a696fce0 tempest-TestServerVolumeAttachmentScenario-735605229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:43:33 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd2a859e-1a05-4df6-8a25-7cd35eac3084]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:43:33 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e4025e83-da07-40da-bb20-41710e4b0bd2 tempest-AttachVolumeNegativeTest-605821046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-16509596-8851-42d6-b941-39d3bae618e6 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:43:33 devstack sudo[98274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:43:33 devstack sudo[98274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:43:33 devstack sudo[98275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-16509596-8851-42d6-b941-39d3bae618e6 Sep 18 21:43:33 devstack sudo[98275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:43:33 devstack sudo[98274]: pam_unix(sudo:session): session closed for user root Sep 18 21:43:33 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-aee59d93-9c06-416a-85bd-fde0a696fce0 tempest-TestServerVolumeAttachmentScenario-735605229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.341s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:43:33 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-aee59d93-9c06-416a-85bd-fde0a696fce0 tempest-TestServerVolumeAttachmentScenario-735605229 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:43:33 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-aee59d93-9c06-416a-85bd-fde0a696fce0 tempest-TestServerVolumeAttachmentScenario-735605229 None] Deleted volume successfully. Sep 18 21:43:33 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-aee59d93-9c06-416a-85bd-fde0a696fce0 tempest-TestServerVolumeAttachmentScenario-735605229 None] Lock "cinder-c0a22dd5-118a-43a0-99e5-0f8f3186a712-delete_volume" released by "delete_volume" :: held 1.730s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:43:33 devstack sudo[98275]: pam_unix(sudo:session): session closed for user root Sep 18 21:43:33 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e4025e83-da07-40da-bb20-41710e4b0bd2 tempest-AttachVolumeNegativeTest-605821046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-16509596-8851-42d6-b941-39d3bae618e6" returned: 0 in 0.562s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:43:33 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e4025e83-da07-40da-bb20-41710e4b0bd2 tempest-AttachVolumeNegativeTest-605821046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-16509596-8851-42d6-b941-39d3bae618e6 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:43:33 devstack sudo[98282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-16509596-8851-42d6-b941-39d3bae618e6 Sep 18 21:43:33 devstack sudo[98282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:43:34 devstack sudo[98282]: pam_unix(sudo:session): session closed for user root Sep 18 21:43:34 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e4025e83-da07-40da-bb20-41710e4b0bd2 tempest-AttachVolumeNegativeTest-605821046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-16509596-8851-42d6-b941-39d3bae618e6" returned: 0 in 0.328s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:43:34 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-e4025e83-da07-40da-bb20-41710e4b0bd2 tempest-AttachVolumeNegativeTest-605821046 None] Lock "cinder-quobyte-16509596-8851-42d6-b941-39d3bae618e6" released by "delete_volume" :: held 0.986s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:43:34 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-12c9a44d-cf4e-4231-ad11-bfbd0795c5e9 tempest-TestServerVolumeAttachmentScenario-735605229 None] Acquiring lock "cinder-bfeb9879-d81d-43b7-8ecf-bb45599f7db4-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:43:34 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-12c9a44d-cf4e-4231-ad11-bfbd0795c5e9 tempest-TestServerVolumeAttachmentScenario-735605229 None] Lock "cinder-bfeb9879-d81d-43b7-8ecf-bb45599f7db4-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:43:34 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-e4025e83-da07-40da-bb20-41710e4b0bd2 tempest-AttachVolumeNegativeTest-605821046 None] Created reservations ['6d7e964c-b6c7-4226-b6d5-b70c3e98ba68', 'b1289d43-3491-45d0-813d-e30142060043', '379b8a1f-179a-4dfc-a23a-1d919d0816d2', 'ae5e2f6e-ae66-4bd0-8e25-c16b8000d455'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:43:34 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-12c9a44d-cf4e-4231-ad11-bfbd0795c5e9 tempest-TestServerVolumeAttachmentScenario-735605229 None] Acquiring lock "cinder-quobyte-bfeb9879-d81d-43b7-8ecf-bb45599f7db4" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:43:34 devstack sudo[98258]: pam_unix(sudo:session): session closed for user root Sep 18 21:43:34 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-cc502c31-cb33-48bf-8b6b-f7c5b1cc3940 tempest-TestInstancesWithCinderVolumes-34987593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9edf2e55-adc3-46b6-aa7d-50af07f1c9b6_nylbuwnhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-49dfec77-2112-4d6b-8f22-0406b3ffa3d2" returned: 0 in 2.610s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:43:34 devstack cinder-volume[86136]: DEBUG cinder.image.image_utils [None req-cc502c31-cb33-48bf-8b6b-f7c5b1cc3940 tempest-TestInstancesWithCinderVolumes-34987593 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9edf2e55-adc3-46b6-aa7d-50af07f1c9b6_nylbuwnhdevstack@QuobyteHD, size 112.00 MB, duration 2.61 sec, destination /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-49dfec77-2112-4d6b-8f22-0406b3ffa3d2 {{(pid=86136) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 18 21:43:34 devstack cinder-volume[86136]: INFO cinder.image.image_utils [None req-cc502c31-cb33-48bf-8b6b-f7c5b1cc3940 tempest-TestInstancesWithCinderVolumes-34987593 None] Converted 112.00 MB image at 42.90 MB/s Sep 18 21:43:34 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-cc502c31-cb33-48bf-8b6b-f7c5b1cc3940 tempest-TestInstancesWithCinderVolumes-34987593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-49dfec77-2112-4d6b-8f22-0406b3ffa3d2 1G {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:43:34 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-12c9a44d-cf4e-4231-ad11-bfbd0795c5e9 tempest-TestServerVolumeAttachmentScenario-735605229 None] Lock "cinder-quobyte-bfeb9879-d81d-43b7-8ecf-bb45599f7db4" acquired by "delete_volume" :: waited 0.026s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:43:34 devstack sudo[98285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-49dfec77-2112-4d6b-8f22-0406b3ffa3d2 1G Sep 18 21:43:34 devstack sudo[98285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:43:34 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a36698-2140-4dd9-9271-c8feefea86af]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:43:34 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-12c9a44d-cf4e-4231-ad11-bfbd0795c5e9 tempest-TestServerVolumeAttachmentScenario-735605229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-bfeb9879-d81d-43b7-8ecf-bb45599f7db4 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:43:34 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-e4025e83-da07-40da-bb20-41710e4b0bd2 tempest-AttachVolumeNegativeTest-605821046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:43:34 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-e4025e83-da07-40da-bb20-41710e4b0bd2 tempest-AttachVolumeNegativeTest-605821046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:43:34 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-e4025e83-da07-40da-bb20-41710e4b0bd2 tempest-AttachVolumeNegativeTest-605821046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:43:34 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-e4025e83-da07-40da-bb20-41710e4b0bd2 tempest-AttachVolumeNegativeTest-605821046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:43:34 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-e4025e83-da07-40da-bb20-41710e4b0bd2 tempest-AttachVolumeNegativeTest-605821046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:43:34 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e4025e83-da07-40da-bb20-41710e4b0bd2 tempest-AttachVolumeNegativeTest-605821046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:43:34 devstack sudo[98288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:43:34 devstack sudo[98288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:43:34 devstack sudo[98287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-bfeb9879-d81d-43b7-8ecf-bb45599f7db4 Sep 18 21:43:34 devstack sudo[98287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:43:34 devstack sudo[98288]: pam_unix(sudo:session): session closed for user root Sep 18 21:43:34 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e4025e83-da07-40da-bb20-41710e4b0bd2 tempest-AttachVolumeNegativeTest-605821046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.304s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:43:34 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-e4025e83-da07-40da-bb20-41710e4b0bd2 tempest-AttachVolumeNegativeTest-605821046 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:43:34 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-e4025e83-da07-40da-bb20-41710e4b0bd2 tempest-AttachVolumeNegativeTest-605821046 None] Deleted volume successfully. Sep 18 21:43:34 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-e4025e83-da07-40da-bb20-41710e4b0bd2 tempest-AttachVolumeNegativeTest-605821046 None] Lock "cinder-16509596-8851-42d6-b941-39d3bae618e6-delete_volume" released by "delete_volume" :: held 1.688s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:43:34 devstack sudo[98285]: pam_unix(sudo:session): session closed for user root Sep 18 21:43:34 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-cc502c31-cb33-48bf-8b6b-f7c5b1cc3940 tempest-TestInstancesWithCinderVolumes-34987593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-49dfec77-2112-4d6b-8f22-0406b3ffa3d2 1G" returned: 0 in 0.444s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:43:34 devstack cinder-volume[86136]: DEBUG cinder.volume.volume_utils [None req-cc502c31-cb33-48bf-8b6b-f7c5b1cc3940 tempest-TestInstancesWithCinderVolumes-34987593 None] Downloaded image 9edf2e55-adc3-46b6-aa7d-50af07f1c9b6 ((None, [{'url': 'file:///opt/stack/data/glance/images/9edf2e55-adc3-46b6-aa7d-50af07f1c9b6', 'metadata': {}}])) to volume 49dfec77-2112-4d6b-8f22-0406b3ffa3d2 successfully. {{(pid=86136) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 18 21:43:34 devstack cinder-volume[86136]: DEBUG cinder.image.image_utils [None req-cc502c31-cb33-48bf-8b6b-f7c5b1cc3940 tempest-TestInstancesWithCinderVolumes-34987593 None] Temporary image 9edf2e55-adc3-46b6-aa7d-50af07f1c9b6 for user bac1913499e240e4a2e5441614850415 is deleted. {{(pid=86136) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 18 21:43:34 devstack cinder-volume[86136]: DEBUG cinder.volume.volume_utils [None req-cc502c31-cb33-48bf-8b6b-f7c5b1cc3940 tempest-TestInstancesWithCinderVolumes-34987593 None] Marking volume 49dfec77-2112-4d6b-8f22-0406b3ffa3d2 as bootable. {{(pid=86136) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 18 21:43:34 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc502c31-cb33-48bf-8b6b-f7c5b1cc3940 tempest-TestInstancesWithCinderVolumes-34987593 None] Copying metadata from image 9edf2e55-adc3-46b6-aa7d-50af07f1c9b6 to 49dfec77-2112-4d6b-8f22-0406b3ffa3d2. {{(pid=86136) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 18 21:43:34 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc502c31-cb33-48bf-8b6b-f7c5b1cc3940 tempest-TestInstancesWithCinderVolumes-34987593 None] Creating volume glance metadata for volume 49dfec77-2112-4d6b-8f22-0406b3ffa3d2 backed by image 9edf2e55-adc3-46b6-aa7d-50af07f1c9b6 with: {'image_id': '9edf2e55-adc3-46b6-aa7d-50af07f1c9b6', 'image_name': 'tempest-scenario-img--278201025', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86136) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 18 21:43:34 devstack sudo[98287]: pam_unix(sudo:session): session closed for user root Sep 18 21:43:34 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-12c9a44d-cf4e-4231-ad11-bfbd0795c5e9 tempest-TestServerVolumeAttachmentScenario-735605229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-bfeb9879-d81d-43b7-8ecf-bb45599f7db4" returned: 0 in 0.469s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:43:34 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-12c9a44d-cf4e-4231-ad11-bfbd0795c5e9 tempest-TestServerVolumeAttachmentScenario-735605229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-bfeb9879-d81d-43b7-8ecf-bb45599f7db4 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:43:34 devstack sudo[98299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-bfeb9879-d81d-43b7-8ecf-bb45599f7db4 Sep 18 21:43:34 devstack sudo[98299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:43:34 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-cc502c31-cb33-48bf-8b6b-f7c5b1cc3940 tempest-TestInstancesWithCinderVolumes-34987593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d533178a-824d-48ae-bc95-f98d02e4601e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49dfec77-2112-4d6b-8f22-0406b3ffa3d2', 'volume_size': 1, 'image_id': '9edf2e55-adc3-46b6-aa7d-50af07f1c9b6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9edf2e55-adc3-46b6-aa7d-50af07f1c9b6', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--278201025', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0ef7f03caecd4fd69acbe26157891fb9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9edf2e55-adc3-46b6-aa7d-50af07f1c9b6', 'created_at': datetime.datetime(2026, 9, 18, 19, 43, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 18, 19, 43, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9edf2e55-adc3-46b6-aa7d-50af07f1c9b6/file', 'properties': {}}, 'image_service': }' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:43:34 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-cc502c31-cb33-48bf-8b6b-f7c5b1cc3940 tempest-TestInstancesWithCinderVolumes-34987593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (485e9a2a-ce3d-4f07-80d4-169c536383e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:43:34 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-cc502c31-cb33-48bf-8b6b-f7c5b1cc3940 tempest-TestInstancesWithCinderVolumes-34987593 None] Volume volume-49dfec77-2112-4d6b-8f22-0406b3ffa3d2 (49dfec77-2112-4d6b-8f22-0406b3ffa3d2): created successfully Sep 18 21:43:34 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-cc502c31-cb33-48bf-8b6b-f7c5b1cc3940 tempest-TestInstancesWithCinderVolumes-34987593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (485e9a2a-ce3d-4f07-80d4-169c536383e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:43:34 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-cc502c31-cb33-48bf-8b6b-f7c5b1cc3940 tempest-TestInstancesWithCinderVolumes-34987593 None] Flow 'volume_create_manager' (3e1de16e-656d-45d4-a844-60c50d189e4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:43:34 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-cc502c31-cb33-48bf-8b6b-f7c5b1cc3940 tempest-TestInstancesWithCinderVolumes-34987593 None] Created volume successfully. Sep 18 21:43:35 devstack sudo[98299]: pam_unix(sudo:session): session closed for user root Sep 18 21:43:35 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-12c9a44d-cf4e-4231-ad11-bfbd0795c5e9 tempest-TestServerVolumeAttachmentScenario-735605229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-bfeb9879-d81d-43b7-8ecf-bb45599f7db4" returned: 0 in 0.283s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:43:35 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-12c9a44d-cf4e-4231-ad11-bfbd0795c5e9 tempest-TestServerVolumeAttachmentScenario-735605229 None] Lock "cinder-quobyte-bfeb9879-d81d-43b7-8ecf-bb45599f7db4" released by "delete_volume" :: held 0.813s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:43:35 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-12c9a44d-cf4e-4231-ad11-bfbd0795c5e9 tempest-TestServerVolumeAttachmentScenario-735605229 None] Created reservations ['876697e2-f889-48fe-bf87-70239ea582e8', '898dcedb-413a-41c9-bb0f-f6095957e853', 'c9441857-104d-44f0-9d5d-8983ab089f86', '7abd92aa-86d4-4a06-9348-ba4098da0b5e'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:43:35 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-12c9a44d-cf4e-4231-ad11-bfbd0795c5e9 tempest-TestServerVolumeAttachmentScenario-735605229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:43:35 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-12c9a44d-cf4e-4231-ad11-bfbd0795c5e9 tempest-TestServerVolumeAttachmentScenario-735605229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:43:35 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-12c9a44d-cf4e-4231-ad11-bfbd0795c5e9 tempest-TestServerVolumeAttachmentScenario-735605229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:43:35 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-12c9a44d-cf4e-4231-ad11-bfbd0795c5e9 tempest-TestServerVolumeAttachmentScenario-735605229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:43:35 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-12c9a44d-cf4e-4231-ad11-bfbd0795c5e9 tempest-TestServerVolumeAttachmentScenario-735605229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:43:35 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-12c9a44d-cf4e-4231-ad11-bfbd0795c5e9 tempest-TestServerVolumeAttachmentScenario-735605229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:43:35 devstack sudo[98302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:43:35 devstack sudo[98302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:43:35 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b1297aa-3688-4858-a5ae-4c658aba3acd tempest-VolumesNegativeTest-1777176385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:43:35 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-0b1297aa-3688-4858-a5ae-4c658aba3acd tempest-VolumesNegativeTest-1777176385 None] Flow 'volume_create_manager' (15242a44-5cbf-4c98-9adb-d3fb21542c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:43:35 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-0b1297aa-3688-4858-a5ae-4c658aba3acd tempest-VolumesNegativeTest-1777176385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4080716-ab37-4b55-9b84-ea76e6cbb9fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:43:35 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-87fe55a1-b6dc-439b-bc1d-cf8102817b77 tempest-AttachVolumeNegativeTest-605821046 None] Acquiring lock "cinder-8351963b-4e32-44de-bd3d-2eec4a802b12-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:43:35 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-0b1297aa-3688-4858-a5ae-4c658aba3acd tempest-VolumesNegativeTest-1777176385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4080716-ab37-4b55-9b84-ea76e6cbb9fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:43:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2011485515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6eee4d3-efc1-4057-9584-610abe821a57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af09e4ef090d4a83a951c704a561bf9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:43:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:43:35Z,use_quota=True,user_id='9f93eb866c5c41beb1d73b66b49509f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:43:35 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-0b1297aa-3688-4858-a5ae-4c658aba3acd tempest-VolumesNegativeTest-1777176385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1ca8c3c-d5a9-434e-822f-9c937c4e7cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:43:35 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-0b1297aa-3688-4858-a5ae-4c658aba3acd tempest-VolumesNegativeTest-1777176385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1ca8c3c-d5a9-434e-822f-9c937c4e7cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:43:35 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-0b1297aa-3688-4858-a5ae-4c658aba3acd tempest-VolumesNegativeTest-1777176385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75308ad6-ddbd-45aa-9de1-996411bf0ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:43:35 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-0b1297aa-3688-4858-a5ae-4c658aba3acd tempest-VolumesNegativeTest-1777176385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75308ad6-ddbd-45aa-9de1-996411bf0ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6eee4d3-efc1-4057-9584-610abe821a57', 'volume_name': 'volume-d6eee4d3-efc1-4057-9584-610abe821a57', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:43:35 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-0b1297aa-3688-4858-a5ae-4c658aba3acd tempest-VolumesNegativeTest-1777176385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce452b71-e917-4e64-9eb7-f7b3985d2a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:43:35 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-0b1297aa-3688-4858-a5ae-4c658aba3acd tempest-VolumesNegativeTest-1777176385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce452b71-e917-4e64-9eb7-f7b3985d2a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:43:35 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-0b1297aa-3688-4858-a5ae-4c658aba3acd tempest-VolumesNegativeTest-1777176385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c17f907-8b2f-4823-b9da-a58dee4ddb5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:43:35 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-0b1297aa-3688-4858-a5ae-4c658aba3acd tempest-VolumesNegativeTest-1777176385 None] Volume d6eee4d3-efc1-4057-9584-610abe821a57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6eee4d3-efc1-4057-9584-610abe821a57', 'volume_size': 1} Sep 18 21:43:35 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-0b1297aa-3688-4858-a5ae-4c658aba3acd tempest-VolumesNegativeTest-1777176385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:43:35 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-0b1297aa-3688-4858-a5ae-4c658aba3acd tempest-VolumesNegativeTest-1777176385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:43:35 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-0b1297aa-3688-4858-a5ae-4c658aba3acd tempest-VolumesNegativeTest-1777176385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:43:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2011485515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6eee4d3-efc1-4057-9584-610abe821a57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af09e4ef090d4a83a951c704a561bf9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:43:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:43:35Z,use_quota=True,user_id='9f93eb866c5c41beb1d73b66b49509f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:43:35 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-0b1297aa-3688-4858-a5ae-4c658aba3acd tempest-VolumesNegativeTest-1777176385 None] Creating volume d6eee4d3-efc1-4057-9584-610abe821a57 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:43:35 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-0b1297aa-3688-4858-a5ae-4c658aba3acd tempest-VolumesNegativeTest-1777176385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:43:35 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-0b1297aa-3688-4858-a5ae-4c658aba3acd tempest-VolumesNegativeTest-1777176385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:43:35 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-0b1297aa-3688-4858-a5ae-4c658aba3acd tempest-VolumesNegativeTest-1777176385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:43:35 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-0b1297aa-3688-4858-a5ae-4c658aba3acd tempest-VolumesNegativeTest-1777176385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:43:35 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-0b1297aa-3688-4858-a5ae-4c658aba3acd tempest-VolumesNegativeTest-1777176385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:43:35 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-0b1297aa-3688-4858-a5ae-4c658aba3acd tempest-VolumesNegativeTest-1777176385 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:43:35 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-0b1297aa-3688-4858-a5ae-4c658aba3acd tempest-VolumesNegativeTest-1777176385 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:43:35 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0b1297aa-3688-4858-a5ae-4c658aba3acd tempest-VolumesNegativeTest-1777176385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-d6eee4d3-efc1-4057-9584-610abe821a57 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:43:35 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-87fe55a1-b6dc-439b-bc1d-cf8102817b77 tempest-AttachVolumeNegativeTest-605821046 None] Lock "cinder-8351963b-4e32-44de-bd3d-2eec4a802b12-delete_volume" acquired by "delete_volume" :: waited 0.106s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:43:35 devstack sudo[98304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-d6eee4d3-efc1-4057-9584-610abe821a57 1073741824 Sep 18 21:43:35 devstack sudo[98304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:43:35 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-87fe55a1-b6dc-439b-bc1d-cf8102817b77 tempest-AttachVolumeNegativeTest-605821046 None] Acquiring lock "cinder-quobyte-8351963b-4e32-44de-bd3d-2eec4a802b12" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:43:35 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-87fe55a1-b6dc-439b-bc1d-cf8102817b77 tempest-AttachVolumeNegativeTest-605821046 None] Lock "cinder-quobyte-8351963b-4e32-44de-bd3d-2eec4a802b12" acquired by "delete_volume" :: waited 0.023s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:43:35 devstack sudo[98302]: pam_unix(sudo:session): session closed for user root Sep 18 21:43:35 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-12c9a44d-cf4e-4231-ad11-bfbd0795c5e9 tempest-TestServerVolumeAttachmentScenario-735605229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.373s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:43:35 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-12c9a44d-cf4e-4231-ad11-bfbd0795c5e9 tempest-TestServerVolumeAttachmentScenario-735605229 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:43:35 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-12c9a44d-cf4e-4231-ad11-bfbd0795c5e9 tempest-TestServerVolumeAttachmentScenario-735605229 None] Deleted volume successfully. Sep 18 21:43:35 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[844f6b9f-c487-4da1-b70d-3ff5e44e7d84]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:43:35 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-87fe55a1-b6dc-439b-bc1d-cf8102817b77 tempest-AttachVolumeNegativeTest-605821046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-8351963b-4e32-44de-bd3d-2eec4a802b12 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:43:35 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-12c9a44d-cf4e-4231-ad11-bfbd0795c5e9 tempest-TestServerVolumeAttachmentScenario-735605229 None] Lock "cinder-bfeb9879-d81d-43b7-8ecf-bb45599f7db4-delete_volume" released by "delete_volume" :: held 1.455s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:43:35 devstack sudo[98307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-8351963b-4e32-44de-bd3d-2eec4a802b12 Sep 18 21:43:35 devstack sudo[98307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:43:36 devstack sudo[98307]: pam_unix(sudo:session): session closed for user root Sep 18 21:43:36 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-87fe55a1-b6dc-439b-bc1d-cf8102817b77 tempest-AttachVolumeNegativeTest-605821046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-8351963b-4e32-44de-bd3d-2eec4a802b12" returned: 0 in 0.456s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:43:36 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-87fe55a1-b6dc-439b-bc1d-cf8102817b77 tempest-AttachVolumeNegativeTest-605821046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-8351963b-4e32-44de-bd3d-2eec4a802b12 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:43:36 devstack sudo[98316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-8351963b-4e32-44de-bd3d-2eec4a802b12 Sep 18 21:43:36 devstack sudo[98316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:43:36 devstack sudo[98304]: pam_unix(sudo:session): session closed for user root Sep 18 21:43:36 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0b1297aa-3688-4858-a5ae-4c658aba3acd tempest-VolumesNegativeTest-1777176385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-d6eee4d3-efc1-4057-9584-610abe821a57 1073741824" returned: 0 in 0.667s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:43:36 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0b1297aa-3688-4858-a5ae-4c658aba3acd tempest-VolumesNegativeTest-1777176385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-d6eee4d3-efc1-4057-9584-610abe821a57 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:43:36 devstack sudo[98318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-d6eee4d3-efc1-4057-9584-610abe821a57 Sep 18 21:43:36 devstack sudo[98318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:43:36 devstack sudo[98316]: pam_unix(sudo:session): session closed for user root Sep 18 21:43:36 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-87fe55a1-b6dc-439b-bc1d-cf8102817b77 tempest-AttachVolumeNegativeTest-605821046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-8351963b-4e32-44de-bd3d-2eec4a802b12" returned: 0 in 0.364s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:43:36 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-87fe55a1-b6dc-439b-bc1d-cf8102817b77 tempest-AttachVolumeNegativeTest-605821046 None] Lock "cinder-quobyte-8351963b-4e32-44de-bd3d-2eec4a802b12" released by "delete_volume" :: held 0.891s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:43:36 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-87fe55a1-b6dc-439b-bc1d-cf8102817b77 tempest-AttachVolumeNegativeTest-605821046 None] Created reservations ['a2a3c8f1-6812-40a0-a1bd-ce1ca1cba855', '8d03b598-ddfb-46d3-a43c-f1a0361bd502', '6786a22c-96b2-4894-9c92-d22a3a866c36', 'c4f2345d-0c90-4310-9206-d4431d595b4d'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:43:36 devstack sudo[98318]: pam_unix(sudo:session): session closed for user root Sep 18 21:43:36 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0b1297aa-3688-4858-a5ae-4c658aba3acd tempest-VolumesNegativeTest-1777176385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-d6eee4d3-efc1-4057-9584-610abe821a57" returned: 0 in 0.393s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:43:36 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-0b1297aa-3688-4858-a5ae-4c658aba3acd tempest-VolumesNegativeTest-1777176385 None] <== create_volume: return (1128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:43:36 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-0b1297aa-3688-4858-a5ae-4c658aba3acd tempest-VolumesNegativeTest-1777176385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.131s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:43:36 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-0b1297aa-3688-4858-a5ae-4c658aba3acd tempest-VolumesNegativeTest-1777176385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c17f907-8b2f-4823-b9da-a58dee4ddb5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6eee4d3-efc1-4057-9584-610abe821a57', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:43:36 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-0b1297aa-3688-4858-a5ae-4c658aba3acd tempest-VolumesNegativeTest-1777176385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91c50b2f-6d35-46f6-a73b-12e6c9f5d89d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:43:36 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-0b1297aa-3688-4858-a5ae-4c658aba3acd tempest-VolumesNegativeTest-1777176385 None] Volume volume-d6eee4d3-efc1-4057-9584-610abe821a57 (d6eee4d3-efc1-4057-9584-610abe821a57): created successfully Sep 18 21:43:36 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-0b1297aa-3688-4858-a5ae-4c658aba3acd tempest-VolumesNegativeTest-1777176385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91c50b2f-6d35-46f6-a73b-12e6c9f5d89d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:43:36 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-0b1297aa-3688-4858-a5ae-4c658aba3acd tempest-VolumesNegativeTest-1777176385 None] Flow 'volume_create_manager' (15242a44-5cbf-4c98-9adb-d3fb21542c74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:43:36 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-87fe55a1-b6dc-439b-bc1d-cf8102817b77 tempest-AttachVolumeNegativeTest-605821046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:43:36 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-87fe55a1-b6dc-439b-bc1d-cf8102817b77 tempest-AttachVolumeNegativeTest-605821046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:43:36 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-87fe55a1-b6dc-439b-bc1d-cf8102817b77 tempest-AttachVolumeNegativeTest-605821046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:43:36 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-87fe55a1-b6dc-439b-bc1d-cf8102817b77 tempest-AttachVolumeNegativeTest-605821046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:43:36 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-87fe55a1-b6dc-439b-bc1d-cf8102817b77 tempest-AttachVolumeNegativeTest-605821046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:43:36 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-87fe55a1-b6dc-439b-bc1d-cf8102817b77 tempest-AttachVolumeNegativeTest-605821046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:43:36 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-0b1297aa-3688-4858-a5ae-4c658aba3acd tempest-VolumesNegativeTest-1777176385 None] Created volume successfully. Sep 18 21:43:36 devstack sudo[98322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:43:36 devstack sudo[98322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:43:37 devstack sudo[98322]: pam_unix(sudo:session): session closed for user root Sep 18 21:43:37 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-87fe55a1-b6dc-439b-bc1d-cf8102817b77 tempest-AttachVolumeNegativeTest-605821046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.301s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:43:37 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-87fe55a1-b6dc-439b-bc1d-cf8102817b77 tempest-AttachVolumeNegativeTest-605821046 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:43:37 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-87fe55a1-b6dc-439b-bc1d-cf8102817b77 tempest-AttachVolumeNegativeTest-605821046 None] Deleted volume successfully. Sep 18 21:43:37 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-87fe55a1-b6dc-439b-bc1d-cf8102817b77 tempest-AttachVolumeNegativeTest-605821046 None] Lock "cinder-8351963b-4e32-44de-bd3d-2eec4a802b12-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:43:38 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-fb8740dc-9743-4ddf-a643-513fa86e18ed tempest-AttachVolumeNegativeTest-605821046 None] Acquiring lock "cinder-9a1be3b5-70fb-44ba-9551-fb7c7861bfbe-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:43:38 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-fb8740dc-9743-4ddf-a643-513fa86e18ed tempest-AttachVolumeNegativeTest-605821046 None] Lock "cinder-9a1be3b5-70fb-44ba-9551-fb7c7861bfbe-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:43:38 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-fb8740dc-9743-4ddf-a643-513fa86e18ed tempest-AttachVolumeNegativeTest-605821046 None] Acquiring lock "cinder-quobyte-9a1be3b5-70fb-44ba-9551-fb7c7861bfbe" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:43:38 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-fb8740dc-9743-4ddf-a643-513fa86e18ed tempest-AttachVolumeNegativeTest-605821046 None] Lock "cinder-quobyte-9a1be3b5-70fb-44ba-9551-fb7c7861bfbe" acquired by "delete_volume" :: waited 0.031s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:43:38 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[8168ac79-1a46-422f-a97c-39a53b810ad3]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:43:38 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-fb8740dc-9743-4ddf-a643-513fa86e18ed tempest-AttachVolumeNegativeTest-605821046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9a1be3b5-70fb-44ba-9551-fb7c7861bfbe {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:43:38 devstack sudo[98332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9a1be3b5-70fb-44ba-9551-fb7c7861bfbe Sep 18 21:43:38 devstack sudo[98332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:43:38 devstack sudo[98332]: pam_unix(sudo:session): session closed for user root Sep 18 21:43:38 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-fb8740dc-9743-4ddf-a643-513fa86e18ed tempest-AttachVolumeNegativeTest-605821046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9a1be3b5-70fb-44ba-9551-fb7c7861bfbe" returned: 0 in 0.580s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:43:38 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-fb8740dc-9743-4ddf-a643-513fa86e18ed tempest-AttachVolumeNegativeTest-605821046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9a1be3b5-70fb-44ba-9551-fb7c7861bfbe {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:43:38 devstack sudo[98337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9a1be3b5-70fb-44ba-9551-fb7c7861bfbe Sep 18 21:43:38 devstack sudo[98337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:43:39 devstack sudo[98337]: pam_unix(sudo:session): session closed for user root Sep 18 21:43:39 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-fb8740dc-9743-4ddf-a643-513fa86e18ed tempest-AttachVolumeNegativeTest-605821046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9a1be3b5-70fb-44ba-9551-fb7c7861bfbe" returned: 0 in 0.357s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:43:39 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-fb8740dc-9743-4ddf-a643-513fa86e18ed tempest-AttachVolumeNegativeTest-605821046 None] Lock "cinder-quobyte-9a1be3b5-70fb-44ba-9551-fb7c7861bfbe" released by "delete_volume" :: held 1.032s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:43:39 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-fb8740dc-9743-4ddf-a643-513fa86e18ed tempest-AttachVolumeNegativeTest-605821046 None] Created reservations ['8f7ff901-994a-40bd-81f9-eed7a04acb84', '79e46ad9-3ad5-4bd9-ad10-243aba562d80', '7dab84a0-f3d9-470f-82db-86255b43f95a', '213e8c85-16d2-426f-889f-714340beb443'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:43:39 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-43b275e6-62f1-46b4-a166-d12b71bac124 req-841c1a7a-62b8-4ceb-872f-47ce981441e7 tempest-TestInstancesWithCinderVolumes-34987593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:43:39 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-43b275e6-62f1-46b4-a166-d12b71bac124 req-841c1a7a-62b8-4ceb-872f-47ce981441e7 tempest-TestInstancesWithCinderVolumes-34987593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:43:39 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-fb8740dc-9743-4ddf-a643-513fa86e18ed tempest-AttachVolumeNegativeTest-605821046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:43:39 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-fb8740dc-9743-4ddf-a643-513fa86e18ed tempest-AttachVolumeNegativeTest-605821046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:43:39 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-fb8740dc-9743-4ddf-a643-513fa86e18ed tempest-AttachVolumeNegativeTest-605821046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:43:39 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-fb8740dc-9743-4ddf-a643-513fa86e18ed tempest-AttachVolumeNegativeTest-605821046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:43:39 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-fb8740dc-9743-4ddf-a643-513fa86e18ed tempest-AttachVolumeNegativeTest-605821046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:43:39 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-fb8740dc-9743-4ddf-a643-513fa86e18ed tempest-AttachVolumeNegativeTest-605821046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:43:39 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-43b275e6-62f1-46b4-a166-d12b71bac124 req-841c1a7a-62b8-4ceb-872f-47ce981441e7 tempest-TestInstancesWithCinderVolumes-34987593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.044s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:43:39 devstack sudo[98348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:43:39 devstack sudo[98348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:43:39 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [req-43b275e6-62f1-46b4-a166-d12b71bac124 req-841c1a7a-62b8-4ceb-872f-47ce981441e7 tempest-TestInstancesWithCinderVolumes-34987593 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff', 'name': 'volume-49dfec77-2112-4d6b-8f22-0406b3ffa3d2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ba01447e-b813-4e10-b793-5d1d8b9cfd4d', 'enforce_multipath': True} {{(pid=86136) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 18 21:43:39 devstack cinder-volume[86136]: INFO cinder.volume.manager [req-43b275e6-62f1-46b4-a166-d12b71bac124 req-841c1a7a-62b8-4ceb-872f-47ce981441e7 tempest-TestInstancesWithCinderVolumes-34987593 None] attachment_update completed successfully. Sep 18 21:43:40 devstack sudo[98348]: pam_unix(sudo:session): session closed for user root Sep 18 21:43:40 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-fb8740dc-9743-4ddf-a643-513fa86e18ed tempest-AttachVolumeNegativeTest-605821046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.451s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:43:40 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-fb8740dc-9743-4ddf-a643-513fa86e18ed tempest-AttachVolumeNegativeTest-605821046 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:43:40 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-fb8740dc-9743-4ddf-a643-513fa86e18ed tempest-AttachVolumeNegativeTest-605821046 None] Deleted volume successfully. Sep 18 21:43:40 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-fb8740dc-9743-4ddf-a643-513fa86e18ed tempest-AttachVolumeNegativeTest-605821046 None] Lock "cinder-9a1be3b5-70fb-44ba-9551-fb7c7861bfbe-delete_volume" released by "delete_volume" :: held 1.914s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:43:49 devstack cinder-volume[86136]: DEBUG dbcounter [-] [86136] Writing DB stats cinder:SELECT=82,cinder:UPDATE=69,cinder:INSERT=23,cinder:DELETE=3 {{(pid=86136) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 21:43:50 devstack cinder-volume[86136]: DEBUG dbcounter [-] [86136] Writing DB stats cinder:UPDATE=74,cinder:SELECT=70,cinder:DELETE=8,cinder:INSERT=15 {{(pid=86136) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 21:43:56 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-797065b2-e14b-48d3-938e-de2ce7104f53 tempest-GroupSnapshotsTest-367307629 None] Group tempest-GroupSnapshotsTest-Group-350515378: creating Sep 18 21:43:56 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-797065b2-e14b-48d3-938e-de2ce7104f53 tempest-GroupSnapshotsTest-367307629 None] Group tempest-GroupSnapshotsTest-Group-350515378: created successfully Sep 18 21:43:56 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-797065b2-e14b-48d3-938e-de2ce7104f53 tempest-GroupSnapshotsTest-367307629 None] Create group completed successfully. Sep 18 21:43:59 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8a58950-13c3-4cc7-9535-25dcadbdabcf tempest-GroupSnapshotsTest-367307629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:43:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c8a58950-13c3-4cc7-9535-25dcadbdabcf tempest-GroupSnapshotsTest-367307629 None] Flow 'volume_create_manager' (038bb04d-fade-4d9e-8ec1-85c155a7936b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:43:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c8a58950-13c3-4cc7-9535-25dcadbdabcf tempest-GroupSnapshotsTest-367307629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (911db5c1-eee5-4451-ba7b-f8ef89d53031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:43:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c8a58950-13c3-4cc7-9535-25dcadbdabcf tempest-GroupSnapshotsTest-367307629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (911db5c1-eee5-4451-ba7b-f8ef89d53031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:43:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-399072984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=93284ba8-bae5-4267-957c-b61e9a0b1c63,host='devstack@QuobyteHD#QuobyteHD',id=631542a4-639e-4acc-817c-8bd861773b19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1623a52b317543e9922e23aab834e567',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:43:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:43:59Z,use_quota=True,user_id='3f44c15c704a42e5b18ee6f61ea8b5d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a044ec7-a344-4f78-8129-93747705c01d),volume_type_id=4a044ec7-a344-4f78-8129-93747705c01d)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:43:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c8a58950-13c3-4cc7-9535-25dcadbdabcf tempest-GroupSnapshotsTest-367307629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a12b3e7-5867-4e44-a57e-89c3a6dd39ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:43:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c8a58950-13c3-4cc7-9535-25dcadbdabcf tempest-GroupSnapshotsTest-367307629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a12b3e7-5867-4e44-a57e-89c3a6dd39ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:43:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c8a58950-13c3-4cc7-9535-25dcadbdabcf tempest-GroupSnapshotsTest-367307629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff5d0eef-27b5-4408-8e1a-702cd97cea10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:43:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c8a58950-13c3-4cc7-9535-25dcadbdabcf tempest-GroupSnapshotsTest-367307629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff5d0eef-27b5-4408-8e1a-702cd97cea10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '631542a4-639e-4acc-817c-8bd861773b19', 'volume_name': 'volume-631542a4-639e-4acc-817c-8bd861773b19', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:43:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c8a58950-13c3-4cc7-9535-25dcadbdabcf tempest-GroupSnapshotsTest-367307629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d74fcb86-5169-4bbd-8065-f4938bd1d0b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:43:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c8a58950-13c3-4cc7-9535-25dcadbdabcf tempest-GroupSnapshotsTest-367307629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d74fcb86-5169-4bbd-8065-f4938bd1d0b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:43:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c8a58950-13c3-4cc7-9535-25dcadbdabcf tempest-GroupSnapshotsTest-367307629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e60ac951-9df1-4041-9d34-ae3f2af53037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:43:59 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-c8a58950-13c3-4cc7-9535-25dcadbdabcf tempest-GroupSnapshotsTest-367307629 None] Volume 631542a4-639e-4acc-817c-8bd861773b19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-631542a4-639e-4acc-817c-8bd861773b19', 'volume_size': 1} Sep 18 21:43:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c8a58950-13c3-4cc7-9535-25dcadbdabcf tempest-GroupSnapshotsTest-367307629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:43:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c8a58950-13c3-4cc7-9535-25dcadbdabcf tempest-GroupSnapshotsTest-367307629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:43:59 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-c8a58950-13c3-4cc7-9535-25dcadbdabcf tempest-GroupSnapshotsTest-367307629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=93284ba8-bae5-4267-957c-b61e9a0b1c63,created_at=2026-09-18T19:43:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-399072984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=93284ba8-bae5-4267-957c-b61e9a0b1c63,host='devstack@QuobyteHD#QuobyteHD',id=631542a4-639e-4acc-817c-8bd861773b19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1623a52b317543e9922e23aab834e567',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:43:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:43:59Z,use_quota=True,user_id='3f44c15c704a42e5b18ee6f61ea8b5d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a044ec7-a344-4f78-8129-93747705c01d),volume_type_id=4a044ec7-a344-4f78-8129-93747705c01d)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:43:59 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-c8a58950-13c3-4cc7-9535-25dcadbdabcf tempest-GroupSnapshotsTest-367307629 None] Creating volume 631542a4-639e-4acc-817c-8bd861773b19 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:43:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c8a58950-13c3-4cc7-9535-25dcadbdabcf tempest-GroupSnapshotsTest-367307629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:43:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c8a58950-13c3-4cc7-9535-25dcadbdabcf tempest-GroupSnapshotsTest-367307629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:43:59 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-c8a58950-13c3-4cc7-9535-25dcadbdabcf tempest-GroupSnapshotsTest-367307629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:43:59 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-c8a58950-13c3-4cc7-9535-25dcadbdabcf tempest-GroupSnapshotsTest-367307629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:43:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c8a58950-13c3-4cc7-9535-25dcadbdabcf tempest-GroupSnapshotsTest-367307629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:43:59 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-c8a58950-13c3-4cc7-9535-25dcadbdabcf tempest-GroupSnapshotsTest-367307629 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:43:59 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-c8a58950-13c3-4cc7-9535-25dcadbdabcf tempest-GroupSnapshotsTest-367307629 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:43:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c8a58950-13c3-4cc7-9535-25dcadbdabcf tempest-GroupSnapshotsTest-367307629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-631542a4-639e-4acc-817c-8bd861773b19 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:43:59 devstack sudo[98947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-631542a4-639e-4acc-817c-8bd861773b19 1073741824 Sep 18 21:43:59 devstack sudo[98947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:44:00 devstack sudo[98947]: pam_unix(sudo:session): session closed for user root Sep 18 21:44:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c8a58950-13c3-4cc7-9535-25dcadbdabcf tempest-GroupSnapshotsTest-367307629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-631542a4-639e-4acc-817c-8bd861773b19 1073741824" returned: 0 in 0.697s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:44:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c8a58950-13c3-4cc7-9535-25dcadbdabcf tempest-GroupSnapshotsTest-367307629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-631542a4-639e-4acc-817c-8bd861773b19 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:44:00 devstack sudo[98955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-631542a4-639e-4acc-817c-8bd861773b19 Sep 18 21:44:00 devstack sudo[98955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:44:00 devstack sudo[98955]: pam_unix(sudo:session): session closed for user root Sep 18 21:44:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c8a58950-13c3-4cc7-9535-25dcadbdabcf tempest-GroupSnapshotsTest-367307629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-631542a4-639e-4acc-817c-8bd861773b19" returned: 0 in 0.475s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:44:00 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-c8a58950-13c3-4cc7-9535-25dcadbdabcf tempest-GroupSnapshotsTest-367307629 None] <== create_volume: return (1452ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:44:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c8a58950-13c3-4cc7-9535-25dcadbdabcf tempest-GroupSnapshotsTest-367307629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.457s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:44:00 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c8a58950-13c3-4cc7-9535-25dcadbdabcf tempest-GroupSnapshotsTest-367307629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e60ac951-9df1-4041-9d34-ae3f2af53037) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-631542a4-639e-4acc-817c-8bd861773b19', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:44:01 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c8a58950-13c3-4cc7-9535-25dcadbdabcf tempest-GroupSnapshotsTest-367307629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99267695-e162-47ea-905e-da7f174846cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:44:01 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-c8a58950-13c3-4cc7-9535-25dcadbdabcf tempest-GroupSnapshotsTest-367307629 None] Volume volume-631542a4-639e-4acc-817c-8bd861773b19 (631542a4-639e-4acc-817c-8bd861773b19): created successfully Sep 18 21:44:01 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c8a58950-13c3-4cc7-9535-25dcadbdabcf tempest-GroupSnapshotsTest-367307629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99267695-e162-47ea-905e-da7f174846cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:44:01 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c8a58950-13c3-4cc7-9535-25dcadbdabcf tempest-GroupSnapshotsTest-367307629 None] Flow 'volume_create_manager' (038bb04d-fade-4d9e-8ec1-85c155a7936b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:44:01 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-c8a58950-13c3-4cc7-9535-25dcadbdabcf tempest-GroupSnapshotsTest-367307629 None] Created volume successfully. Sep 18 21:44:02 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-6fd6f940-afeb-4710-9480-863b8126a0cd tempest-GroupSnapshotsTest-367307629 None] GroupSnapshot d2edc7f5-7401-4715-82a2-14e4bd0bac20: creating. Sep 18 21:44:02 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6fd6f940-afeb-4710-9480-863b8126a0cd tempest-GroupSnapshotsTest-367307629 None] Group snapshot d2edc7f5-7401-4715-82a2-14e4bd0bac20: creating. {{(pid=86136) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 18 21:44:02 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6fd6f940-afeb-4710-9480-863b8126a0cd tempest-GroupSnapshotsTest-367307629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:44:02 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6fd6f940-afeb-4710-9480-863b8126a0cd tempest-GroupSnapshotsTest-367307629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:44:02 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-6fd6f940-afeb-4710-9480-863b8126a0cd tempest-GroupSnapshotsTest-367307629 None] Creating offline snapshot e1bb28af-02de-4b29-bd55-5fb7c48fd47a of volume 631542a4-639e-4acc-817c-8bd861773b19 {{(pid=86136) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 21:44:02 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba55394-2d04-419f-a06d-41a997da5b83]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:44:02 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6fd6f940-afeb-4710-9480-863b8126a0cd tempest-GroupSnapshotsTest-367307629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-631542a4-639e-4acc-817c-8bd861773b19 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:44:03 devstack sudo[98961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-631542a4-639e-4acc-817c-8bd861773b19 Sep 18 21:44:03 devstack sudo[98961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:44:03 devstack sudo[98961]: pam_unix(sudo:session): session closed for user root Sep 18 21:44:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6fd6f940-afeb-4710-9480-863b8126a0cd tempest-GroupSnapshotsTest-367307629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-631542a4-639e-4acc-817c-8bd861773b19" returned: 0 in 0.830s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:44:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6fd6f940-afeb-4710-9480-863b8126a0cd tempest-GroupSnapshotsTest-367307629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-631542a4-639e-4acc-817c-8bd861773b19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-631542a4-639e-4acc-817c-8bd861773b19.e1bb28af-02de-4b29-bd55-5fb7c48fd47a 1G {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:44:03 devstack sudo[98966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-631542a4-639e-4acc-817c-8bd861773b19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-631542a4-639e-4acc-817c-8bd861773b19.e1bb28af-02de-4b29-bd55-5fb7c48fd47a 1G Sep 18 21:44:03 devstack sudo[98966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:44:04 devstack sudo[98966]: pam_unix(sudo:session): session closed for user root Sep 18 21:44:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6fd6f940-afeb-4710-9480-863b8126a0cd tempest-GroupSnapshotsTest-367307629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-631542a4-639e-4acc-817c-8bd861773b19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-631542a4-639e-4acc-817c-8bd861773b19.e1bb28af-02de-4b29-bd55-5fb7c48fd47a 1G" returned: 0 in 0.577s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:44:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6fd6f940-afeb-4710-9480-863b8126a0cd tempest-GroupSnapshotsTest-367307629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-631542a4-639e-4acc-817c-8bd861773b19 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-631542a4-639e-4acc-817c-8bd861773b19.e1bb28af-02de-4b29-bd55-5fb7c48fd47a {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:44:04 devstack sudo[98972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-631542a4-639e-4acc-817c-8bd861773b19 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-631542a4-639e-4acc-817c-8bd861773b19.e1bb28af-02de-4b29-bd55-5fb7c48fd47a Sep 18 21:44:04 devstack sudo[98972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:44:04 devstack sudo[98972]: pam_unix(sudo:session): session closed for user root Sep 18 21:44:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6fd6f940-afeb-4710-9480-863b8126a0cd tempest-GroupSnapshotsTest-367307629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-631542a4-639e-4acc-817c-8bd861773b19 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-631542a4-639e-4acc-817c-8bd861773b19.e1bb28af-02de-4b29-bd55-5fb7c48fd47a" returned: 0 in 0.495s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:44:04 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-6fd6f940-afeb-4710-9480-863b8126a0cd tempest-GroupSnapshotsTest-367307629 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-631542a4-639e-4acc-817c-8bd861773b19.e1bb28af-02de-4b29-bd55-5fb7c48fd47a is being set with open permissions: ugo+rw: NotImplementedError Sep 18 21:44:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6fd6f940-afeb-4710-9480-863b8126a0cd tempest-GroupSnapshotsTest-367307629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-631542a4-639e-4acc-817c-8bd861773b19.e1bb28af-02de-4b29-bd55-5fb7c48fd47a {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:44:04 devstack sudo[98978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-631542a4-639e-4acc-817c-8bd861773b19.e1bb28af-02de-4b29-bd55-5fb7c48fd47a Sep 18 21:44:04 devstack sudo[98978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:44:05 devstack cinder-volume[86136]: DEBUG oslo_service.periodic_task [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86136) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 21:44:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:44:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:44:05 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:44:05 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:44:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:44:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:44:05 devstack sudo[98978]: pam_unix(sudo:session): session closed for user root Sep 18 21:44:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6fd6f940-afeb-4710-9480-863b8126a0cd tempest-GroupSnapshotsTest-367307629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-631542a4-639e-4acc-817c-8bd861773b19.e1bb28af-02de-4b29-bd55-5fb7c48fd47a" returned: 0 in 0.548s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:44:05 devstack sudo[98981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:44:05 devstack sudo[98981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:44:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6fd6f940-afeb-4710-9480-863b8126a0cd tempest-GroupSnapshotsTest-367307629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-631542a4-639e-4acc-817c-8bd861773b19.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:44:05 devstack sudo[98983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-631542a4-639e-4acc-817c-8bd861773b19.info Sep 18 21:44:05 devstack sudo[98983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:44:05 devstack sudo[98983]: pam_unix(sudo:session): session closed for user root Sep 18 21:44:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6fd6f940-afeb-4710-9480-863b8126a0cd tempest-GroupSnapshotsTest-367307629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-631542a4-639e-4acc-817c-8bd861773b19.info" returned: 0 in 0.618s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:44:05 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-6fd6f940-afeb-4710-9480-863b8126a0cd tempest-GroupSnapshotsTest-367307629 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-631542a4-639e-4acc-817c-8bd861773b19.info is being set with open permissions: ugo+rw: NotImplementedError Sep 18 21:44:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6fd6f940-afeb-4710-9480-863b8126a0cd tempest-GroupSnapshotsTest-367307629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-631542a4-639e-4acc-817c-8bd861773b19.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:44:05 devstack sudo[98981]: pam_unix(sudo:session): session closed for user root Sep 18 21:44:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.736s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:44:05 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:44:05 devstack cinder-volume[86136]: DEBUG oslo_service.periodic_task [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Running periodic task VolumeManager._thread_info {{(pid=86136) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 21:44:05 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] thread count: 28 {{(pid=86136) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 18 21:44:05 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] thread info: [<_MainThread(MainThread, started 138548347871360)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86136) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 18 21:44:05 devstack sudo[98987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-631542a4-639e-4acc-817c-8bd861773b19.info Sep 18 21:44:05 devstack sudo[98987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:44:06 devstack sudo[98987]: pam_unix(sudo:session): session closed for user root Sep 18 21:44:06 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6fd6f940-afeb-4710-9480-863b8126a0cd tempest-GroupSnapshotsTest-367307629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-631542a4-639e-4acc-817c-8bd861773b19.info" returned: 0 in 0.459s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:44:06 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6fd6f940-afeb-4710-9480-863b8126a0cd tempest-GroupSnapshotsTest-367307629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.758s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:44:06 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-6fd6f940-afeb-4710-9480-863b8126a0cd tempest-GroupSnapshotsTest-367307629 None] group_snapshot d2edc7f5-7401-4715-82a2-14e4bd0bac20: created successfully Sep 18 21:44:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-a91edb30-64bb-45dc-8d9a-81b09eefb323 tempest-GroupSnapshotsTest-367307629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:44:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-a91edb30-64bb-45dc-8d9a-81b09eefb323 tempest-GroupSnapshotsTest-367307629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:44:08 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-a91edb30-64bb-45dc-8d9a-81b09eefb323 tempest-GroupSnapshotsTest-367307629 None] Acquiring lock "cinder-quobyte-e1bb28af-02de-4b29-bd55-5fb7c48fd47a-92856615-2f2f-4aaa-83a0-22116203bd71" by "_create_volume_from_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:44:08 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-a91edb30-64bb-45dc-8d9a-81b09eefb323 tempest-GroupSnapshotsTest-367307629 None] Lock "cinder-quobyte-e1bb28af-02de-4b29-bd55-5fb7c48fd47a-92856615-2f2f-4aaa-83a0-22116203bd71" acquired by "_create_volume_from_snapshot" :: waited 0.054s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:44:08 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-a91edb30-64bb-45dc-8d9a-81b09eefb323 tempest-GroupSnapshotsTest-367307629 None] Creating volume 92856615-2f2f-4aaa-83a0-22116203bd71 from snapshot e1bb28af-02de-4b29-bd55-5fb7c48fd47a {{(pid=86136) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 18 21:44:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-a91edb30-64bb-45dc-8d9a-81b09eefb323 tempest-GroupSnapshotsTest-367307629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:44:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-a91edb30-64bb-45dc-8d9a-81b09eefb323 tempest-GroupSnapshotsTest-367307629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:44:08 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-a91edb30-64bb-45dc-8d9a-81b09eefb323 tempest-GroupSnapshotsTest-367307629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:44:08 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-a91edb30-64bb-45dc-8d9a-81b09eefb323 tempest-GroupSnapshotsTest-367307629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:44:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-a91edb30-64bb-45dc-8d9a-81b09eefb323 tempest-GroupSnapshotsTest-367307629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:44:08 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-a91edb30-64bb-45dc-8d9a-81b09eefb323 tempest-GroupSnapshotsTest-367307629 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:44:08 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-a91edb30-64bb-45dc-8d9a-81b09eefb323 tempest-GroupSnapshotsTest-367307629 None] Acquiring lock "cinder-quobyte-92856615-2f2f-4aaa-83a0-22116203bd71" by "_copy_volume_from_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:44:08 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-a91edb30-64bb-45dc-8d9a-81b09eefb323 tempest-GroupSnapshotsTest-367307629 None] Lock "cinder-quobyte-92856615-2f2f-4aaa-83a0-22116203bd71" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:44:08 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-a91edb30-64bb-45dc-8d9a-81b09eefb323 tempest-GroupSnapshotsTest-367307629 None] snapshot: e1bb28af-02de-4b29-bd55-5fb7c48fd47a, volume: 92856615-2f2f-4aaa-83a0-22116203bd71, {{(pid=86136) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 18 21:44:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-a91edb30-64bb-45dc-8d9a-81b09eefb323 tempest-GroupSnapshotsTest-367307629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:44:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-a91edb30-64bb-45dc-8d9a-81b09eefb323 tempest-GroupSnapshotsTest-367307629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:44:08 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-a91edb30-64bb-45dc-8d9a-81b09eefb323 tempest-GroupSnapshotsTest-367307629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:44:08 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-a91edb30-64bb-45dc-8d9a-81b09eefb323 tempest-GroupSnapshotsTest-367307629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:44:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-a91edb30-64bb-45dc-8d9a-81b09eefb323 tempest-GroupSnapshotsTest-367307629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:44:08 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d69156-0463-4aa8-a9d9-c9572ea242e1]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:44:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-a91edb30-64bb-45dc-8d9a-81b09eefb323 tempest-GroupSnapshotsTest-367307629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-631542a4-639e-4acc-817c-8bd861773b19.e1bb28af-02de-4b29-bd55-5fb7c48fd47a {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:44:08 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-0e8ad365-bb0f-4d1a-a066-3f0f628992b0 tempest-VolumesNegativeTest-1777176385 None] Acquiring lock "cinder-d6eee4d3-efc1-4057-9584-610abe821a57-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:44:08 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-0e8ad365-bb0f-4d1a-a066-3f0f628992b0 tempest-VolumesNegativeTest-1777176385 None] Lock "cinder-d6eee4d3-efc1-4057-9584-610abe821a57-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:44:08 devstack sudo[99014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-631542a4-639e-4acc-817c-8bd861773b19.e1bb28af-02de-4b29-bd55-5fb7c48fd47a Sep 18 21:44:08 devstack sudo[99014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:44:08 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-0e8ad365-bb0f-4d1a-a066-3f0f628992b0 tempest-VolumesNegativeTest-1777176385 None] Acquiring lock "cinder-quobyte-d6eee4d3-efc1-4057-9584-610abe821a57" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:44:08 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-0e8ad365-bb0f-4d1a-a066-3f0f628992b0 tempest-VolumesNegativeTest-1777176385 None] Lock "cinder-quobyte-d6eee4d3-efc1-4057-9584-610abe821a57" acquired by "delete_volume" :: waited 0.032s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:44:08 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e33b12-6574-444c-ae84-5974551b61b0]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:44:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0e8ad365-bb0f-4d1a-a066-3f0f628992b0 tempest-VolumesNegativeTest-1777176385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-d6eee4d3-efc1-4057-9584-610abe821a57 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:44:08 devstack sudo[99016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-d6eee4d3-efc1-4057-9584-610abe821a57 Sep 18 21:44:08 devstack sudo[99016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:44:09 devstack sudo[99014]: pam_unix(sudo:session): session closed for user root Sep 18 21:44:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-a91edb30-64bb-45dc-8d9a-81b09eefb323 tempest-GroupSnapshotsTest-367307629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-631542a4-639e-4acc-817c-8bd861773b19.e1bb28af-02de-4b29-bd55-5fb7c48fd47a" returned: 0 in 0.644s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:44:09 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-a91edb30-64bb-45dc-8d9a-81b09eefb323 tempest-GroupSnapshotsTest-367307629 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-631542a4-639e-4acc-817c-8bd861773b19(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86136) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 21:44:09 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa6091d3-602d-459a-920a-7c16283633ab]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:44:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-a91edb30-64bb-45dc-8d9a-81b09eefb323 tempest-GroupSnapshotsTest-367307629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-631542a4-639e-4acc-817c-8bd861773b19 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:44:09 devstack sudo[99021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-631542a4-639e-4acc-817c-8bd861773b19 Sep 18 21:44:09 devstack sudo[99021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:44:09 devstack sudo[99016]: pam_unix(sudo:session): session closed for user root Sep 18 21:44:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0e8ad365-bb0f-4d1a-a066-3f0f628992b0 tempest-VolumesNegativeTest-1777176385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-d6eee4d3-efc1-4057-9584-610abe821a57" returned: 0 in 0.627s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:44:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0e8ad365-bb0f-4d1a-a066-3f0f628992b0 tempest-VolumesNegativeTest-1777176385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-d6eee4d3-efc1-4057-9584-610abe821a57 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:44:09 devstack sudo[99030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-d6eee4d3-efc1-4057-9584-610abe821a57 Sep 18 21:44:09 devstack sudo[99030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:44:09 devstack sudo[99021]: pam_unix(sudo:session): session closed for user root Sep 18 21:44:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-a91edb30-64bb-45dc-8d9a-81b09eefb323 tempest-GroupSnapshotsTest-367307629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-631542a4-639e-4acc-817c-8bd861773b19" returned: 0 in 0.525s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:44:09 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-a91edb30-64bb-45dc-8d9a-81b09eefb323 tempest-GroupSnapshotsTest-367307629 None] will copy from snapshot at /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-631542a4-639e-4acc-817c-8bd861773b19 {{(pid=86136) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 18 21:44:09 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-a91edb30-64bb-45dc-8d9a-81b09eefb323 tempest-GroupSnapshotsTest-367307629 None] Creating direct copy from snapshot {{(pid=86136) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 18 21:44:09 devstack cinder-volume[86136]: DEBUG cinder.utils [None req-a91edb30-64bb-45dc-8d9a-81b09eefb323 tempest-GroupSnapshotsTest-367307629 None] Path /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-92856615-2f2f-4aaa-83a0-22116203bd71 not found in is_blk_device check {{(pid=86136) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 18 21:44:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-a91edb30-64bb-45dc-8d9a-81b09eefb323 tempest-GroupSnapshotsTest-367307629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-631542a4-639e-4acc-817c-8bd861773b19 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-92856615-2f2f-4aaa-83a0-22116203bd71 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:44:09 devstack sudo[99035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-631542a4-639e-4acc-817c-8bd861773b19 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-92856615-2f2f-4aaa-83a0-22116203bd71 Sep 18 21:44:09 devstack sudo[99035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:44:09 devstack sudo[99030]: pam_unix(sudo:session): session closed for user root Sep 18 21:44:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0e8ad365-bb0f-4d1a-a066-3f0f628992b0 tempest-VolumesNegativeTest-1777176385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-d6eee4d3-efc1-4057-9584-610abe821a57" returned: 0 in 0.392s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:44:09 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-0e8ad365-bb0f-4d1a-a066-3f0f628992b0 tempest-VolumesNegativeTest-1777176385 None] Lock "cinder-quobyte-d6eee4d3-efc1-4057-9584-610abe821a57" released by "delete_volume" :: held 1.133s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:44:09 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-0e8ad365-bb0f-4d1a-a066-3f0f628992b0 tempest-VolumesNegativeTest-1777176385 None] Created reservations ['73d6b77b-a365-4c63-a951-65760e2383b2', '6a21b3bd-4e56-46f9-9cf5-f4f1cdcf92aa', '8c5e146f-13c1-4533-9a78-ea4f808c13b8', 'e8bd18a6-e84e-4f3a-a2d6-1c538a4ac7fe'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:44:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-0e8ad365-bb0f-4d1a-a066-3f0f628992b0 tempest-VolumesNegativeTest-1777176385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:44:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-0e8ad365-bb0f-4d1a-a066-3f0f628992b0 tempest-VolumesNegativeTest-1777176385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:44:09 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-0e8ad365-bb0f-4d1a-a066-3f0f628992b0 tempest-VolumesNegativeTest-1777176385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:44:09 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-0e8ad365-bb0f-4d1a-a066-3f0f628992b0 tempest-VolumesNegativeTest-1777176385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:44:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-0e8ad365-bb0f-4d1a-a066-3f0f628992b0 tempest-VolumesNegativeTest-1777176385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:44:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0e8ad365-bb0f-4d1a-a066-3f0f628992b0 tempest-VolumesNegativeTest-1777176385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:44:10 devstack sudo[99042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:44:10 devstack sudo[99042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:44:10 devstack sudo[99042]: pam_unix(sudo:session): session closed for user root Sep 18 21:44:10 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0e8ad365-bb0f-4d1a-a066-3f0f628992b0 tempest-VolumesNegativeTest-1777176385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.606s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:44:10 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-0e8ad365-bb0f-4d1a-a066-3f0f628992b0 tempest-VolumesNegativeTest-1777176385 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:44:10 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-0e8ad365-bb0f-4d1a-a066-3f0f628992b0 tempest-VolumesNegativeTest-1777176385 None] Deleted volume successfully. Sep 18 21:44:10 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-0e8ad365-bb0f-4d1a-a066-3f0f628992b0 tempest-VolumesNegativeTest-1777176385 None] Lock "cinder-d6eee4d3-efc1-4057-9584-610abe821a57-delete_volume" released by "delete_volume" :: held 2.107s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:44:18 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-c080ed67-d015-494c-a9ab-fcff7190d5a4 tempest-VolumesSnapshotNegativeTestJSON-919717616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:44:18 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c080ed67-d015-494c-a9ab-fcff7190d5a4 tempest-VolumesSnapshotNegativeTestJSON-919717616 None] Flow 'volume_create_manager' (a7d8dddf-3e52-45df-aa0f-9d07c85f993c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:44:18 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c080ed67-d015-494c-a9ab-fcff7190d5a4 tempest-VolumesSnapshotNegativeTestJSON-919717616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (115d8e5f-793e-4338-83c9-32f3843b1a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:44:18 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c080ed67-d015-494c-a9ab-fcff7190d5a4 tempest-VolumesSnapshotNegativeTestJSON-919717616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (115d8e5f-793e-4338-83c9-32f3843b1a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:44:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1804425569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d37b893-55e0-4c17-9f5e-157fb4d4322e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65bd21e735fa48479c36ad97b695e6bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:44:18Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:44:18Z,use_quota=True,user_id='46313256c9864dac86b2b232c45c4842',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:44:18 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c080ed67-d015-494c-a9ab-fcff7190d5a4 tempest-VolumesSnapshotNegativeTestJSON-919717616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f249f5c-0161-4171-ae92-203039aa58e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:44:18 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c080ed67-d015-494c-a9ab-fcff7190d5a4 tempest-VolumesSnapshotNegativeTestJSON-919717616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f249f5c-0161-4171-ae92-203039aa58e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:44:18 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c080ed67-d015-494c-a9ab-fcff7190d5a4 tempest-VolumesSnapshotNegativeTestJSON-919717616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7224880d-bd74-4726-a610-165dbd1c9350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:44:18 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c080ed67-d015-494c-a9ab-fcff7190d5a4 tempest-VolumesSnapshotNegativeTestJSON-919717616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7224880d-bd74-4726-a610-165dbd1c9350) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d37b893-55e0-4c17-9f5e-157fb4d4322e', 'volume_name': 'volume-9d37b893-55e0-4c17-9f5e-157fb4d4322e', 'volume_size': 2}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:44:18 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c080ed67-d015-494c-a9ab-fcff7190d5a4 tempest-VolumesSnapshotNegativeTestJSON-919717616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c4b511f-d37e-4895-81ce-c337e16ed10d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:44:18 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c080ed67-d015-494c-a9ab-fcff7190d5a4 tempest-VolumesSnapshotNegativeTestJSON-919717616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c4b511f-d37e-4895-81ce-c337e16ed10d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:44:18 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c080ed67-d015-494c-a9ab-fcff7190d5a4 tempest-VolumesSnapshotNegativeTestJSON-919717616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dec40198-1298-48fc-98a7-6b486e0f86d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:44:18 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-c080ed67-d015-494c-a9ab-fcff7190d5a4 tempest-VolumesSnapshotNegativeTestJSON-919717616 None] Volume 9d37b893-55e0-4c17-9f5e-157fb4d4322e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d37b893-55e0-4c17-9f5e-157fb4d4322e', 'volume_size': 2} Sep 18 21:44:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c080ed67-d015-494c-a9ab-fcff7190d5a4 tempest-VolumesSnapshotNegativeTestJSON-919717616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:44:18 devstack sudo[99035]: pam_unix(sudo:session): session closed for user root Sep 18 21:44:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-a91edb30-64bb-45dc-8d9a-81b09eefb323 tempest-GroupSnapshotsTest-367307629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-631542a4-639e-4acc-817c-8bd861773b19 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-92856615-2f2f-4aaa-83a0-22116203bd71" returned: 0 in 9.198s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:44:18 devstack cinder-volume[86136]: DEBUG cinder.image.image_utils [None req-a91edb30-64bb-45dc-8d9a-81b09eefb323 tempest-GroupSnapshotsTest-367307629 None] Image conversion details: src /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-631542a4-639e-4acc-817c-8bd861773b19, size 1024.00 MB, duration 9.20 sec, destination /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-92856615-2f2f-4aaa-83a0-22116203bd71 {{(pid=86136) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 18 21:44:18 devstack cinder-volume[86136]: INFO cinder.image.image_utils [None req-a91edb30-64bb-45dc-8d9a-81b09eefb323 tempest-GroupSnapshotsTest-367307629 None] Converted 1024.00 MB image at 111.32 MB/s Sep 18 21:44:18 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-a91edb30-64bb-45dc-8d9a-81b09eefb323 tempest-GroupSnapshotsTest-367307629 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-92856615-2f2f-4aaa-83a0-22116203bd71 is being set with open permissions: ugo+rw: NotImplementedError Sep 18 21:44:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-a91edb30-64bb-45dc-8d9a-81b09eefb323 tempest-GroupSnapshotsTest-367307629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-92856615-2f2f-4aaa-83a0-22116203bd71 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:44:18 devstack sudo[99073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-92856615-2f2f-4aaa-83a0-22116203bd71 Sep 18 21:44:18 devstack sudo[99073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:44:19 devstack sudo[99073]: pam_unix(sudo:session): session closed for user root Sep 18 21:44:19 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-a91edb30-64bb-45dc-8d9a-81b09eefb323 tempest-GroupSnapshotsTest-367307629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-92856615-2f2f-4aaa-83a0-22116203bd71" returned: 0 in 0.327s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:44:19 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-a91edb30-64bb-45dc-8d9a-81b09eefb323 tempest-GroupSnapshotsTest-367307629 None] Lock "cinder-quobyte-92856615-2f2f-4aaa-83a0-22116203bd71" released by "_copy_volume_from_snapshot" :: held 10.838s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:44:19 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-a91edb30-64bb-45dc-8d9a-81b09eefb323 tempest-GroupSnapshotsTest-367307629 None] Lock "cinder-quobyte-e1bb28af-02de-4b29-bd55-5fb7c48fd47a-92856615-2f2f-4aaa-83a0-22116203bd71" released by "_create_volume_from_snapshot" :: held 10.967s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:44:19 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-a91edb30-64bb-45dc-8d9a-81b09eefb323 tempest-GroupSnapshotsTest-367307629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.023s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:44:19 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c080ed67-d015-494c-a9ab-fcff7190d5a4 tempest-VolumesSnapshotNegativeTestJSON-919717616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.566s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:44:19 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-c080ed67-d015-494c-a9ab-fcff7190d5a4 tempest-VolumesSnapshotNegativeTestJSON-919717616 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:44:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1804425569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d37b893-55e0-4c17-9f5e-157fb4d4322e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65bd21e735fa48479c36ad97b695e6bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:44:18Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:44:18Z,use_quota=True,user_id='46313256c9864dac86b2b232c45c4842',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:44:19 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-c080ed67-d015-494c-a9ab-fcff7190d5a4 tempest-VolumesSnapshotNegativeTestJSON-919717616 None] Creating volume 9d37b893-55e0-4c17-9f5e-157fb4d4322e {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:44:19 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c080ed67-d015-494c-a9ab-fcff7190d5a4 tempest-VolumesSnapshotNegativeTestJSON-919717616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:44:19 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c080ed67-d015-494c-a9ab-fcff7190d5a4 tempest-VolumesSnapshotNegativeTestJSON-919717616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:44:19 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-c080ed67-d015-494c-a9ab-fcff7190d5a4 tempest-VolumesSnapshotNegativeTestJSON-919717616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:44:19 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-c080ed67-d015-494c-a9ab-fcff7190d5a4 tempest-VolumesSnapshotNegativeTestJSON-919717616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:44:19 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c080ed67-d015-494c-a9ab-fcff7190d5a4 tempest-VolumesSnapshotNegativeTestJSON-919717616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:44:19 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-c080ed67-d015-494c-a9ab-fcff7190d5a4 tempest-VolumesSnapshotNegativeTestJSON-919717616 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:44:19 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-c080ed67-d015-494c-a9ab-fcff7190d5a4 tempest-VolumesSnapshotNegativeTestJSON-919717616 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:44:19 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c080ed67-d015-494c-a9ab-fcff7190d5a4 tempest-VolumesSnapshotNegativeTestJSON-919717616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9d37b893-55e0-4c17-9f5e-157fb4d4322e 2147483648 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:44:19 devstack sudo[99096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9d37b893-55e0-4c17-9f5e-157fb4d4322e 2147483648 Sep 18 21:44:19 devstack sudo[99096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:44:19 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-a91edb30-64bb-45dc-8d9a-81b09eefb323 tempest-GroupSnapshotsTest-367307629 None] Create group from source-snapshot-d2edc7f5-7401-4715-82a2-14e4bd0bac20 completed successfully. Sep 18 21:44:19 devstack sudo[99096]: pam_unix(sudo:session): session closed for user root Sep 18 21:44:19 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c080ed67-d015-494c-a9ab-fcff7190d5a4 tempest-VolumesSnapshotNegativeTestJSON-919717616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9d37b893-55e0-4c17-9f5e-157fb4d4322e 2147483648" returned: 0 in 0.730s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:44:19 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c080ed67-d015-494c-a9ab-fcff7190d5a4 tempest-VolumesSnapshotNegativeTestJSON-919717616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9d37b893-55e0-4c17-9f5e-157fb4d4322e {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:44:20 devstack sudo[99104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9d37b893-55e0-4c17-9f5e-157fb4d4322e Sep 18 21:44:20 devstack sudo[99104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:44:20 devstack sudo[99104]: pam_unix(sudo:session): session closed for user root Sep 18 21:44:20 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c080ed67-d015-494c-a9ab-fcff7190d5a4 tempest-VolumesSnapshotNegativeTestJSON-919717616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9d37b893-55e0-4c17-9f5e-157fb4d4322e" returned: 0 in 0.271s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:44:20 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-c080ed67-d015-494c-a9ab-fcff7190d5a4 tempest-VolumesSnapshotNegativeTestJSON-919717616 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:44:20 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c080ed67-d015-494c-a9ab-fcff7190d5a4 tempest-VolumesSnapshotNegativeTestJSON-919717616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:44:20 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c080ed67-d015-494c-a9ab-fcff7190d5a4 tempest-VolumesSnapshotNegativeTestJSON-919717616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dec40198-1298-48fc-98a7-6b486e0f86d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d37b893-55e0-4c17-9f5e-157fb4d4322e', 'volume_size': 2}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:44:20 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c080ed67-d015-494c-a9ab-fcff7190d5a4 tempest-VolumesSnapshotNegativeTestJSON-919717616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a753490c-3175-4b51-80b7-2b16a964a3b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:44:20 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-c080ed67-d015-494c-a9ab-fcff7190d5a4 tempest-VolumesSnapshotNegativeTestJSON-919717616 None] Volume volume-9d37b893-55e0-4c17-9f5e-157fb4d4322e (9d37b893-55e0-4c17-9f5e-157fb4d4322e): created successfully Sep 18 21:44:20 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c080ed67-d015-494c-a9ab-fcff7190d5a4 tempest-VolumesSnapshotNegativeTestJSON-919717616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a753490c-3175-4b51-80b7-2b16a964a3b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:44:20 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c080ed67-d015-494c-a9ab-fcff7190d5a4 tempest-VolumesSnapshotNegativeTestJSON-919717616 None] Flow 'volume_create_manager' (a7d8dddf-3e52-45df-aa0f-9d07c85f993c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:44:20 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-c080ed67-d015-494c-a9ab-fcff7190d5a4 tempest-VolumesSnapshotNegativeTestJSON-919717616 None] Created volume successfully. Sep 18 21:44:20 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-3d3239ff-c754-4763-93b8-cd49af740ce3 tempest-VolumesSnapshotNegativeTestJSON-919717616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:44:20 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-3d3239ff-c754-4763-93b8-cd49af740ce3 tempest-VolumesSnapshotNegativeTestJSON-919717616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:44:20 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-3d3239ff-c754-4763-93b8-cd49af740ce3 tempest-VolumesSnapshotNegativeTestJSON-919717616 None] Creating offline snapshot cebefb8c-ae49-437f-9433-298fd78a313e of volume 9d37b893-55e0-4c17-9f5e-157fb4d4322e {{(pid=86136) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 21:44:20 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[05466a97-e632-43a3-af5e-c1101061657a]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:44:20 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3d3239ff-c754-4763-93b8-cd49af740ce3 tempest-VolumesSnapshotNegativeTestJSON-919717616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9d37b893-55e0-4c17-9f5e-157fb4d4322e {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:44:21 devstack sudo[99119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9d37b893-55e0-4c17-9f5e-157fb4d4322e Sep 18 21:44:21 devstack sudo[99119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:44:21 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-9c486142-99bc-41e6-9967-e78cc6412033 tempest-GroupSnapshotsTest-367307629 None] Acquiring lock "cinder-quobyte-92856615-2f2f-4aaa-83a0-22116203bd71" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:44:21 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-9c486142-99bc-41e6-9967-e78cc6412033 tempest-GroupSnapshotsTest-367307629 None] Lock "cinder-quobyte-92856615-2f2f-4aaa-83a0-22116203bd71" acquired by "delete_volume" :: waited 0.030s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:44:21 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[67484752-dba8-4824-afc3-62fd45e0030c]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:44:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9c486142-99bc-41e6-9967-e78cc6412033 tempest-GroupSnapshotsTest-367307629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-92856615-2f2f-4aaa-83a0-22116203bd71 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:44:21 devstack sudo[99121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-92856615-2f2f-4aaa-83a0-22116203bd71 Sep 18 21:44:21 devstack sudo[99121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:44:21 devstack sudo[99119]: pam_unix(sudo:session): session closed for user root Sep 18 21:44:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3d3239ff-c754-4763-93b8-cd49af740ce3 tempest-VolumesSnapshotNegativeTestJSON-919717616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9d37b893-55e0-4c17-9f5e-157fb4d4322e" returned: 0 in 0.603s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:44:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3d3239ff-c754-4763-93b8-cd49af740ce3 tempest-VolumesSnapshotNegativeTestJSON-919717616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9d37b893-55e0-4c17-9f5e-157fb4d4322e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9d37b893-55e0-4c17-9f5e-157fb4d4322e.cebefb8c-ae49-437f-9433-298fd78a313e 2G {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:44:21 devstack sudo[99127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9d37b893-55e0-4c17-9f5e-157fb4d4322e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9d37b893-55e0-4c17-9f5e-157fb4d4322e.cebefb8c-ae49-437f-9433-298fd78a313e 2G Sep 18 21:44:21 devstack sudo[99127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:44:21 devstack sudo[99121]: pam_unix(sudo:session): session closed for user root Sep 18 21:44:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9c486142-99bc-41e6-9967-e78cc6412033 tempest-GroupSnapshotsTest-367307629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-92856615-2f2f-4aaa-83a0-22116203bd71" returned: 0 in 0.497s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:44:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9c486142-99bc-41e6-9967-e78cc6412033 tempest-GroupSnapshotsTest-367307629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-92856615-2f2f-4aaa-83a0-22116203bd71 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:44:21 devstack sudo[99133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-92856615-2f2f-4aaa-83a0-22116203bd71 Sep 18 21:44:21 devstack sudo[99133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:44:21 devstack sudo[99127]: pam_unix(sudo:session): session closed for user root Sep 18 21:44:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3d3239ff-c754-4763-93b8-cd49af740ce3 tempest-VolumesSnapshotNegativeTestJSON-919717616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9d37b893-55e0-4c17-9f5e-157fb4d4322e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9d37b893-55e0-4c17-9f5e-157fb4d4322e.cebefb8c-ae49-437f-9433-298fd78a313e 2G" returned: 0 in 0.470s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:44:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3d3239ff-c754-4763-93b8-cd49af740ce3 tempest-VolumesSnapshotNegativeTestJSON-919717616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d37b893-55e0-4c17-9f5e-157fb4d4322e -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9d37b893-55e0-4c17-9f5e-157fb4d4322e.cebefb8c-ae49-437f-9433-298fd78a313e {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:44:21 devstack sudo[99133]: pam_unix(sudo:session): session closed for user root Sep 18 21:44:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9c486142-99bc-41e6-9967-e78cc6412033 tempest-GroupSnapshotsTest-367307629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-92856615-2f2f-4aaa-83a0-22116203bd71" returned: 0 in 0.285s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:44:22 devstack sudo[99139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d37b893-55e0-4c17-9f5e-157fb4d4322e -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9d37b893-55e0-4c17-9f5e-157fb4d4322e.cebefb8c-ae49-437f-9433-298fd78a313e Sep 18 21:44:22 devstack sudo[99139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:44:22 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-9c486142-99bc-41e6-9967-e78cc6412033 tempest-GroupSnapshotsTest-367307629 None] Lock "cinder-quobyte-92856615-2f2f-4aaa-83a0-22116203bd71" released by "delete_volume" :: held 0.860s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:44:22 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-9c486142-99bc-41e6-9967-e78cc6412033 tempest-GroupSnapshotsTest-367307629 None] Created reservations ['f1e27378-a903-4ba7-bf04-0add1b89ab11'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:44:22 devstack cinder-volume[86136]: WARNING cinder.quota [None req-9c486142-99bc-41e6-9967-e78cc6412033 tempest-GroupSnapshotsTest-367307629 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-585415108 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-585415108, it is now deprecated. Please use the default quota class for default quota. Sep 18 21:44:22 devstack cinder-volume[86136]: WARNING cinder.quota [None req-9c486142-99bc-41e6-9967-e78cc6412033 tempest-GroupSnapshotsTest-367307629 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-585415108 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-585415108, it is now deprecated. Please use the default quota class for default quota. Sep 18 21:44:22 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-9c486142-99bc-41e6-9967-e78cc6412033 tempest-GroupSnapshotsTest-367307629 None] Created reservations ['8406dc89-0d81-4c41-a6bc-95534c8738c4', '4fd1f06f-a164-4458-a2d3-d9ba32660d81', '00262485-ab6e-49c1-b8f0-0684083a1eda', '57678f3a-96c2-4845-9efd-9afc16b4155c'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:44:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-9c486142-99bc-41e6-9967-e78cc6412033 tempest-GroupSnapshotsTest-367307629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:44:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-9c486142-99bc-41e6-9967-e78cc6412033 tempest-GroupSnapshotsTest-367307629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:44:22 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-9c486142-99bc-41e6-9967-e78cc6412033 tempest-GroupSnapshotsTest-367307629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:44:22 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-9c486142-99bc-41e6-9967-e78cc6412033 tempest-GroupSnapshotsTest-367307629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:44:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-9c486142-99bc-41e6-9967-e78cc6412033 tempest-GroupSnapshotsTest-367307629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:44:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9c486142-99bc-41e6-9967-e78cc6412033 tempest-GroupSnapshotsTest-367307629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:44:22 devstack sudo[99144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:44:22 devstack sudo[99144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:44:22 devstack sudo[99139]: pam_unix(sudo:session): session closed for user root Sep 18 21:44:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3d3239ff-c754-4763-93b8-cd49af740ce3 tempest-VolumesSnapshotNegativeTestJSON-919717616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d37b893-55e0-4c17-9f5e-157fb4d4322e -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9d37b893-55e0-4c17-9f5e-157fb4d4322e.cebefb8c-ae49-437f-9433-298fd78a313e" returned: 0 in 0.334s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:44:22 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-3d3239ff-c754-4763-93b8-cd49af740ce3 tempest-VolumesSnapshotNegativeTestJSON-919717616 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9d37b893-55e0-4c17-9f5e-157fb4d4322e.cebefb8c-ae49-437f-9433-298fd78a313e is being set with open permissions: ugo+rw Sep 18 21:44:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3d3239ff-c754-4763-93b8-cd49af740ce3 tempest-VolumesSnapshotNegativeTestJSON-919717616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9d37b893-55e0-4c17-9f5e-157fb4d4322e.cebefb8c-ae49-437f-9433-298fd78a313e {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:44:22 devstack sudo[99146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9d37b893-55e0-4c17-9f5e-157fb4d4322e.cebefb8c-ae49-437f-9433-298fd78a313e Sep 18 21:44:22 devstack sudo[99146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:44:22 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-5313fe78-e849-4844-866d-8f51f1f33fba tempest-GroupSnapshotsTest-367307629 None] group_snapshot d2edc7f5-7401-4715-82a2-14e4bd0bac20: deleting Sep 18 21:44:22 devstack sudo[99144]: pam_unix(sudo:session): session closed for user root Sep 18 21:44:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9c486142-99bc-41e6-9967-e78cc6412033 tempest-GroupSnapshotsTest-367307629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.280s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:44:22 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-9c486142-99bc-41e6-9967-e78cc6412033 tempest-GroupSnapshotsTest-367307629 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:44:22 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-5313fe78-e849-4844-866d-8f51f1f33fba tempest-GroupSnapshotsTest-367307629 None] group_snapshot d2edc7f5-7401-4715-82a2-14e4bd0bac20: deleting {{(pid=86136) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 18 21:44:22 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-9c486142-99bc-41e6-9967-e78cc6412033 tempest-GroupSnapshotsTest-367307629 None] Delete group completed successfully. Sep 18 21:44:22 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-5313fe78-e849-4844-866d-8f51f1f33fba tempest-GroupSnapshotsTest-367307629 None] Acquiring lock "cinder-quobyte-631542a4-639e-4acc-817c-8bd861773b19" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:44:22 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-5313fe78-e849-4844-866d-8f51f1f33fba tempest-GroupSnapshotsTest-367307629 None] Lock "cinder-quobyte-631542a4-639e-4acc-817c-8bd861773b19" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:44:22 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-5313fe78-e849-4844-866d-8f51f1f33fba tempest-GroupSnapshotsTest-367307629 None] Acquiring lock "cinder-quobyte-e1bb28af-02de-4b29-bd55-5fb7c48fd47a" by "_delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:44:22 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-5313fe78-e849-4844-866d-8f51f1f33fba tempest-GroupSnapshotsTest-367307629 None] Lock "cinder-quobyte-e1bb28af-02de-4b29-bd55-5fb7c48fd47a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:44:22 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-5313fe78-e849-4844-866d-8f51f1f33fba tempest-GroupSnapshotsTest-367307629 None] Deleting offline snapshot e1bb28af-02de-4b29-bd55-5fb7c48fd47a of volume 631542a4-639e-4acc-817c-8bd861773b19 {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 21:44:22 devstack sudo[99146]: pam_unix(sudo:session): session closed for user root Sep 18 21:44:22 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-5313fe78-e849-4844-866d-8f51f1f33fba tempest-GroupSnapshotsTest-367307629 None] snapshot_file for this snap is: volume-631542a4-639e-4acc-817c-8bd861773b19.e1bb28af-02de-4b29-bd55-5fb7c48fd47a {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 21:44:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3d3239ff-c754-4763-93b8-cd49af740ce3 tempest-VolumesSnapshotNegativeTestJSON-919717616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9d37b893-55e0-4c17-9f5e-157fb4d4322e.cebefb8c-ae49-437f-9433-298fd78a313e" returned: 0 in 0.375s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:44:22 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[478b320a-e4e6-429e-9431-412734e268d0]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:44:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5313fe78-e849-4844-866d-8f51f1f33fba tempest-GroupSnapshotsTest-367307629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-631542a4-639e-4acc-817c-8bd861773b19.e1bb28af-02de-4b29-bd55-5fb7c48fd47a {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:44:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3d3239ff-c754-4763-93b8-cd49af740ce3 tempest-VolumesSnapshotNegativeTestJSON-919717616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9d37b893-55e0-4c17-9f5e-157fb4d4322e.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:44:22 devstack sudo[99151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9d37b893-55e0-4c17-9f5e-157fb4d4322e.info Sep 18 21:44:22 devstack sudo[99151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:44:22 devstack sudo[99150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-631542a4-639e-4acc-817c-8bd861773b19.e1bb28af-02de-4b29-bd55-5fb7c48fd47a Sep 18 21:44:22 devstack sudo[99150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:44:23 devstack sudo[99151]: pam_unix(sudo:session): session closed for user root Sep 18 21:44:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3d3239ff-c754-4763-93b8-cd49af740ce3 tempest-VolumesSnapshotNegativeTestJSON-919717616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9d37b893-55e0-4c17-9f5e-157fb4d4322e.info" returned: 0 in 0.284s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:44:23 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-3d3239ff-c754-4763-93b8-cd49af740ce3 tempest-VolumesSnapshotNegativeTestJSON-919717616 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9d37b893-55e0-4c17-9f5e-157fb4d4322e.info is being set with open permissions: ugo+rw Sep 18 21:44:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3d3239ff-c754-4763-93b8-cd49af740ce3 tempest-VolumesSnapshotNegativeTestJSON-919717616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9d37b893-55e0-4c17-9f5e-157fb4d4322e.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:44:23 devstack sudo[99155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9d37b893-55e0-4c17-9f5e-157fb4d4322e.info Sep 18 21:44:23 devstack sudo[99155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:44:23 devstack sudo[99150]: pam_unix(sudo:session): session closed for user root Sep 18 21:44:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5313fe78-e849-4844-866d-8f51f1f33fba tempest-GroupSnapshotsTest-367307629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-631542a4-639e-4acc-817c-8bd861773b19.e1bb28af-02de-4b29-bd55-5fb7c48fd47a" returned: 0 in 0.417s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:44:23 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-5313fe78-e849-4844-866d-8f51f1f33fba tempest-GroupSnapshotsTest-367307629 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-631542a4-639e-4acc-817c-8bd861773b19(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86136) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 21:44:23 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[bebcd631-f3ef-45a3-a275-002c17c26d55]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:44:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5313fe78-e849-4844-866d-8f51f1f33fba tempest-GroupSnapshotsTest-367307629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-631542a4-639e-4acc-817c-8bd861773b19 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:44:23 devstack sudo[99160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-631542a4-639e-4acc-817c-8bd861773b19 Sep 18 21:44:23 devstack sudo[99160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:44:23 devstack sudo[99155]: pam_unix(sudo:session): session closed for user root Sep 18 21:44:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3d3239ff-c754-4763-93b8-cd49af740ce3 tempest-VolumesSnapshotNegativeTestJSON-919717616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9d37b893-55e0-4c17-9f5e-157fb4d4322e.info" returned: 0 in 0.272s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:44:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-3d3239ff-c754-4763-93b8-cd49af740ce3 tempest-VolumesSnapshotNegativeTestJSON-919717616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.453s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:44:23 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-3d3239ff-c754-4763-93b8-cd49af740ce3 tempest-VolumesSnapshotNegativeTestJSON-919717616 None] Create snapshot completed successfully Sep 18 21:44:23 devstack sudo[99160]: pam_unix(sudo:session): session closed for user root Sep 18 21:44:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5313fe78-e849-4844-866d-8f51f1f33fba tempest-GroupSnapshotsTest-367307629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-631542a4-639e-4acc-817c-8bd861773b19" returned: 0 in 0.538s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:44:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5313fe78-e849-4844-866d-8f51f1f33fba tempest-GroupSnapshotsTest-367307629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-631542a4-639e-4acc-817c-8bd861773b19.e1bb28af-02de-4b29-bd55-5fb7c48fd47a {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:44:23 devstack sudo[99166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-631542a4-639e-4acc-817c-8bd861773b19.e1bb28af-02de-4b29-bd55-5fb7c48fd47a Sep 18 21:44:23 devstack sudo[99166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:44:24 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-0cfc5efc-2fc8-46f6-bbf1-7e1b24cb086d tempest-VolumesSnapshotNegativeTestJSON-919717616 None] Acquiring lock "cinder-cebefb8c-ae49-437f-9433-298fd78a313e-delete_snapshot" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:44:24 devstack sudo[99166]: pam_unix(sudo:session): session closed for user root Sep 18 21:44:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5313fe78-e849-4844-866d-8f51f1f33fba tempest-GroupSnapshotsTest-367307629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-631542a4-639e-4acc-817c-8bd861773b19.e1bb28af-02de-4b29-bd55-5fb7c48fd47a" returned: 0 in 0.501s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:44:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5313fe78-e849-4844-866d-8f51f1f33fba tempest-GroupSnapshotsTest-367307629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-631542a4-639e-4acc-817c-8bd861773b19.e1bb28af-02de-4b29-bd55-5fb7c48fd47a {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:44:24 devstack sudo[99176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-631542a4-639e-4acc-817c-8bd861773b19.e1bb28af-02de-4b29-bd55-5fb7c48fd47a Sep 18 21:44:24 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-0cfc5efc-2fc8-46f6-bbf1-7e1b24cb086d tempest-VolumesSnapshotNegativeTestJSON-919717616 None] Lock "cinder-cebefb8c-ae49-437f-9433-298fd78a313e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:44:24 devstack sudo[99176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:44:24 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-0cfc5efc-2fc8-46f6-bbf1-7e1b24cb086d tempest-VolumesSnapshotNegativeTestJSON-919717616 None] Acquiring lock "cinder-quobyte-9d37b893-55e0-4c17-9f5e-157fb4d4322e" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:44:24 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-0cfc5efc-2fc8-46f6-bbf1-7e1b24cb086d tempest-VolumesSnapshotNegativeTestJSON-919717616 None] Lock "cinder-quobyte-9d37b893-55e0-4c17-9f5e-157fb4d4322e" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:44:24 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-0cfc5efc-2fc8-46f6-bbf1-7e1b24cb086d tempest-VolumesSnapshotNegativeTestJSON-919717616 None] Acquiring lock "cinder-quobyte-cebefb8c-ae49-437f-9433-298fd78a313e" by "_delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:44:24 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-0cfc5efc-2fc8-46f6-bbf1-7e1b24cb086d tempest-VolumesSnapshotNegativeTestJSON-919717616 None] Lock "cinder-quobyte-cebefb8c-ae49-437f-9433-298fd78a313e" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:44:24 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-0cfc5efc-2fc8-46f6-bbf1-7e1b24cb086d tempest-VolumesSnapshotNegativeTestJSON-919717616 None] Deleting offline snapshot cebefb8c-ae49-437f-9433-298fd78a313e of volume 9d37b893-55e0-4c17-9f5e-157fb4d4322e {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 21:44:24 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-0cfc5efc-2fc8-46f6-bbf1-7e1b24cb086d tempest-VolumesSnapshotNegativeTestJSON-919717616 None] snapshot_file for this snap is: volume-9d37b893-55e0-4c17-9f5e-157fb4d4322e.cebefb8c-ae49-437f-9433-298fd78a313e {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 21:44:24 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[3460a0b1-dcd4-4b3c-9fa9-0ca9516168f1]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:44:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0cfc5efc-2fc8-46f6-bbf1-7e1b24cb086d tempest-VolumesSnapshotNegativeTestJSON-919717616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9d37b893-55e0-4c17-9f5e-157fb4d4322e.cebefb8c-ae49-437f-9433-298fd78a313e {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:44:24 devstack sudo[99176]: pam_unix(sudo:session): session closed for user root Sep 18 21:44:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5313fe78-e849-4844-866d-8f51f1f33fba tempest-GroupSnapshotsTest-367307629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-631542a4-639e-4acc-817c-8bd861773b19.e1bb28af-02de-4b29-bd55-5fb7c48fd47a" returned: 0 in 0.304s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:44:24 devstack sudo[99178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9d37b893-55e0-4c17-9f5e-157fb4d4322e.cebefb8c-ae49-437f-9433-298fd78a313e Sep 18 21:44:24 devstack sudo[99178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:44:24 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-5313fe78-e849-4844-866d-8f51f1f33fba tempest-GroupSnapshotsTest-367307629 None] Lock "cinder-quobyte-e1bb28af-02de-4b29-bd55-5fb7c48fd47a" released by "_delete_snapshot" :: held 1.889s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:44:24 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-5313fe78-e849-4844-866d-8f51f1f33fba tempest-GroupSnapshotsTest-367307629 None] Lock "cinder-quobyte-631542a4-639e-4acc-817c-8bd861773b19" released by "delete_snapshot" :: held 1.916s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:44:24 devstack cinder-volume[86136]: WARNING cinder.quota [None req-5313fe78-e849-4844-866d-8f51f1f33fba tempest-GroupSnapshotsTest-367307629 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-585415108 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-585415108, it is now deprecated. Please use the default quota class for default quota. Sep 18 21:44:24 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-5313fe78-e849-4844-866d-8f51f1f33fba tempest-GroupSnapshotsTest-367307629 None] Created reservations ['fd8e6352-1e7f-4f9f-bbc9-d6a0aa1d0eaa', '2695b056-d110-4afe-af52-70d189703456', 'cba17d50-3154-4cdb-87d2-8ef114dbba79', '7392dd6d-7dfd-40ed-b042-b9a83594c509'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:44:24 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-5313fe78-e849-4844-866d-8f51f1f33fba tempest-GroupSnapshotsTest-367307629 None] group_snapshot d2edc7f5-7401-4715-82a2-14e4bd0bac20: deleted successfully Sep 18 21:44:24 devstack sudo[99178]: pam_unix(sudo:session): session closed for user root Sep 18 21:44:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0cfc5efc-2fc8-46f6-bbf1-7e1b24cb086d tempest-VolumesSnapshotNegativeTestJSON-919717616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9d37b893-55e0-4c17-9f5e-157fb4d4322e.cebefb8c-ae49-437f-9433-298fd78a313e" returned: 0 in 0.453s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:44:24 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-0cfc5efc-2fc8-46f6-bbf1-7e1b24cb086d tempest-VolumesSnapshotNegativeTestJSON-919717616 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d37b893-55e0-4c17-9f5e-157fb4d4322e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86136) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 21:44:24 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed4a986-3a15-4002-bd9d-25f1b44f80fe]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:44:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0cfc5efc-2fc8-46f6-bbf1-7e1b24cb086d tempest-VolumesSnapshotNegativeTestJSON-919717616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9d37b893-55e0-4c17-9f5e-157fb4d4322e {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:44:24 devstack sudo[99186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9d37b893-55e0-4c17-9f5e-157fb4d4322e Sep 18 21:44:24 devstack sudo[99186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:44:25 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-f16888e6-11bf-401f-ad13-383256641930 tempest-GroupSnapshotsTest-367307629 None] Acquiring lock "cinder-quobyte-631542a4-639e-4acc-817c-8bd861773b19" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:44:25 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-f16888e6-11bf-401f-ad13-383256641930 tempest-GroupSnapshotsTest-367307629 None] Lock "cinder-quobyte-631542a4-639e-4acc-817c-8bd861773b19" acquired by "delete_volume" :: waited 0.025s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:44:25 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[54fd835e-eeed-4c0c-a4b3-15e914284147]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:44:25 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f16888e6-11bf-401f-ad13-383256641930 tempest-GroupSnapshotsTest-367307629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-631542a4-639e-4acc-817c-8bd861773b19 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:44:25 devstack sudo[99186]: pam_unix(sudo:session): session closed for user root Sep 18 21:44:25 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0cfc5efc-2fc8-46f6-bbf1-7e1b24cb086d tempest-VolumesSnapshotNegativeTestJSON-919717616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9d37b893-55e0-4c17-9f5e-157fb4d4322e" returned: 0 in 0.517s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:44:25 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0cfc5efc-2fc8-46f6-bbf1-7e1b24cb086d tempest-VolumesSnapshotNegativeTestJSON-919717616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9d37b893-55e0-4c17-9f5e-157fb4d4322e.cebefb8c-ae49-437f-9433-298fd78a313e {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:44:25 devstack sudo[99197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9d37b893-55e0-4c17-9f5e-157fb4d4322e.cebefb8c-ae49-437f-9433-298fd78a313e Sep 18 21:44:25 devstack sudo[99197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:44:25 devstack sudo[99196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-631542a4-639e-4acc-817c-8bd861773b19 Sep 18 21:44:25 devstack sudo[99196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:44:25 devstack sudo[99197]: pam_unix(sudo:session): session closed for user root Sep 18 21:44:25 devstack sudo[99196]: pam_unix(sudo:session): session closed for user root Sep 18 21:44:25 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0cfc5efc-2fc8-46f6-bbf1-7e1b24cb086d tempest-VolumesSnapshotNegativeTestJSON-919717616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9d37b893-55e0-4c17-9f5e-157fb4d4322e.cebefb8c-ae49-437f-9433-298fd78a313e" returned: 0 in 0.458s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:44:25 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0cfc5efc-2fc8-46f6-bbf1-7e1b24cb086d tempest-VolumesSnapshotNegativeTestJSON-919717616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9d37b893-55e0-4c17-9f5e-157fb4d4322e.cebefb8c-ae49-437f-9433-298fd78a313e {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:44:25 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f16888e6-11bf-401f-ad13-383256641930 tempest-GroupSnapshotsTest-367307629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-631542a4-639e-4acc-817c-8bd861773b19" returned: 0 in 0.498s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:44:25 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f16888e6-11bf-401f-ad13-383256641930 tempest-GroupSnapshotsTest-367307629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-631542a4-639e-4acc-817c-8bd861773b19 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:44:25 devstack sudo[99214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9d37b893-55e0-4c17-9f5e-157fb4d4322e.cebefb8c-ae49-437f-9433-298fd78a313e Sep 18 21:44:25 devstack sudo[99214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:44:25 devstack sudo[99216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-631542a4-639e-4acc-817c-8bd861773b19 Sep 18 21:44:25 devstack sudo[99216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:44:25 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-4733a507-0237-45d6-b717-a506d1a97874 req-6be15d40-a4af-491c-bee7-b9d719311c2c tempest-TestInstancesWithCinderVolumes-34987593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:44:25 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-4733a507-0237-45d6-b717-a506d1a97874 req-6be15d40-a4af-491c-bee7-b9d719311c2c tempest-TestInstancesWithCinderVolumes-34987593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:44:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-4733a507-0237-45d6-b717-a506d1a97874 req-6be15d40-a4af-491c-bee7-b9d719311c2c tempest-TestInstancesWithCinderVolumes-34987593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:44:26 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [req-4733a507-0237-45d6-b717-a506d1a97874 req-6be15d40-a4af-491c-bee7-b9d719311c2c tempest-TestInstancesWithCinderVolumes-34987593 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff', 'name': 'volume-84a2b4c6-6677-4b37-9c7e-271b0d9c5aad', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd5515cb7-d140-4b63-a923-e946e1b1373a', 'enforce_multipath': True} {{(pid=86136) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 18 21:44:26 devstack cinder-volume[86136]: INFO cinder.volume.manager [req-4733a507-0237-45d6-b717-a506d1a97874 req-6be15d40-a4af-491c-bee7-b9d719311c2c tempest-TestInstancesWithCinderVolumes-34987593 None] attachment_update completed successfully. Sep 18 21:44:26 devstack sudo[99214]: pam_unix(sudo:session): session closed for user root Sep 18 21:44:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0cfc5efc-2fc8-46f6-bbf1-7e1b24cb086d tempest-VolumesSnapshotNegativeTestJSON-919717616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9d37b893-55e0-4c17-9f5e-157fb4d4322e.cebefb8c-ae49-437f-9433-298fd78a313e" returned: 0 in 0.301s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:44:26 devstack sudo[99216]: pam_unix(sudo:session): session closed for user root Sep 18 21:44:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f16888e6-11bf-401f-ad13-383256641930 tempest-GroupSnapshotsTest-367307629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-631542a4-639e-4acc-817c-8bd861773b19" returned: 0 in 0.343s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:44:26 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-0cfc5efc-2fc8-46f6-bbf1-7e1b24cb086d tempest-VolumesSnapshotNegativeTestJSON-919717616 None] Lock "cinder-quobyte-cebefb8c-ae49-437f-9433-298fd78a313e" released by "_delete_snapshot" :: held 1.922s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:44:26 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-f16888e6-11bf-401f-ad13-383256641930 tempest-GroupSnapshotsTest-367307629 None] Lock "cinder-quobyte-631542a4-639e-4acc-817c-8bd861773b19" released by "delete_volume" :: held 0.922s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:44:26 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-0cfc5efc-2fc8-46f6-bbf1-7e1b24cb086d tempest-VolumesSnapshotNegativeTestJSON-919717616 None] Lock "cinder-quobyte-9d37b893-55e0-4c17-9f5e-157fb4d4322e" released by "delete_snapshot" :: held 1.961s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:44:26 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-f16888e6-11bf-401f-ad13-383256641930 tempest-GroupSnapshotsTest-367307629 None] Created reservations ['c7c04492-dcaf-46a0-b896-62db5f4b6031'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:44:26 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-0cfc5efc-2fc8-46f6-bbf1-7e1b24cb086d tempest-VolumesSnapshotNegativeTestJSON-919717616 None] Created reservations ['fe81d442-e7fe-48fe-82ce-5df8b43d06fb', 'fd032f44-93f3-44ab-8e8d-fdca2b716c3e', 'd79dc712-31f0-4235-9e15-916811727d5f', 'cd224760-5f17-41e2-ada7-289351e45631'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:44:26 devstack cinder-volume[86136]: WARNING cinder.db.api [None req-f16888e6-11bf-401f-ad13-383256641930 tempest-GroupSnapshotsTest-367307629 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-585415108'] Sep 18 21:44:26 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-f16888e6-11bf-401f-ad13-383256641930 tempest-GroupSnapshotsTest-367307629 None] Created reservations ['90b8b9b8-eaa5-4c2c-8559-31ff0f590c3f', '9dbf274d-9244-47d9-9c69-1deea23fadf1', 'e0695395-6804-4b2f-9c06-6f39d1714831', 'cc79ebcd-9ee6-46f8-9dd2-5459c9661dd0'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:44:26 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-0cfc5efc-2fc8-46f6-bbf1-7e1b24cb086d tempest-VolumesSnapshotNegativeTestJSON-919717616 None] Delete snapshot completed successfully. Sep 18 21:44:26 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-0cfc5efc-2fc8-46f6-bbf1-7e1b24cb086d tempest-VolumesSnapshotNegativeTestJSON-919717616 None] Lock "cinder-cebefb8c-ae49-437f-9433-298fd78a313e-delete_snapshot" released by "delete_snapshot" :: held 2.236s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:44:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-f16888e6-11bf-401f-ad13-383256641930 tempest-GroupSnapshotsTest-367307629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:44:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-f16888e6-11bf-401f-ad13-383256641930 tempest-GroupSnapshotsTest-367307629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:44:26 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-f16888e6-11bf-401f-ad13-383256641930 tempest-GroupSnapshotsTest-367307629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:44:26 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-f16888e6-11bf-401f-ad13-383256641930 tempest-GroupSnapshotsTest-367307629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:44:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-f16888e6-11bf-401f-ad13-383256641930 tempest-GroupSnapshotsTest-367307629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:44:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f16888e6-11bf-401f-ad13-383256641930 tempest-GroupSnapshotsTest-367307629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:44:26 devstack sudo[99229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:44:26 devstack sudo[99229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:44:26 devstack sudo[99229]: pam_unix(sudo:session): session closed for user root Sep 18 21:44:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f16888e6-11bf-401f-ad13-383256641930 tempest-GroupSnapshotsTest-367307629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.321s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:44:26 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-f16888e6-11bf-401f-ad13-383256641930 tempest-GroupSnapshotsTest-367307629 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:44:26 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-f16888e6-11bf-401f-ad13-383256641930 tempest-GroupSnapshotsTest-367307629 None] Delete group completed successfully. Sep 18 21:44:27 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-27d0bbbe-751c-40c4-8767-19adc7c310a0 tempest-GroupSnapshotsTest-367307629 None] Group tempest-GroupSnapshotsTest-Group-1278513065: creating Sep 18 21:44:27 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-27d0bbbe-751c-40c4-8767-19adc7c310a0 tempest-GroupSnapshotsTest-367307629 None] Group tempest-GroupSnapshotsTest-Group-1278513065: created successfully Sep 18 21:44:27 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-27d0bbbe-751c-40c4-8767-19adc7c310a0 tempest-GroupSnapshotsTest-367307629 None] Create group completed successfully. Sep 18 21:44:27 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-25767338-b509-4f25-848a-b22528a32bb4 tempest-VolumesSnapshotNegativeTestJSON-919717616 None] Acquiring lock "cinder-9d37b893-55e0-4c17-9f5e-157fb4d4322e-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:44:27 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-25767338-b509-4f25-848a-b22528a32bb4 tempest-VolumesSnapshotNegativeTestJSON-919717616 None] Lock "cinder-9d37b893-55e0-4c17-9f5e-157fb4d4322e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:44:27 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-25767338-b509-4f25-848a-b22528a32bb4 tempest-VolumesSnapshotNegativeTestJSON-919717616 None] Acquiring lock "cinder-quobyte-9d37b893-55e0-4c17-9f5e-157fb4d4322e" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:44:27 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-25767338-b509-4f25-848a-b22528a32bb4 tempest-VolumesSnapshotNegativeTestJSON-919717616 None] Lock "cinder-quobyte-9d37b893-55e0-4c17-9f5e-157fb4d4322e" acquired by "delete_volume" :: waited 0.016s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:44:27 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[3898af41-204c-4c1b-8712-08b5fbd3af56]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:44:27 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-25767338-b509-4f25-848a-b22528a32bb4 tempest-VolumesSnapshotNegativeTestJSON-919717616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9d37b893-55e0-4c17-9f5e-157fb4d4322e {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:44:27 devstack sudo[99232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9d37b893-55e0-4c17-9f5e-157fb4d4322e Sep 18 21:44:27 devstack sudo[99232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:44:28 devstack sudo[99232]: pam_unix(sudo:session): session closed for user root Sep 18 21:44:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-25767338-b509-4f25-848a-b22528a32bb4 tempest-VolumesSnapshotNegativeTestJSON-919717616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9d37b893-55e0-4c17-9f5e-157fb4d4322e" returned: 0 in 0.441s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:44:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-25767338-b509-4f25-848a-b22528a32bb4 tempest-VolumesSnapshotNegativeTestJSON-919717616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9d37b893-55e0-4c17-9f5e-157fb4d4322e {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:44:28 devstack sudo[99239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9d37b893-55e0-4c17-9f5e-157fb4d4322e Sep 18 21:44:28 devstack sudo[99239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:44:28 devstack sudo[99239]: pam_unix(sudo:session): session closed for user root Sep 18 21:44:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-25767338-b509-4f25-848a-b22528a32bb4 tempest-VolumesSnapshotNegativeTestJSON-919717616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9d37b893-55e0-4c17-9f5e-157fb4d4322e" returned: 0 in 0.366s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:44:28 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-25767338-b509-4f25-848a-b22528a32bb4 tempest-VolumesSnapshotNegativeTestJSON-919717616 None] Lock "cinder-quobyte-9d37b893-55e0-4c17-9f5e-157fb4d4322e" released by "delete_volume" :: held 0.905s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:44:28 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-25767338-b509-4f25-848a-b22528a32bb4 tempest-VolumesSnapshotNegativeTestJSON-919717616 None] Created reservations ['fc8536d9-00f8-426e-903b-e193129cbea4', '61bd0c21-05eb-4875-9149-6875d05489cb', '28b0e651-38ff-449a-a518-69f3892b1aef', '1e95b97a-11f7-428a-906d-9e903ae02b19'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:44:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-25767338-b509-4f25-848a-b22528a32bb4 tempest-VolumesSnapshotNegativeTestJSON-919717616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:44:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-25767338-b509-4f25-848a-b22528a32bb4 tempest-VolumesSnapshotNegativeTestJSON-919717616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:44:28 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-25767338-b509-4f25-848a-b22528a32bb4 tempest-VolumesSnapshotNegativeTestJSON-919717616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:44:28 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-25767338-b509-4f25-848a-b22528a32bb4 tempest-VolumesSnapshotNegativeTestJSON-919717616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:44:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-25767338-b509-4f25-848a-b22528a32bb4 tempest-VolumesSnapshotNegativeTestJSON-919717616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:44:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-25767338-b509-4f25-848a-b22528a32bb4 tempest-VolumesSnapshotNegativeTestJSON-919717616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:44:28 devstack sudo[99249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:44:28 devstack sudo[99249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:44:29 devstack sudo[99249]: pam_unix(sudo:session): session closed for user root Sep 18 21:44:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-25767338-b509-4f25-848a-b22528a32bb4 tempest-VolumesSnapshotNegativeTestJSON-919717616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.400s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:44:29 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-25767338-b509-4f25-848a-b22528a32bb4 tempest-VolumesSnapshotNegativeTestJSON-919717616 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:44:29 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-25767338-b509-4f25-848a-b22528a32bb4 tempest-VolumesSnapshotNegativeTestJSON-919717616 None] Deleted volume successfully. Sep 18 21:44:29 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-25767338-b509-4f25-848a-b22528a32bb4 tempest-VolumesSnapshotNegativeTestJSON-919717616 None] Lock "cinder-9d37b893-55e0-4c17-9f5e-157fb4d4322e-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:44:29 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-19b3855d-fa73-448d-8a11-840bbd96bd2b tempest-GroupSnapshotsTest-367307629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:44:29 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-19b3855d-fa73-448d-8a11-840bbd96bd2b tempest-GroupSnapshotsTest-367307629 None] Flow 'volume_create_manager' (2e277855-6452-4547-a41c-887bf8052c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:44:29 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-19b3855d-fa73-448d-8a11-840bbd96bd2b tempest-GroupSnapshotsTest-367307629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d4074ea-be04-4618-b237-e2d7cde2bcbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:44:29 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-19b3855d-fa73-448d-8a11-840bbd96bd2b tempest-GroupSnapshotsTest-367307629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d4074ea-be04-4618-b237-e2d7cde2bcbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:44:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1839550412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dab9eb0d-9b96-4deb-9722-42470ea4b543,host='devstack@QuobyteHD#QuobyteHD',id=60c956da-cc89-4da1-8307-233990837948,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1623a52b317543e9922e23aab834e567',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:44:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:44:29Z,use_quota=True,user_id='3f44c15c704a42e5b18ee6f61ea8b5d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4b5744b1-cfe0-4716-a6a2-87101ec412ea),volume_type_id=4b5744b1-cfe0-4716-a6a2-87101ec412ea)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:44:29 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-19b3855d-fa73-448d-8a11-840bbd96bd2b tempest-GroupSnapshotsTest-367307629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1f0f17d-5b4e-4c37-8727-e6a0d1233f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:44:29 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-19b3855d-fa73-448d-8a11-840bbd96bd2b tempest-GroupSnapshotsTest-367307629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1f0f17d-5b4e-4c37-8727-e6a0d1233f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:44:29 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-19b3855d-fa73-448d-8a11-840bbd96bd2b tempest-GroupSnapshotsTest-367307629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4730bd0-2c0c-4e5e-9bc4-ad198570e7c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:44:29 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-19b3855d-fa73-448d-8a11-840bbd96bd2b tempest-GroupSnapshotsTest-367307629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4730bd0-2c0c-4e5e-9bc4-ad198570e7c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60c956da-cc89-4da1-8307-233990837948', 'volume_name': 'volume-60c956da-cc89-4da1-8307-233990837948', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:44:29 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-19b3855d-fa73-448d-8a11-840bbd96bd2b tempest-GroupSnapshotsTest-367307629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aac417a2-45ce-4e30-bae5-a7032037ee87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:44:29 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-19b3855d-fa73-448d-8a11-840bbd96bd2b tempest-GroupSnapshotsTest-367307629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aac417a2-45ce-4e30-bae5-a7032037ee87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:44:29 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-19b3855d-fa73-448d-8a11-840bbd96bd2b tempest-GroupSnapshotsTest-367307629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a8bc291-5e0e-4100-8d32-f2aa1c8b9878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:44:29 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-19b3855d-fa73-448d-8a11-840bbd96bd2b tempest-GroupSnapshotsTest-367307629 None] Volume 60c956da-cc89-4da1-8307-233990837948: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60c956da-cc89-4da1-8307-233990837948', 'volume_size': 1} Sep 18 21:44:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-19b3855d-fa73-448d-8a11-840bbd96bd2b tempest-GroupSnapshotsTest-367307629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:44:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-19b3855d-fa73-448d-8a11-840bbd96bd2b tempest-GroupSnapshotsTest-367307629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:44:29 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-19b3855d-fa73-448d-8a11-840bbd96bd2b tempest-GroupSnapshotsTest-367307629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=dab9eb0d-9b96-4deb-9722-42470ea4b543,created_at=2026-09-18T19:44:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1839550412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dab9eb0d-9b96-4deb-9722-42470ea4b543,host='devstack@QuobyteHD#QuobyteHD',id=60c956da-cc89-4da1-8307-233990837948,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1623a52b317543e9922e23aab834e567',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:44:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:44:29Z,use_quota=True,user_id='3f44c15c704a42e5b18ee6f61ea8b5d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4b5744b1-cfe0-4716-a6a2-87101ec412ea),volume_type_id=4b5744b1-cfe0-4716-a6a2-87101ec412ea)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:44:29 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-19b3855d-fa73-448d-8a11-840bbd96bd2b tempest-GroupSnapshotsTest-367307629 None] Creating volume 60c956da-cc89-4da1-8307-233990837948 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:44:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-19b3855d-fa73-448d-8a11-840bbd96bd2b tempest-GroupSnapshotsTest-367307629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:44:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-19b3855d-fa73-448d-8a11-840bbd96bd2b tempest-GroupSnapshotsTest-367307629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:44:29 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-19b3855d-fa73-448d-8a11-840bbd96bd2b tempest-GroupSnapshotsTest-367307629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:44:29 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-19b3855d-fa73-448d-8a11-840bbd96bd2b tempest-GroupSnapshotsTest-367307629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:44:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-19b3855d-fa73-448d-8a11-840bbd96bd2b tempest-GroupSnapshotsTest-367307629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:44:29 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-19b3855d-fa73-448d-8a11-840bbd96bd2b tempest-GroupSnapshotsTest-367307629 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:44:29 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-19b3855d-fa73-448d-8a11-840bbd96bd2b tempest-GroupSnapshotsTest-367307629 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:44:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-19b3855d-fa73-448d-8a11-840bbd96bd2b tempest-GroupSnapshotsTest-367307629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-60c956da-cc89-4da1-8307-233990837948 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:44:29 devstack sudo[99252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-60c956da-cc89-4da1-8307-233990837948 1073741824 Sep 18 21:44:29 devstack sudo[99252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:44:30 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-2abddb3c-3e8a-414c-ab4a-77e68543ea40 req-256d00bd-14e5-4a31-8fe8-39ae6bab4cec tempest-TestInstancesWithCinderVolumes-34987593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:44:30 devstack sudo[99252]: pam_unix(sudo:session): session closed for user root Sep 18 21:44:30 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-19b3855d-fa73-448d-8a11-840bbd96bd2b tempest-GroupSnapshotsTest-367307629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-60c956da-cc89-4da1-8307-233990837948 1073741824" returned: 0 in 0.610s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:44:30 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-19b3855d-fa73-448d-8a11-840bbd96bd2b tempest-GroupSnapshotsTest-367307629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-60c956da-cc89-4da1-8307-233990837948 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:44:30 devstack sudo[99267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-60c956da-cc89-4da1-8307-233990837948 Sep 18 21:44:30 devstack sudo[99267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:44:30 devstack sudo[99267]: pam_unix(sudo:session): session closed for user root Sep 18 21:44:30 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-19b3855d-fa73-448d-8a11-840bbd96bd2b tempest-GroupSnapshotsTest-367307629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-60c956da-cc89-4da1-8307-233990837948" returned: 0 in 0.350s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:44:30 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-19b3855d-fa73-448d-8a11-840bbd96bd2b tempest-GroupSnapshotsTest-367307629 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:44:30 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-19b3855d-fa73-448d-8a11-840bbd96bd2b tempest-GroupSnapshotsTest-367307629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:44:30 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-2abddb3c-3e8a-414c-ab4a-77e68543ea40 req-256d00bd-14e5-4a31-8fe8-39ae6bab4cec tempest-TestInstancesWithCinderVolumes-34987593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.422s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:44:30 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-19b3855d-fa73-448d-8a11-840bbd96bd2b tempest-GroupSnapshotsTest-367307629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a8bc291-5e0e-4100-8d32-f2aa1c8b9878) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60c956da-cc89-4da1-8307-233990837948', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:44:30 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-19b3855d-fa73-448d-8a11-840bbd96bd2b tempest-GroupSnapshotsTest-367307629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dc10a95-4408-4e74-9daa-264e0ec9f019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:44:30 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-2abddb3c-3e8a-414c-ab4a-77e68543ea40 req-256d00bd-14e5-4a31-8fe8-39ae6bab4cec tempest-TestInstancesWithCinderVolumes-34987593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:44:30 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-19b3855d-fa73-448d-8a11-840bbd96bd2b tempest-GroupSnapshotsTest-367307629 None] Volume volume-60c956da-cc89-4da1-8307-233990837948 (60c956da-cc89-4da1-8307-233990837948): created successfully Sep 18 21:44:30 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-19b3855d-fa73-448d-8a11-840bbd96bd2b tempest-GroupSnapshotsTest-367307629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dc10a95-4408-4e74-9daa-264e0ec9f019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:44:30 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-19b3855d-fa73-448d-8a11-840bbd96bd2b tempest-GroupSnapshotsTest-367307629 None] Flow 'volume_create_manager' (2e277855-6452-4547-a41c-887bf8052c5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:44:30 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-19b3855d-fa73-448d-8a11-840bbd96bd2b tempest-GroupSnapshotsTest-367307629 None] Created volume successfully. Sep 18 21:44:30 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [req-2abddb3c-3e8a-414c-ab4a-77e68543ea40 req-256d00bd-14e5-4a31-8fe8-39ae6bab4cec tempest-TestInstancesWithCinderVolumes-34987593 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff', 'name': 'volume-120b2523-d362-4bb1-a2b0-e0e3eea65b01', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '795a4f45-0a2d-4389-b8ab-9113a917e571', 'enforce_multipath': True} {{(pid=86136) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 18 21:44:30 devstack cinder-volume[86136]: INFO cinder.volume.manager [req-2abddb3c-3e8a-414c-ab4a-77e68543ea40 req-256d00bd-14e5-4a31-8fe8-39ae6bab4cec tempest-TestInstancesWithCinderVolumes-34987593 None] attachment_update completed successfully. Sep 18 21:44:32 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-256afa2d-72a6-4d58-bafb-c40124de1171 tempest-GroupSnapshotsTest-367307629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:44:32 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-256afa2d-72a6-4d58-bafb-c40124de1171 tempest-GroupSnapshotsTest-367307629 None] Flow 'volume_create_manager' (9ad1e19c-f8b2-4430-bd86-891dd315f84b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:44:32 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-256afa2d-72a6-4d58-bafb-c40124de1171 tempest-GroupSnapshotsTest-367307629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f24c0b18-81d6-4b3d-b4ee-faa91bf392ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:44:32 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-256afa2d-72a6-4d58-bafb-c40124de1171 tempest-GroupSnapshotsTest-367307629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f24c0b18-81d6-4b3d-b4ee-faa91bf392ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:44:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2086850571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dab9eb0d-9b96-4deb-9722-42470ea4b543,host='devstack@QuobyteHD#QuobyteHD',id=9f203882-6d29-4f07-bec4-0183c44eeb30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1623a52b317543e9922e23aab834e567',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:44:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:44:32Z,use_quota=True,user_id='3f44c15c704a42e5b18ee6f61ea8b5d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4b5744b1-cfe0-4716-a6a2-87101ec412ea),volume_type_id=4b5744b1-cfe0-4716-a6a2-87101ec412ea)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:44:32 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-256afa2d-72a6-4d58-bafb-c40124de1171 tempest-GroupSnapshotsTest-367307629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d44a589-756b-48df-89ad-c49b51d942b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:44:32 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-256afa2d-72a6-4d58-bafb-c40124de1171 tempest-GroupSnapshotsTest-367307629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d44a589-756b-48df-89ad-c49b51d942b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:44:32 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-256afa2d-72a6-4d58-bafb-c40124de1171 tempest-GroupSnapshotsTest-367307629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a0b1e21-cbe8-42f7-b9f5-2cb0ec5ad9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:44:32 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-256afa2d-72a6-4d58-bafb-c40124de1171 tempest-GroupSnapshotsTest-367307629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a0b1e21-cbe8-42f7-b9f5-2cb0ec5ad9ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f203882-6d29-4f07-bec4-0183c44eeb30', 'volume_name': 'volume-9f203882-6d29-4f07-bec4-0183c44eeb30', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:44:32 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-256afa2d-72a6-4d58-bafb-c40124de1171 tempest-GroupSnapshotsTest-367307629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b62f5b2-131f-4cf3-a4cf-0912e592fd76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:44:32 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-256afa2d-72a6-4d58-bafb-c40124de1171 tempest-GroupSnapshotsTest-367307629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b62f5b2-131f-4cf3-a4cf-0912e592fd76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:44:32 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-256afa2d-72a6-4d58-bafb-c40124de1171 tempest-GroupSnapshotsTest-367307629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fcf5ec3-5bb9-4e2d-a9f5-f4357d2c238d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:44:32 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-256afa2d-72a6-4d58-bafb-c40124de1171 tempest-GroupSnapshotsTest-367307629 None] Volume 9f203882-6d29-4f07-bec4-0183c44eeb30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f203882-6d29-4f07-bec4-0183c44eeb30', 'volume_size': 1} Sep 18 21:44:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-256afa2d-72a6-4d58-bafb-c40124de1171 tempest-GroupSnapshotsTest-367307629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:44:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-256afa2d-72a6-4d58-bafb-c40124de1171 tempest-GroupSnapshotsTest-367307629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:44:32 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-256afa2d-72a6-4d58-bafb-c40124de1171 tempest-GroupSnapshotsTest-367307629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=dab9eb0d-9b96-4deb-9722-42470ea4b543,created_at=2026-09-18T19:44:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2086850571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dab9eb0d-9b96-4deb-9722-42470ea4b543,host='devstack@QuobyteHD#QuobyteHD',id=9f203882-6d29-4f07-bec4-0183c44eeb30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1623a52b317543e9922e23aab834e567',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:44:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:44:32Z,use_quota=True,user_id='3f44c15c704a42e5b18ee6f61ea8b5d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4b5744b1-cfe0-4716-a6a2-87101ec412ea),volume_type_id=4b5744b1-cfe0-4716-a6a2-87101ec412ea)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:44:32 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-256afa2d-72a6-4d58-bafb-c40124de1171 tempest-GroupSnapshotsTest-367307629 None] Creating volume 9f203882-6d29-4f07-bec4-0183c44eeb30 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:44:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-256afa2d-72a6-4d58-bafb-c40124de1171 tempest-GroupSnapshotsTest-367307629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:44:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-256afa2d-72a6-4d58-bafb-c40124de1171 tempest-GroupSnapshotsTest-367307629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:44:32 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-256afa2d-72a6-4d58-bafb-c40124de1171 tempest-GroupSnapshotsTest-367307629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:44:32 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-256afa2d-72a6-4d58-bafb-c40124de1171 tempest-GroupSnapshotsTest-367307629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:44:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-256afa2d-72a6-4d58-bafb-c40124de1171 tempest-GroupSnapshotsTest-367307629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:44:32 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-256afa2d-72a6-4d58-bafb-c40124de1171 tempest-GroupSnapshotsTest-367307629 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:44:32 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-256afa2d-72a6-4d58-bafb-c40124de1171 tempest-GroupSnapshotsTest-367307629 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:44:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-256afa2d-72a6-4d58-bafb-c40124de1171 tempest-GroupSnapshotsTest-367307629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9f203882-6d29-4f07-bec4-0183c44eeb30 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:44:32 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd1900d7-6f0c-45be-bdda-1837bd5a3b08 tempest-TestImageHashVerification-1276655736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:44:32 devstack sudo[99278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9f203882-6d29-4f07-bec4-0183c44eeb30 1073741824 Sep 18 21:44:32 devstack sudo[99278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:44:32 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-dd1900d7-6f0c-45be-bdda-1837bd5a3b08 tempest-TestImageHashVerification-1276655736 None] Flow 'volume_create_manager' (c2279b5d-cee3-4c51-9c03-c1289c435a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:44:32 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-dd1900d7-6f0c-45be-bdda-1837bd5a3b08 tempest-TestImageHashVerification-1276655736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d934b2d9-14f8-42cd-880a-0bc69b6a9833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:44:32 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-dd1900d7-6f0c-45be-bdda-1837bd5a3b08 tempest-TestImageHashVerification-1276655736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d934b2d9-14f8-42cd-880a-0bc69b6a9833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:44:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-684222199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=106e4d64-dcd3-413e-9982-010a9e04bb81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c17a7d84324497194d166f372d9a1cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:44:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:44:33Z,use_quota=True,user_id='0a08ec6608cc4b7eaadab276f39fc14a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:44:32 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-dd1900d7-6f0c-45be-bdda-1837bd5a3b08 tempest-TestImageHashVerification-1276655736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f20a6d8-915b-4b87-9d73-d9857c0cdbb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:44:32 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-dd1900d7-6f0c-45be-bdda-1837bd5a3b08 tempest-TestImageHashVerification-1276655736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f20a6d8-915b-4b87-9d73-d9857c0cdbb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:44:32 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-dd1900d7-6f0c-45be-bdda-1837bd5a3b08 tempest-TestImageHashVerification-1276655736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f3ec556-c51c-43ae-ae98-ead2dc608d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:44:32 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-dd1900d7-6f0c-45be-bdda-1837bd5a3b08 tempest-TestImageHashVerification-1276655736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f3ec556-c51c-43ae-ae98-ead2dc608d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '106e4d64-dcd3-413e-9982-010a9e04bb81', 'volume_name': 'volume-106e4d64-dcd3-413e-9982-010a9e04bb81', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:44:32 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-dd1900d7-6f0c-45be-bdda-1837bd5a3b08 tempest-TestImageHashVerification-1276655736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b927a493-be24-451b-aca8-c2d5c5cc4f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:44:32 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-dd1900d7-6f0c-45be-bdda-1837bd5a3b08 tempest-TestImageHashVerification-1276655736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b927a493-be24-451b-aca8-c2d5c5cc4f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:44:32 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-dd1900d7-6f0c-45be-bdda-1837bd5a3b08 tempest-TestImageHashVerification-1276655736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1d206eb-74b9-46f3-b1bd-1195231840e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:44:32 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-dd1900d7-6f0c-45be-bdda-1837bd5a3b08 tempest-TestImageHashVerification-1276655736 None] Volume 106e4d64-dcd3-413e-9982-010a9e04bb81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-106e4d64-dcd3-413e-9982-010a9e04bb81', 'volume_size': 1} Sep 18 21:44:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-dd1900d7-6f0c-45be-bdda-1837bd5a3b08 tempest-TestImageHashVerification-1276655736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:44:33 devstack sudo[99278]: pam_unix(sudo:session): session closed for user root Sep 18 21:44:33 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-256afa2d-72a6-4d58-bafb-c40124de1171 tempest-GroupSnapshotsTest-367307629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9f203882-6d29-4f07-bec4-0183c44eeb30 1073741824" returned: 0 in 0.576s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:44:33 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-256afa2d-72a6-4d58-bafb-c40124de1171 tempest-GroupSnapshotsTest-367307629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9f203882-6d29-4f07-bec4-0183c44eeb30 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:44:33 devstack sudo[99288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9f203882-6d29-4f07-bec4-0183c44eeb30 Sep 18 21:44:33 devstack sudo[99288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:44:33 devstack sudo[99288]: pam_unix(sudo:session): session closed for user root Sep 18 21:44:33 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-256afa2d-72a6-4d58-bafb-c40124de1171 tempest-GroupSnapshotsTest-367307629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9f203882-6d29-4f07-bec4-0183c44eeb30" returned: 0 in 0.267s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:44:33 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-256afa2d-72a6-4d58-bafb-c40124de1171 tempest-GroupSnapshotsTest-367307629 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:44:33 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-256afa2d-72a6-4d58-bafb-c40124de1171 tempest-GroupSnapshotsTest-367307629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:44:33 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-dd1900d7-6f0c-45be-bdda-1837bd5a3b08 tempest-TestImageHashVerification-1276655736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.761s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:44:33 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-dd1900d7-6f0c-45be-bdda-1837bd5a3b08 tempest-TestImageHashVerification-1276655736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:44:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-684222199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=106e4d64-dcd3-413e-9982-010a9e04bb81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c17a7d84324497194d166f372d9a1cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:44:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:44:33Z,use_quota=True,user_id='0a08ec6608cc4b7eaadab276f39fc14a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:44:33 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-dd1900d7-6f0c-45be-bdda-1837bd5a3b08 tempest-TestImageHashVerification-1276655736 None] Creating volume 106e4d64-dcd3-413e-9982-010a9e04bb81 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:44:33 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-dd1900d7-6f0c-45be-bdda-1837bd5a3b08 tempest-TestImageHashVerification-1276655736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:44:33 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-dd1900d7-6f0c-45be-bdda-1837bd5a3b08 tempest-TestImageHashVerification-1276655736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:44:33 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-dd1900d7-6f0c-45be-bdda-1837bd5a3b08 tempest-TestImageHashVerification-1276655736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:44:33 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-dd1900d7-6f0c-45be-bdda-1837bd5a3b08 tempest-TestImageHashVerification-1276655736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:44:33 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-dd1900d7-6f0c-45be-bdda-1837bd5a3b08 tempest-TestImageHashVerification-1276655736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:44:33 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-dd1900d7-6f0c-45be-bdda-1837bd5a3b08 tempest-TestImageHashVerification-1276655736 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:44:33 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-dd1900d7-6f0c-45be-bdda-1837bd5a3b08 tempest-TestImageHashVerification-1276655736 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:44:33 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-dd1900d7-6f0c-45be-bdda-1837bd5a3b08 tempest-TestImageHashVerification-1276655736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-106e4d64-dcd3-413e-9982-010a9e04bb81 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:44:33 devstack sudo[99291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-106e4d64-dcd3-413e-9982-010a9e04bb81 1073741824 Sep 18 21:44:33 devstack sudo[99291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:44:33 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-256afa2d-72a6-4d58-bafb-c40124de1171 tempest-GroupSnapshotsTest-367307629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fcf5ec3-5bb9-4e2d-a9f5-f4357d2c238d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f203882-6d29-4f07-bec4-0183c44eeb30', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:44:33 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-256afa2d-72a6-4d58-bafb-c40124de1171 tempest-GroupSnapshotsTest-367307629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b929ac08-d024-479d-a533-1a36ea516313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:44:33 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-256afa2d-72a6-4d58-bafb-c40124de1171 tempest-GroupSnapshotsTest-367307629 None] Volume volume-9f203882-6d29-4f07-bec4-0183c44eeb30 (9f203882-6d29-4f07-bec4-0183c44eeb30): created successfully Sep 18 21:44:33 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-256afa2d-72a6-4d58-bafb-c40124de1171 tempest-GroupSnapshotsTest-367307629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b929ac08-d024-479d-a533-1a36ea516313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:44:33 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-256afa2d-72a6-4d58-bafb-c40124de1171 tempest-GroupSnapshotsTest-367307629 None] Flow 'volume_create_manager' (9ad1e19c-f8b2-4430-bd86-891dd315f84b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:44:33 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-256afa2d-72a6-4d58-bafb-c40124de1171 tempest-GroupSnapshotsTest-367307629 None] Created volume successfully. Sep 18 21:44:34 devstack sudo[99291]: pam_unix(sudo:session): session closed for user root Sep 18 21:44:34 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-dd1900d7-6f0c-45be-bdda-1837bd5a3b08 tempest-TestImageHashVerification-1276655736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-106e4d64-dcd3-413e-9982-010a9e04bb81 1073741824" returned: 0 in 0.551s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:44:34 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-dd1900d7-6f0c-45be-bdda-1837bd5a3b08 tempest-TestImageHashVerification-1276655736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-106e4d64-dcd3-413e-9982-010a9e04bb81 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:44:34 devstack sudo[99297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-106e4d64-dcd3-413e-9982-010a9e04bb81 Sep 18 21:44:34 devstack sudo[99297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:44:34 devstack sudo[99297]: pam_unix(sudo:session): session closed for user root Sep 18 21:44:34 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-dd1900d7-6f0c-45be-bdda-1837bd5a3b08 tempest-TestImageHashVerification-1276655736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-106e4d64-dcd3-413e-9982-010a9e04bb81" returned: 0 in 0.326s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:44:34 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-dd1900d7-6f0c-45be-bdda-1837bd5a3b08 tempest-TestImageHashVerification-1276655736 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:44:34 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-dd1900d7-6f0c-45be-bdda-1837bd5a3b08 tempest-TestImageHashVerification-1276655736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:44:34 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-dd1900d7-6f0c-45be-bdda-1837bd5a3b08 tempest-TestImageHashVerification-1276655736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1d206eb-74b9-46f3-b1bd-1195231840e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-106e4d64-dcd3-413e-9982-010a9e04bb81', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:44:34 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-dd1900d7-6f0c-45be-bdda-1837bd5a3b08 tempest-TestImageHashVerification-1276655736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83be0cb4-1ab3-4b1e-ac89-34ad7141fa60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:44:34 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-dd1900d7-6f0c-45be-bdda-1837bd5a3b08 tempest-TestImageHashVerification-1276655736 None] Volume volume-106e4d64-dcd3-413e-9982-010a9e04bb81 (106e4d64-dcd3-413e-9982-010a9e04bb81): created successfully Sep 18 21:44:34 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-dd1900d7-6f0c-45be-bdda-1837bd5a3b08 tempest-TestImageHashVerification-1276655736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83be0cb4-1ab3-4b1e-ac89-34ad7141fa60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:44:34 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-dd1900d7-6f0c-45be-bdda-1837bd5a3b08 tempest-TestImageHashVerification-1276655736 None] Flow 'volume_create_manager' (c2279b5d-cee3-4c51-9c03-c1289c435a1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:44:34 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-dd1900d7-6f0c-45be-bdda-1837bd5a3b08 tempest-TestImageHashVerification-1276655736 None] Created volume successfully. Sep 18 21:44:35 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-a4d28c98-131d-4fd4-bb99-faaf019c4769 tempest-GroupSnapshotsTest-367307629 None] Update group completed successfully. Sep 18 21:44:36 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-0cdc02e3-9a9a-4b1f-930c-53d732934510 tempest-GroupSnapshotsTest-367307629 None] Update group completed successfully. Sep 18 21:44:36 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-1323941b-abbe-480e-ae11-94a4466e8da2 tempest-TestImageHashVerification-1276655736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:44:36 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-1323941b-abbe-480e-ae11-94a4466e8da2 tempest-TestImageHashVerification-1276655736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:44:36 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b156d50-be2c-4b8c-bc59-85b190c04038]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:44:36 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1323941b-abbe-480e-ae11-94a4466e8da2 tempest-TestImageHashVerification-1276655736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-106e4d64-dcd3-413e-9982-010a9e04bb81 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:44:36 devstack sudo[99323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-106e4d64-dcd3-413e-9982-010a9e04bb81 Sep 18 21:44:36 devstack sudo[99323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:44:37 devstack cinder-volume[86136]: INFO cinder.volume.manager [req-f5c7f5ac-c569-4198-9004-53efce0d1189 req-07ba07b9-177a-4344-8675-99c74a9f4bd6 tempest-TestInstancesWithCinderVolumes-34987593 None] Terminate volume connection completed successfully. Sep 18 21:44:37 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [req-f5c7f5ac-c569-4198-9004-53efce0d1189 req-07ba07b9-177a-4344-8675-99c74a9f4bd6 tempest-TestInstancesWithCinderVolumes-34987593 None] Deleting attachment d5515cb7-d140-4b63-a923-e946e1b1373a. {{(pid=86136) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 18 21:44:37 devstack sudo[99323]: pam_unix(sudo:session): session closed for user root Sep 18 21:44:37 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1323941b-abbe-480e-ae11-94a4466e8da2 tempest-TestImageHashVerification-1276655736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-106e4d64-dcd3-413e-9982-010a9e04bb81" returned: 0 in 0.422s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:44:37 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0767e2f-8956-4820-bde1-39cfe0ebedd3]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:44:37 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1323941b-abbe-480e-ae11-94a4466e8da2 tempest-TestImageHashVerification-1276655736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-106e4d64-dcd3-413e-9982-010a9e04bb81 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:44:37 devstack sudo[99331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-106e4d64-dcd3-413e-9982-010a9e04bb81 Sep 18 21:44:37 devstack sudo[99331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:44:37 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-10db4986-1049-4c19-836d-c00b49e56269 tempest-GroupSnapshotsTest-367307629 None] Update group completed successfully. Sep 18 21:44:37 devstack sudo[99331]: pam_unix(sudo:session): session closed for user root Sep 18 21:44:37 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1323941b-abbe-480e-ae11-94a4466e8da2 tempest-TestImageHashVerification-1276655736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-106e4d64-dcd3-413e-9982-010a9e04bb81" returned: 0 in 0.494s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:44:37 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1323941b-abbe-480e-ae11-94a4466e8da2 tempest-TestImageHashVerification-1276655736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-106e4d64-dcd3-413e-9982-010a9e04bb81 /opt/stack/data/cinder/conversion/106e4d64-dcd3-413e-9982-010a9e04bb81.temp_image.95d29c75-dbd4-4077-b06b-9b9c8dba7f4cmubygzqa.img {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:44:37 devstack sudo[99337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-106e4d64-dcd3-413e-9982-010a9e04bb81 /opt/stack/data/cinder/conversion/106e4d64-dcd3-413e-9982-010a9e04bb81.temp_image.95d29c75-dbd4-4077-b06b-9b9c8dba7f4cmubygzqa.img Sep 18 21:44:37 devstack sudo[99337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:44:37 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-82f8c128-42f6-4ec8-8c2a-789bb8d59b4d tempest-TestInstancesWithCinderVolumes-34987593 None] Acquiring lock "cinder-84a2b4c6-6677-4b37-9c7e-271b0d9c5aad-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:44:37 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-82f8c128-42f6-4ec8-8c2a-789bb8d59b4d tempest-TestInstancesWithCinderVolumes-34987593 None] Lock "cinder-84a2b4c6-6677-4b37-9c7e-271b0d9c5aad-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:44:37 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-82f8c128-42f6-4ec8-8c2a-789bb8d59b4d tempest-TestInstancesWithCinderVolumes-34987593 None] Acquiring lock "cinder-quobyte-84a2b4c6-6677-4b37-9c7e-271b0d9c5aad" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:44:37 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-82f8c128-42f6-4ec8-8c2a-789bb8d59b4d tempest-TestInstancesWithCinderVolumes-34987593 None] Lock "cinder-quobyte-84a2b4c6-6677-4b37-9c7e-271b0d9c5aad" acquired by "delete_volume" :: waited 0.019s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:44:37 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[049d4c59-dbdb-4699-b629-7c524f973182]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:44:37 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-82f8c128-42f6-4ec8-8c2a-789bb8d59b4d tempest-TestInstancesWithCinderVolumes-34987593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-84a2b4c6-6677-4b37-9c7e-271b0d9c5aad {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:44:38 devstack sudo[99344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-84a2b4c6-6677-4b37-9c7e-271b0d9c5aad Sep 18 21:44:38 devstack sudo[99344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:44:38 devstack sudo[99344]: pam_unix(sudo:session): session closed for user root Sep 18 21:44:39 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-82f8c128-42f6-4ec8-8c2a-789bb8d59b4d tempest-TestInstancesWithCinderVolumes-34987593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-84a2b4c6-6677-4b37-9c7e-271b0d9c5aad" returned: 0 in 1.045s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:44:39 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-82f8c128-42f6-4ec8-8c2a-789bb8d59b4d tempest-TestInstancesWithCinderVolumes-34987593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-84a2b4c6-6677-4b37-9c7e-271b0d9c5aad {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:44:39 devstack sudo[99358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-84a2b4c6-6677-4b37-9c7e-271b0d9c5aad Sep 18 21:44:39 devstack sudo[99358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:44:39 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-4a3729b9-6353-4b67-bf02-609a0a56c5ae tempest-GroupSnapshotsTest-367307629 None] Update group completed successfully. Sep 18 21:44:39 devstack sudo[99358]: pam_unix(sudo:session): session closed for user root Sep 18 21:44:39 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-82f8c128-42f6-4ec8-8c2a-789bb8d59b4d tempest-TestInstancesWithCinderVolumes-34987593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-84a2b4c6-6677-4b37-9c7e-271b0d9c5aad" returned: 0 in 0.709s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:44:39 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-82f8c128-42f6-4ec8-8c2a-789bb8d59b4d tempest-TestInstancesWithCinderVolumes-34987593 None] Lock "cinder-quobyte-84a2b4c6-6677-4b37-9c7e-271b0d9c5aad" released by "delete_volume" :: held 1.836s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:44:39 devstack cinder-volume[86136]: WARNING cinder.quota [None req-82f8c128-42f6-4ec8-8c2a-789bb8d59b4d tempest-TestInstancesWithCinderVolumes-34987593 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-887701597-2079413764 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-887701597-2079413764, it is now deprecated. Please use the default quota class for default quota. Sep 18 21:44:39 devstack cinder-volume[86136]: WARNING cinder.quota [None req-82f8c128-42f6-4ec8-8c2a-789bb8d59b4d tempest-TestInstancesWithCinderVolumes-34987593 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-887701597-2079413764 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-887701597-2079413764, it is now deprecated. Please use the default quota class for default quota. Sep 18 21:44:39 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-82f8c128-42f6-4ec8-8c2a-789bb8d59b4d tempest-TestInstancesWithCinderVolumes-34987593 None] Created reservations ['02e14fce-0064-4c55-9ebf-2d2f04ee5a4f', 'd2e698d5-25fe-4c45-85b6-5b2e914f6bc3', 'dbfd2f57-5cc9-44b8-bd53-daf47d321299', '7f0aa11d-a0e2-4afe-8a43-6dac7da1c583'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:44:40 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-82f8c128-42f6-4ec8-8c2a-789bb8d59b4d tempest-TestInstancesWithCinderVolumes-34987593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:44:40 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-82f8c128-42f6-4ec8-8c2a-789bb8d59b4d tempest-TestInstancesWithCinderVolumes-34987593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:44:40 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-82f8c128-42f6-4ec8-8c2a-789bb8d59b4d tempest-TestInstancesWithCinderVolumes-34987593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:44:40 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-82f8c128-42f6-4ec8-8c2a-789bb8d59b4d tempest-TestInstancesWithCinderVolumes-34987593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:44:40 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-82f8c128-42f6-4ec8-8c2a-789bb8d59b4d tempest-TestInstancesWithCinderVolumes-34987593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:44:40 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-82f8c128-42f6-4ec8-8c2a-789bb8d59b4d tempest-TestInstancesWithCinderVolumes-34987593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:44:40 devstack sudo[99361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:44:40 devstack sudo[99361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:44:40 devstack sudo[99361]: pam_unix(sudo:session): session closed for user root Sep 18 21:44:40 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-82f8c128-42f6-4ec8-8c2a-789bb8d59b4d tempest-TestInstancesWithCinderVolumes-34987593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.522s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:44:40 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-82f8c128-42f6-4ec8-8c2a-789bb8d59b4d tempest-TestInstancesWithCinderVolumes-34987593 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:44:40 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-82f8c128-42f6-4ec8-8c2a-789bb8d59b4d tempest-TestInstancesWithCinderVolumes-34987593 None] Deleted volume successfully. Sep 18 21:44:40 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-82f8c128-42f6-4ec8-8c2a-789bb8d59b4d tempest-TestInstancesWithCinderVolumes-34987593 None] Lock "cinder-84a2b4c6-6677-4b37-9c7e-271b0d9c5aad-delete_volume" released by "delete_volume" :: held 2.901s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:44:41 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-543eeda6-349a-4987-9d1a-ca4cb30c9eda tempest-GroupSnapshotsTest-367307629 None] GroupSnapshot 1b918d4c-6a8b-4095-b6e7-64d63eb8bd68: creating. Sep 18 21:44:41 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-543eeda6-349a-4987-9d1a-ca4cb30c9eda tempest-GroupSnapshotsTest-367307629 None] Group snapshot 1b918d4c-6a8b-4095-b6e7-64d63eb8bd68: creating. {{(pid=86136) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 18 21:44:41 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-543eeda6-349a-4987-9d1a-ca4cb30c9eda tempest-GroupSnapshotsTest-367307629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:44:44 devstack cinder-volume[86136]: INFO cinder.volume.manager [req-e8cb32fb-edc0-40be-a133-7e3d1638c455 req-ea099027-16d8-48e0-b153-63d8a2fdcd25 tempest-TestInstancesWithCinderVolumes-34987593 None] Terminate volume connection completed successfully. Sep 18 21:44:44 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [req-e8cb32fb-edc0-40be-a133-7e3d1638c455 req-ea099027-16d8-48e0-b153-63d8a2fdcd25 tempest-TestInstancesWithCinderVolumes-34987593 None] Deleting attachment 795a4f45-0a2d-4389-b8ab-9113a917e571. {{(pid=86136) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 18 21:44:44 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d726b1b6-b108-45c7-a32b-b08ec27ed586 tempest-TestInstancesWithCinderVolumes-34987593 None] Acquiring lock "cinder-120b2523-d362-4bb1-a2b0-e0e3eea65b01-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:44:44 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d726b1b6-b108-45c7-a32b-b08ec27ed586 tempest-TestInstancesWithCinderVolumes-34987593 None] Lock "cinder-120b2523-d362-4bb1-a2b0-e0e3eea65b01-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:44:44 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d726b1b6-b108-45c7-a32b-b08ec27ed586 tempest-TestInstancesWithCinderVolumes-34987593 None] Acquiring lock "cinder-quobyte-120b2523-d362-4bb1-a2b0-e0e3eea65b01" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:44:44 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d726b1b6-b108-45c7-a32b-b08ec27ed586 tempest-TestInstancesWithCinderVolumes-34987593 None] Lock "cinder-quobyte-120b2523-d362-4bb1-a2b0-e0e3eea65b01" acquired by "delete_volume" :: waited 0.034s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:44:44 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[da069a0c-9401-4d04-b42d-109f78af1f6f]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:44:44 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d726b1b6-b108-45c7-a32b-b08ec27ed586 tempest-TestInstancesWithCinderVolumes-34987593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-120b2523-d362-4bb1-a2b0-e0e3eea65b01 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:44:45 devstack sudo[99389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-120b2523-d362-4bb1-a2b0-e0e3eea65b01 Sep 18 21:44:45 devstack sudo[99389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:44:45 devstack sudo[99389]: pam_unix(sudo:session): session closed for user root Sep 18 21:44:45 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d726b1b6-b108-45c7-a32b-b08ec27ed586 tempest-TestInstancesWithCinderVolumes-34987593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-120b2523-d362-4bb1-a2b0-e0e3eea65b01" returned: 0 in 0.760s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:44:45 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d726b1b6-b108-45c7-a32b-b08ec27ed586 tempest-TestInstancesWithCinderVolumes-34987593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-120b2523-d362-4bb1-a2b0-e0e3eea65b01 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:44:45 devstack sudo[99395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-120b2523-d362-4bb1-a2b0-e0e3eea65b01 Sep 18 21:44:45 devstack sudo[99395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:44:46 devstack sudo[99395]: pam_unix(sudo:session): session closed for user root Sep 18 21:44:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d726b1b6-b108-45c7-a32b-b08ec27ed586 tempest-TestInstancesWithCinderVolumes-34987593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-120b2523-d362-4bb1-a2b0-e0e3eea65b01" returned: 0 in 0.828s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:44:46 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d726b1b6-b108-45c7-a32b-b08ec27ed586 tempest-TestInstancesWithCinderVolumes-34987593 None] Lock "cinder-quobyte-120b2523-d362-4bb1-a2b0-e0e3eea65b01" released by "delete_volume" :: held 1.695s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:44:46 devstack cinder-volume[86136]: WARNING cinder.quota [None req-d726b1b6-b108-45c7-a32b-b08ec27ed586 tempest-TestInstancesWithCinderVolumes-34987593 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-80597502-1676799802 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-80597502-1676799802, it is now deprecated. Please use the default quota class for default quota. Sep 18 21:44:46 devstack cinder-volume[86136]: WARNING cinder.quota [None req-d726b1b6-b108-45c7-a32b-b08ec27ed586 tempest-TestInstancesWithCinderVolumes-34987593 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-80597502-1676799802 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-80597502-1676799802, it is now deprecated. Please use the default quota class for default quota. Sep 18 21:44:46 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-d726b1b6-b108-45c7-a32b-b08ec27ed586 tempest-TestInstancesWithCinderVolumes-34987593 None] Created reservations ['ce143426-a983-452a-bace-f00b6e6b99a6', 'f36fd2ec-717d-48ab-9a08-98c2ac2de7de', '756ed5e5-bfd1-4a76-a338-ea4c2ba2bcf6', '56781197-6bf0-4bb3-8b52-9dfbb144b68d'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:44:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-d726b1b6-b108-45c7-a32b-b08ec27ed586 tempest-TestInstancesWithCinderVolumes-34987593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:44:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-d726b1b6-b108-45c7-a32b-b08ec27ed586 tempest-TestInstancesWithCinderVolumes-34987593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:44:46 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-d726b1b6-b108-45c7-a32b-b08ec27ed586 tempest-TestInstancesWithCinderVolumes-34987593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:44:46 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-d726b1b6-b108-45c7-a32b-b08ec27ed586 tempest-TestInstancesWithCinderVolumes-34987593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:44:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-d726b1b6-b108-45c7-a32b-b08ec27ed586 tempest-TestInstancesWithCinderVolumes-34987593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:44:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d726b1b6-b108-45c7-a32b-b08ec27ed586 tempest-TestInstancesWithCinderVolumes-34987593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:44:46 devstack sudo[99399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:44:46 devstack sudo[99399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:44:47 devstack sudo[99337]: pam_unix(sudo:session): session closed for user root Sep 18 21:44:47 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1323941b-abbe-480e-ae11-94a4466e8da2 tempest-TestImageHashVerification-1276655736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-106e4d64-dcd3-413e-9982-010a9e04bb81 /opt/stack/data/cinder/conversion/106e4d64-dcd3-413e-9982-010a9e04bb81.temp_image.95d29c75-dbd4-4077-b06b-9b9c8dba7f4cmubygzqa.img" returned: 0 in 9.349s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:44:47 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[07480b45-2802-4fad-aabe-7549356487f6]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:44:47 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1323941b-abbe-480e-ae11-94a4466e8da2 tempest-TestImageHashVerification-1276655736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-106e4d64-dcd3-413e-9982-010a9e04bb81 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:44:47 devstack sudo[99401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-106e4d64-dcd3-413e-9982-010a9e04bb81 Sep 18 21:44:47 devstack sudo[99401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:44:47 devstack sudo[99399]: pam_unix(sudo:session): session closed for user root Sep 18 21:44:47 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d726b1b6-b108-45c7-a32b-b08ec27ed586 tempest-TestInstancesWithCinderVolumes-34987593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.406s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:44:47 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-d726b1b6-b108-45c7-a32b-b08ec27ed586 tempest-TestInstancesWithCinderVolumes-34987593 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:44:47 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-d726b1b6-b108-45c7-a32b-b08ec27ed586 tempest-TestInstancesWithCinderVolumes-34987593 None] Deleted volume successfully. Sep 18 21:44:47 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d726b1b6-b108-45c7-a32b-b08ec27ed586 tempest-TestInstancesWithCinderVolumes-34987593 None] Lock "cinder-120b2523-d362-4bb1-a2b0-e0e3eea65b01-delete_volume" released by "delete_volume" :: held 2.529s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:44:47 devstack sudo[99401]: pam_unix(sudo:session): session closed for user root Sep 18 21:44:47 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1323941b-abbe-480e-ae11-94a4466e8da2 tempest-TestImageHashVerification-1276655736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-106e4d64-dcd3-413e-9982-010a9e04bb81" returned: 0 in 0.703s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:44:47 devstack cinder-volume[86136]: DEBUG cinder.image.image_utils [None req-1323941b-abbe-480e-ae11-94a4466e8da2 tempest-TestImageHashVerification-1276655736 None] Image conversion details: src /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-106e4d64-dcd3-413e-9982-010a9e04bb81, size 1024.00 MB, duration 9.35 sec, destination /opt/stack/data/cinder/conversion/106e4d64-dcd3-413e-9982-010a9e04bb81.temp_image.95d29c75-dbd4-4077-b06b-9b9c8dba7f4cmubygzqa.img {{(pid=86136) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 18 21:44:47 devstack cinder-volume[86136]: INFO cinder.image.image_utils [None req-1323941b-abbe-480e-ae11-94a4466e8da2 tempest-TestImageHashVerification-1276655736 None] Converted 1024.00 MB image at 109.51 MB/s Sep 18 21:44:47 devstack cinder-volume[86136]: DEBUG cinder.image.image_utils [None req-1323941b-abbe-480e-ae11-94a4466e8da2 tempest-TestImageHashVerification-1276655736 None] 95d29c75-dbd4-4077-b06b-9b9c8dba7f4c was raw, no need to convert to raw {{(pid=86136) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 18 21:44:50 devstack cinder-volume[86136]: DEBUG dbcounter [-] [86136] Writing DB stats cinder:UPDATE=96,cinder:SELECT=107,cinder:INSERT=20,cinder:DELETE=5 {{(pid=86136) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 21:44:50 devstack cinder-volume[86136]: DEBUG dbcounter [-] [86136] Writing DB stats cinder:SELECT=102,cinder:UPDATE=94,cinder:INSERT=22,cinder:DELETE=5 {{(pid=86136) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 21:44:50 devstack cinder-volume[86136]: INFO cinder.volume.manager [req-fc5e2622-bcee-4095-8b85-1f071b926c37 req-f488598d-f82d-4484-8b2e-c4086a849137 tempest-TestInstancesWithCinderVolumes-34987593 None] Terminate volume connection completed successfully. Sep 18 21:44:50 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [req-fc5e2622-bcee-4095-8b85-1f071b926c37 req-f488598d-f82d-4484-8b2e-c4086a849137 tempest-TestInstancesWithCinderVolumes-34987593 None] Deleting attachment ba01447e-b813-4e10-b793-5d1d8b9cfd4d. {{(pid=86136) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 18 21:44:52 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-73e8ba33-194c-4a8d-b758-29bc05ad5b84 tempest-TestInstancesWithCinderVolumes-34987593 None] Acquiring lock "cinder-49dfec77-2112-4d6b-8f22-0406b3ffa3d2-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:44:52 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-73e8ba33-194c-4a8d-b758-29bc05ad5b84 tempest-TestInstancesWithCinderVolumes-34987593 None] Lock "cinder-49dfec77-2112-4d6b-8f22-0406b3ffa3d2-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:44:52 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-73e8ba33-194c-4a8d-b758-29bc05ad5b84 tempest-TestInstancesWithCinderVolumes-34987593 None] Acquiring lock "cinder-quobyte-49dfec77-2112-4d6b-8f22-0406b3ffa3d2" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:44:52 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-73e8ba33-194c-4a8d-b758-29bc05ad5b84 tempest-TestInstancesWithCinderVolumes-34987593 None] Lock "cinder-quobyte-49dfec77-2112-4d6b-8f22-0406b3ffa3d2" acquired by "delete_volume" :: waited 0.031s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:44:52 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[9898ca9e-0bc6-4711-bfd4-168e320c1ab5]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:44:52 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-73e8ba33-194c-4a8d-b758-29bc05ad5b84 tempest-TestInstancesWithCinderVolumes-34987593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-49dfec77-2112-4d6b-8f22-0406b3ffa3d2 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:44:52 devstack sudo[99436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-49dfec77-2112-4d6b-8f22-0406b3ffa3d2 Sep 18 21:44:52 devstack sudo[99436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:44:52 devstack sudo[99436]: pam_unix(sudo:session): session closed for user root Sep 18 21:44:52 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-73e8ba33-194c-4a8d-b758-29bc05ad5b84 tempest-TestInstancesWithCinderVolumes-34987593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-49dfec77-2112-4d6b-8f22-0406b3ffa3d2" returned: 0 in 0.455s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:44:52 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-73e8ba33-194c-4a8d-b758-29bc05ad5b84 tempest-TestInstancesWithCinderVolumes-34987593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-49dfec77-2112-4d6b-8f22-0406b3ffa3d2 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:44:52 devstack sudo[99441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-49dfec77-2112-4d6b-8f22-0406b3ffa3d2 Sep 18 21:44:52 devstack sudo[99441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:44:53 devstack sudo[99441]: pam_unix(sudo:session): session closed for user root Sep 18 21:44:53 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-73e8ba33-194c-4a8d-b758-29bc05ad5b84 tempest-TestInstancesWithCinderVolumes-34987593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-49dfec77-2112-4d6b-8f22-0406b3ffa3d2" returned: 0 in 0.323s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:44:53 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-73e8ba33-194c-4a8d-b758-29bc05ad5b84 tempest-TestInstancesWithCinderVolumes-34987593 None] Lock "cinder-quobyte-49dfec77-2112-4d6b-8f22-0406b3ffa3d2" released by "delete_volume" :: held 0.882s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:44:53 devstack cinder-volume[86136]: WARNING cinder.quota [None req-73e8ba33-194c-4a8d-b758-29bc05ad5b84 tempest-TestInstancesWithCinderVolumes-34987593 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1471908186-1067497670 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1471908186-1067497670, it is now deprecated. Please use the default quota class for default quota. Sep 18 21:44:53 devstack cinder-volume[86136]: WARNING cinder.quota [None req-73e8ba33-194c-4a8d-b758-29bc05ad5b84 tempest-TestInstancesWithCinderVolumes-34987593 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1471908186-1067497670 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1471908186-1067497670, it is now deprecated. Please use the default quota class for default quota. Sep 18 21:44:53 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-73e8ba33-194c-4a8d-b758-29bc05ad5b84 tempest-TestInstancesWithCinderVolumes-34987593 None] Created reservations ['176e0aff-99dc-4ba3-a89c-6a5998c87adc', '43017e71-4700-4b5d-9c08-a767b4265c54', '37c9caa4-10fe-46a9-a206-076a5929a9de', 'c2d6c65f-f5ed-4660-8132-8b795386655e'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:44:53 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-73e8ba33-194c-4a8d-b758-29bc05ad5b84 tempest-TestInstancesWithCinderVolumes-34987593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:44:53 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-73e8ba33-194c-4a8d-b758-29bc05ad5b84 tempest-TestInstancesWithCinderVolumes-34987593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:44:53 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-73e8ba33-194c-4a8d-b758-29bc05ad5b84 tempest-TestInstancesWithCinderVolumes-34987593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:44:53 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-73e8ba33-194c-4a8d-b758-29bc05ad5b84 tempest-TestInstancesWithCinderVolumes-34987593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:44:53 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-73e8ba33-194c-4a8d-b758-29bc05ad5b84 tempest-TestInstancesWithCinderVolumes-34987593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:44:53 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-73e8ba33-194c-4a8d-b758-29bc05ad5b84 tempest-TestInstancesWithCinderVolumes-34987593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:44:53 devstack sudo[99444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:44:53 devstack sudo[99444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:44:53 devstack sudo[99444]: pam_unix(sudo:session): session closed for user root Sep 18 21:44:53 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-73e8ba33-194c-4a8d-b758-29bc05ad5b84 tempest-TestInstancesWithCinderVolumes-34987593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.326s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:44:53 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-73e8ba33-194c-4a8d-b758-29bc05ad5b84 tempest-TestInstancesWithCinderVolumes-34987593 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:44:53 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-73e8ba33-194c-4a8d-b758-29bc05ad5b84 tempest-TestInstancesWithCinderVolumes-34987593 None] Deleted volume successfully. Sep 18 21:44:53 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-73e8ba33-194c-4a8d-b758-29bc05ad5b84 tempest-TestInstancesWithCinderVolumes-34987593 None] Lock "cinder-49dfec77-2112-4d6b-8f22-0406b3ffa3d2-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:45:03 devstack cinder-volume[86136]: DEBUG dbcounter [-] [86136] Writing DB stats cinder:SELECT=4,cinder:INSERT=2,cinder:UPDATE=10 {{(pid=86136) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 21:45:03 devstack cinder-volume[86136]: DEBUG dbcounter [-] [86136] Writing DB stats cinder:UPDATE=6,cinder:SELECT=6,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86136) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 21:45:05 devstack cinder-volume[86136]: DEBUG oslo_service.periodic_task [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86136) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 21:45:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:45:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:45:05 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:45:05 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:45:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:45:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:45:05 devstack sudo[99456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:45:05 devstack sudo[99456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:45:05 devstack sudo[99456]: pam_unix(sudo:session): session closed for user root Sep 18 21:45:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.345s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:45:05 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:45:05 devstack cinder-volume[86136]: DEBUG oslo_service.periodic_task [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Running periodic task VolumeManager._thread_info {{(pid=86136) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 21:45:05 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] thread count: 28 {{(pid=86136) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 18 21:45:05 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] thread info: [<_MainThread(MainThread, started 138548347871360)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86136) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 18 21:45:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-1323941b-abbe-480e-ae11-94a4466e8da2 tempest-TestImageHashVerification-1276655736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 38.570s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:45:15 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-1323941b-abbe-480e-ae11-94a4466e8da2 tempest-TestImageHashVerification-1276655736 None] Uploaded volume to glance image-id: 95d29c75-dbd4-4077-b06b-9b9c8dba7f4c. {{(pid=86136) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 18 21:45:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-543eeda6-349a-4987-9d1a-ca4cb30c9eda tempest-GroupSnapshotsTest-367307629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 33.850s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:45:15 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-543eeda6-349a-4987-9d1a-ca4cb30c9eda tempest-GroupSnapshotsTest-367307629 None] Creating offline snapshot 0d88226f-0b6c-4671-af82-be02f52e0ca7 of volume 9f203882-6d29-4f07-bec4-0183c44eeb30 {{(pid=86136) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 21:45:15 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-1323941b-abbe-480e-ae11-94a4466e8da2 tempest-TestImageHashVerification-1276655736 None] Copy volume to image completed successfully. Sep 18 21:45:15 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[a45bab4a-2f8d-4a22-9150-86e9c3757778]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:45:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-543eeda6-349a-4987-9d1a-ca4cb30c9eda tempest-GroupSnapshotsTest-367307629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9f203882-6d29-4f07-bec4-0183c44eeb30 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:45:15 devstack sudo[99560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9f203882-6d29-4f07-bec4-0183c44eeb30 Sep 18 21:45:15 devstack sudo[99560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:45:15 devstack sudo[99560]: pam_unix(sudo:session): session closed for user root Sep 18 21:45:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-543eeda6-349a-4987-9d1a-ca4cb30c9eda tempest-GroupSnapshotsTest-367307629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9f203882-6d29-4f07-bec4-0183c44eeb30" returned: 0 in 0.506s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:45:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-543eeda6-349a-4987-9d1a-ca4cb30c9eda tempest-GroupSnapshotsTest-367307629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9f203882-6d29-4f07-bec4-0183c44eeb30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9f203882-6d29-4f07-bec4-0183c44eeb30.0d88226f-0b6c-4671-af82-be02f52e0ca7 1G {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:45:15 devstack sudo[99568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9f203882-6d29-4f07-bec4-0183c44eeb30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9f203882-6d29-4f07-bec4-0183c44eeb30.0d88226f-0b6c-4671-af82-be02f52e0ca7 1G Sep 18 21:45:15 devstack sudo[99568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:45:16 devstack sudo[99568]: pam_unix(sudo:session): session closed for user root Sep 18 21:45:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-543eeda6-349a-4987-9d1a-ca4cb30c9eda tempest-GroupSnapshotsTest-367307629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9f203882-6d29-4f07-bec4-0183c44eeb30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9f203882-6d29-4f07-bec4-0183c44eeb30.0d88226f-0b6c-4671-af82-be02f52e0ca7 1G" returned: 0 in 0.747s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:45:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-543eeda6-349a-4987-9d1a-ca4cb30c9eda tempest-GroupSnapshotsTest-367307629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f203882-6d29-4f07-bec4-0183c44eeb30 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9f203882-6d29-4f07-bec4-0183c44eeb30.0d88226f-0b6c-4671-af82-be02f52e0ca7 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:45:16 devstack sudo[99574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f203882-6d29-4f07-bec4-0183c44eeb30 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9f203882-6d29-4f07-bec4-0183c44eeb30.0d88226f-0b6c-4671-af82-be02f52e0ca7 Sep 18 21:45:16 devstack sudo[99574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:45:16 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-8f60ad1d-1d58-48a8-a996-20f015f400fa tempest-TestImageHashVerification-1276655736 None] Acquiring lock "cinder-106e4d64-dcd3-413e-9982-010a9e04bb81-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:45:17 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-8f60ad1d-1d58-48a8-a996-20f015f400fa tempest-TestImageHashVerification-1276655736 None] Lock "cinder-106e4d64-dcd3-413e-9982-010a9e04bb81-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:45:17 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-8f60ad1d-1d58-48a8-a996-20f015f400fa tempest-TestImageHashVerification-1276655736 None] Acquiring lock "cinder-quobyte-106e4d64-dcd3-413e-9982-010a9e04bb81" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:45:17 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-8f60ad1d-1d58-48a8-a996-20f015f400fa tempest-TestImageHashVerification-1276655736 None] Lock "cinder-quobyte-106e4d64-dcd3-413e-9982-010a9e04bb81" acquired by "delete_volume" :: waited 0.021s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:45:17 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[f88c5147-9350-41e9-99c3-0cf4664f08aa]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:45:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-8f60ad1d-1d58-48a8-a996-20f015f400fa tempest-TestImageHashVerification-1276655736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-106e4d64-dcd3-413e-9982-010a9e04bb81 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:45:17 devstack sudo[99574]: pam_unix(sudo:session): session closed for user root Sep 18 21:45:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-543eeda6-349a-4987-9d1a-ca4cb30c9eda tempest-GroupSnapshotsTest-367307629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f203882-6d29-4f07-bec4-0183c44eeb30 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9f203882-6d29-4f07-bec4-0183c44eeb30.0d88226f-0b6c-4671-af82-be02f52e0ca7" returned: 0 in 0.652s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:45:17 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-543eeda6-349a-4987-9d1a-ca4cb30c9eda tempest-GroupSnapshotsTest-367307629 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9f203882-6d29-4f07-bec4-0183c44eeb30.0d88226f-0b6c-4671-af82-be02f52e0ca7 is being set with open permissions: ugo+rw: NotImplementedError Sep 18 21:45:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-543eeda6-349a-4987-9d1a-ca4cb30c9eda tempest-GroupSnapshotsTest-367307629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9f203882-6d29-4f07-bec4-0183c44eeb30.0d88226f-0b6c-4671-af82-be02f52e0ca7 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:45:17 devstack sudo[99580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9f203882-6d29-4f07-bec4-0183c44eeb30.0d88226f-0b6c-4671-af82-be02f52e0ca7 Sep 18 21:45:17 devstack sudo[99580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:45:17 devstack sudo[99579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-106e4d64-dcd3-413e-9982-010a9e04bb81 Sep 18 21:45:17 devstack sudo[99579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:45:17 devstack sudo[99579]: pam_unix(sudo:session): session closed for user root Sep 18 21:45:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-8f60ad1d-1d58-48a8-a996-20f015f400fa tempest-TestImageHashVerification-1276655736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-106e4d64-dcd3-413e-9982-010a9e04bb81" returned: 0 in 0.570s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:45:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-8f60ad1d-1d58-48a8-a996-20f015f400fa tempest-TestImageHashVerification-1276655736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-106e4d64-dcd3-413e-9982-010a9e04bb81 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:45:17 devstack sudo[99587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-106e4d64-dcd3-413e-9982-010a9e04bb81 Sep 18 21:45:17 devstack sudo[99587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:45:17 devstack sudo[99580]: pam_unix(sudo:session): session closed for user root Sep 18 21:45:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-543eeda6-349a-4987-9d1a-ca4cb30c9eda tempest-GroupSnapshotsTest-367307629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9f203882-6d29-4f07-bec4-0183c44eeb30.0d88226f-0b6c-4671-af82-be02f52e0ca7" returned: 0 in 0.525s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:45:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-543eeda6-349a-4987-9d1a-ca4cb30c9eda tempest-GroupSnapshotsTest-367307629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9f203882-6d29-4f07-bec4-0183c44eeb30.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:45:17 devstack sudo[99589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9f203882-6d29-4f07-bec4-0183c44eeb30.info Sep 18 21:45:17 devstack sudo[99589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:45:18 devstack sudo[99589]: pam_unix(sudo:session): session closed for user root Sep 18 21:45:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-543eeda6-349a-4987-9d1a-ca4cb30c9eda tempest-GroupSnapshotsTest-367307629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9f203882-6d29-4f07-bec4-0183c44eeb30.info" returned: 0 in 0.458s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:45:18 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-543eeda6-349a-4987-9d1a-ca4cb30c9eda tempest-GroupSnapshotsTest-367307629 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9f203882-6d29-4f07-bec4-0183c44eeb30.info is being set with open permissions: ugo+rw: NotImplementedError Sep 18 21:45:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-543eeda6-349a-4987-9d1a-ca4cb30c9eda tempest-GroupSnapshotsTest-367307629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9f203882-6d29-4f07-bec4-0183c44eeb30.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:45:18 devstack sudo[99593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9f203882-6d29-4f07-bec4-0183c44eeb30.info Sep 18 21:45:18 devstack sudo[99593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:45:18 devstack sudo[99587]: pam_unix(sudo:session): session closed for user root Sep 18 21:45:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-8f60ad1d-1d58-48a8-a996-20f015f400fa tempest-TestImageHashVerification-1276655736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-106e4d64-dcd3-413e-9982-010a9e04bb81" returned: 0 in 0.721s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:45:18 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-8f60ad1d-1d58-48a8-a996-20f015f400fa tempest-TestImageHashVerification-1276655736 None] Lock "cinder-quobyte-106e4d64-dcd3-413e-9982-010a9e04bb81" released by "delete_volume" :: held 1.390s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:45:18 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-8f60ad1d-1d58-48a8-a996-20f015f400fa tempest-TestImageHashVerification-1276655736 None] Created reservations ['7e7798ef-8bb7-4252-a6f2-b265cde4ddc3', 'c73a6f24-1eec-40d2-b0f5-61105503325a', 'b32f6202-a4ab-40cb-bb40-019a7cfc277b', '4ba3bc11-dd55-4410-a551-081fa9edc5c3'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:45:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-8f60ad1d-1d58-48a8-a996-20f015f400fa tempest-TestImageHashVerification-1276655736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:45:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-8f60ad1d-1d58-48a8-a996-20f015f400fa tempest-TestImageHashVerification-1276655736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:45:18 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-8f60ad1d-1d58-48a8-a996-20f015f400fa tempest-TestImageHashVerification-1276655736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:45:18 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-8f60ad1d-1d58-48a8-a996-20f015f400fa tempest-TestImageHashVerification-1276655736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:45:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-8f60ad1d-1d58-48a8-a996-20f015f400fa tempest-TestImageHashVerification-1276655736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:45:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-8f60ad1d-1d58-48a8-a996-20f015f400fa tempest-TestImageHashVerification-1276655736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:45:18 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b27e9da-20d1-4952-a5fc-80c30942bc3f tempest-TestMinimumBasicScenario-579410959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:45:18 devstack sudo[99595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:45:18 devstack sudo[99595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:45:18 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6b27e9da-20d1-4952-a5fc-80c30942bc3f tempest-TestMinimumBasicScenario-579410959 None] Flow 'volume_create_manager' (03a8d497-ac1b-4c11-8b0d-ad3ab809587b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:45:18 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6b27e9da-20d1-4952-a5fc-80c30942bc3f tempest-TestMinimumBasicScenario-579410959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec02c894-4234-48c0-b04d-979465895e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:45:18 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6b27e9da-20d1-4952-a5fc-80c30942bc3f tempest-TestMinimumBasicScenario-579410959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec02c894-4234-48c0-b04d-979465895e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:45:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-2122845304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a15151cf-4aaf-48ba-9d6a-4c13bfdddcdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e5eace00c5f4412bcd31ed320f4d253',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:45:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:45:19Z,use_quota=True,user_id='6284bcfb50ba4a939a9d9961b8a7a11c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:45:18 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6b27e9da-20d1-4952-a5fc-80c30942bc3f tempest-TestMinimumBasicScenario-579410959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f58ec38-45d3-4f3f-b1e5-4b2189889e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:45:18 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6b27e9da-20d1-4952-a5fc-80c30942bc3f tempest-TestMinimumBasicScenario-579410959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f58ec38-45d3-4f3f-b1e5-4b2189889e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:45:18 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6b27e9da-20d1-4952-a5fc-80c30942bc3f tempest-TestMinimumBasicScenario-579410959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35e1f0e9-88ee-48bf-8f7b-806c9b457802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:45:18 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6b27e9da-20d1-4952-a5fc-80c30942bc3f tempest-TestMinimumBasicScenario-579410959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35e1f0e9-88ee-48bf-8f7b-806c9b457802) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a15151cf-4aaf-48ba-9d6a-4c13bfdddcdb', 'volume_name': 'volume-a15151cf-4aaf-48ba-9d6a-4c13bfdddcdb', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:45:18 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6b27e9da-20d1-4952-a5fc-80c30942bc3f tempest-TestMinimumBasicScenario-579410959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dae58ff-7d2b-4fbd-a9b5-bebe8c9f5ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:45:18 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6b27e9da-20d1-4952-a5fc-80c30942bc3f tempest-TestMinimumBasicScenario-579410959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dae58ff-7d2b-4fbd-a9b5-bebe8c9f5ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:45:18 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6b27e9da-20d1-4952-a5fc-80c30942bc3f tempest-TestMinimumBasicScenario-579410959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab1f8a12-6db8-4e6f-aab6-50472fab334c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:45:18 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-6b27e9da-20d1-4952-a5fc-80c30942bc3f tempest-TestMinimumBasicScenario-579410959 None] Volume a15151cf-4aaf-48ba-9d6a-4c13bfdddcdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a15151cf-4aaf-48ba-9d6a-4c13bfdddcdb', 'volume_size': 1} Sep 18 21:45:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6b27e9da-20d1-4952-a5fc-80c30942bc3f tempest-TestMinimumBasicScenario-579410959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:45:18 devstack sudo[99593]: pam_unix(sudo:session): session closed for user root Sep 18 21:45:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-543eeda6-349a-4987-9d1a-ca4cb30c9eda tempest-GroupSnapshotsTest-367307629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9f203882-6d29-4f07-bec4-0183c44eeb30.info" returned: 0 in 0.670s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:45:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-543eeda6-349a-4987-9d1a-ca4cb30c9eda tempest-GroupSnapshotsTest-367307629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.688s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:45:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-543eeda6-349a-4987-9d1a-ca4cb30c9eda tempest-GroupSnapshotsTest-367307629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:45:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-543eeda6-349a-4987-9d1a-ca4cb30c9eda tempest-GroupSnapshotsTest-367307629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:45:19 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-543eeda6-349a-4987-9d1a-ca4cb30c9eda tempest-GroupSnapshotsTest-367307629 None] Creating offline snapshot b04f6cce-512f-4f9c-bd3e-33605dd0afc2 of volume 60c956da-cc89-4da1-8307-233990837948 {{(pid=86136) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 21:45:19 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ada8fbf-5bf4-4ecb-ad43-6681d9a9e79e]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:45:19 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-543eeda6-349a-4987-9d1a-ca4cb30c9eda tempest-GroupSnapshotsTest-367307629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-60c956da-cc89-4da1-8307-233990837948 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:45:19 devstack sudo[99595]: pam_unix(sudo:session): session closed for user root Sep 18 21:45:19 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-8f60ad1d-1d58-48a8-a996-20f015f400fa tempest-TestImageHashVerification-1276655736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.317s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:45:19 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-8f60ad1d-1d58-48a8-a996-20f015f400fa tempest-TestImageHashVerification-1276655736 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:45:19 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-8f60ad1d-1d58-48a8-a996-20f015f400fa tempest-TestImageHashVerification-1276655736 None] Deleted volume successfully. Sep 18 21:45:19 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-8f60ad1d-1d58-48a8-a996-20f015f400fa tempest-TestImageHashVerification-1276655736 None] Lock "cinder-106e4d64-dcd3-413e-9982-010a9e04bb81-delete_volume" released by "delete_volume" :: held 2.092s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:45:19 devstack sudo[99599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-60c956da-cc89-4da1-8307-233990837948 Sep 18 21:45:19 devstack sudo[99599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:45:19 devstack sudo[99599]: pam_unix(sudo:session): session closed for user root Sep 18 21:45:19 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-543eeda6-349a-4987-9d1a-ca4cb30c9eda tempest-GroupSnapshotsTest-367307629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-60c956da-cc89-4da1-8307-233990837948" returned: 0 in 0.456s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:45:19 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-543eeda6-349a-4987-9d1a-ca4cb30c9eda tempest-GroupSnapshotsTest-367307629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-60c956da-cc89-4da1-8307-233990837948,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-60c956da-cc89-4da1-8307-233990837948.b04f6cce-512f-4f9c-bd3e-33605dd0afc2 1G {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:45:19 devstack sudo[99604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-60c956da-cc89-4da1-8307-233990837948,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-60c956da-cc89-4da1-8307-233990837948.b04f6cce-512f-4f9c-bd3e-33605dd0afc2 1G Sep 18 21:45:19 devstack sudo[99604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:45:20 devstack sudo[99604]: pam_unix(sudo:session): session closed for user root Sep 18 21:45:20 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-543eeda6-349a-4987-9d1a-ca4cb30c9eda tempest-GroupSnapshotsTest-367307629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-60c956da-cc89-4da1-8307-233990837948,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-60c956da-cc89-4da1-8307-233990837948.b04f6cce-512f-4f9c-bd3e-33605dd0afc2 1G" returned: 0 in 0.809s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:45:20 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-543eeda6-349a-4987-9d1a-ca4cb30c9eda tempest-GroupSnapshotsTest-367307629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60c956da-cc89-4da1-8307-233990837948 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-60c956da-cc89-4da1-8307-233990837948.b04f6cce-512f-4f9c-bd3e-33605dd0afc2 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:45:20 devstack sudo[99645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60c956da-cc89-4da1-8307-233990837948 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-60c956da-cc89-4da1-8307-233990837948.b04f6cce-512f-4f9c-bd3e-33605dd0afc2 Sep 18 21:45:20 devstack sudo[99645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:45:20 devstack sudo[99645]: pam_unix(sudo:session): session closed for user root Sep 18 21:45:20 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-543eeda6-349a-4987-9d1a-ca4cb30c9eda tempest-GroupSnapshotsTest-367307629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60c956da-cc89-4da1-8307-233990837948 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-60c956da-cc89-4da1-8307-233990837948.b04f6cce-512f-4f9c-bd3e-33605dd0afc2" returned: 0 in 0.415s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:45:20 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-543eeda6-349a-4987-9d1a-ca4cb30c9eda tempest-GroupSnapshotsTest-367307629 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-60c956da-cc89-4da1-8307-233990837948.b04f6cce-512f-4f9c-bd3e-33605dd0afc2 is being set with open permissions: ugo+rw: NotImplementedError Sep 18 21:45:20 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-543eeda6-349a-4987-9d1a-ca4cb30c9eda tempest-GroupSnapshotsTest-367307629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-60c956da-cc89-4da1-8307-233990837948.b04f6cce-512f-4f9c-bd3e-33605dd0afc2 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:45:20 devstack sudo[99653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-60c956da-cc89-4da1-8307-233990837948.b04f6cce-512f-4f9c-bd3e-33605dd0afc2 Sep 18 21:45:20 devstack sudo[99653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:45:21 devstack sudo[99653]: pam_unix(sudo:session): session closed for user root Sep 18 21:45:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-543eeda6-349a-4987-9d1a-ca4cb30c9eda tempest-GroupSnapshotsTest-367307629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-60c956da-cc89-4da1-8307-233990837948.b04f6cce-512f-4f9c-bd3e-33605dd0afc2" returned: 0 in 0.435s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:45:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-543eeda6-349a-4987-9d1a-ca4cb30c9eda tempest-GroupSnapshotsTest-367307629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-60c956da-cc89-4da1-8307-233990837948.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:45:21 devstack sudo[99656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-60c956da-cc89-4da1-8307-233990837948.info Sep 18 21:45:21 devstack sudo[99656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:45:21 devstack sudo[99656]: pam_unix(sudo:session): session closed for user root Sep 18 21:45:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-543eeda6-349a-4987-9d1a-ca4cb30c9eda tempest-GroupSnapshotsTest-367307629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-60c956da-cc89-4da1-8307-233990837948.info" returned: 0 in 0.318s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:45:21 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-543eeda6-349a-4987-9d1a-ca4cb30c9eda tempest-GroupSnapshotsTest-367307629 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-60c956da-cc89-4da1-8307-233990837948.info is being set with open permissions: ugo+rw: NotImplementedError Sep 18 21:45:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-543eeda6-349a-4987-9d1a-ca4cb30c9eda tempest-GroupSnapshotsTest-367307629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-60c956da-cc89-4da1-8307-233990837948.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:45:21 devstack sudo[99659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-60c956da-cc89-4da1-8307-233990837948.info Sep 18 21:45:21 devstack sudo[99659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:45:21 devstack sudo[99659]: pam_unix(sudo:session): session closed for user root Sep 18 21:45:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-543eeda6-349a-4987-9d1a-ca4cb30c9eda tempest-GroupSnapshotsTest-367307629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-60c956da-cc89-4da1-8307-233990837948.info" returned: 0 in 0.461s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:45:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-543eeda6-349a-4987-9d1a-ca4cb30c9eda tempest-GroupSnapshotsTest-367307629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.004s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:45:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6b27e9da-20d1-4952-a5fc-80c30942bc3f tempest-TestMinimumBasicScenario-579410959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.117s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:45:22 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-6b27e9da-20d1-4952-a5fc-80c30942bc3f tempest-TestMinimumBasicScenario-579410959 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:45:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-2122845304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a15151cf-4aaf-48ba-9d6a-4c13bfdddcdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e5eace00c5f4412bcd31ed320f4d253',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:45:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:45:19Z,use_quota=True,user_id='6284bcfb50ba4a939a9d9961b8a7a11c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:45:22 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-6b27e9da-20d1-4952-a5fc-80c30942bc3f tempest-TestMinimumBasicScenario-579410959 None] Creating volume a15151cf-4aaf-48ba-9d6a-4c13bfdddcdb {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:45:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6b27e9da-20d1-4952-a5fc-80c30942bc3f tempest-TestMinimumBasicScenario-579410959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:45:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6b27e9da-20d1-4952-a5fc-80c30942bc3f tempest-TestMinimumBasicScenario-579410959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:45:22 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-6b27e9da-20d1-4952-a5fc-80c30942bc3f tempest-TestMinimumBasicScenario-579410959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:45:22 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-6b27e9da-20d1-4952-a5fc-80c30942bc3f tempest-TestMinimumBasicScenario-579410959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:45:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6b27e9da-20d1-4952-a5fc-80c30942bc3f tempest-TestMinimumBasicScenario-579410959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:45:22 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-6b27e9da-20d1-4952-a5fc-80c30942bc3f tempest-TestMinimumBasicScenario-579410959 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:45:22 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-6b27e9da-20d1-4952-a5fc-80c30942bc3f tempest-TestMinimumBasicScenario-579410959 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:45:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6b27e9da-20d1-4952-a5fc-80c30942bc3f tempest-TestMinimumBasicScenario-579410959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a15151cf-4aaf-48ba-9d6a-4c13bfdddcdb 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:45:22 devstack sudo[99663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a15151cf-4aaf-48ba-9d6a-4c13bfdddcdb 1073741824 Sep 18 21:45:22 devstack sudo[99663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:45:22 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-543eeda6-349a-4987-9d1a-ca4cb30c9eda tempest-GroupSnapshotsTest-367307629 None] group_snapshot 1b918d4c-6a8b-4095-b6e7-64d63eb8bd68: created successfully Sep 18 21:45:22 devstack sudo[99663]: pam_unix(sudo:session): session closed for user root Sep 18 21:45:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6b27e9da-20d1-4952-a5fc-80c30942bc3f tempest-TestMinimumBasicScenario-579410959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a15151cf-4aaf-48ba-9d6a-4c13bfdddcdb 1073741824" returned: 0 in 0.611s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:45:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6b27e9da-20d1-4952-a5fc-80c30942bc3f tempest-TestMinimumBasicScenario-579410959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a15151cf-4aaf-48ba-9d6a-4c13bfdddcdb {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:45:22 devstack sudo[99668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a15151cf-4aaf-48ba-9d6a-4c13bfdddcdb Sep 18 21:45:22 devstack sudo[99668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:45:23 devstack sudo[99668]: pam_unix(sudo:session): session closed for user root Sep 18 21:45:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6b27e9da-20d1-4952-a5fc-80c30942bc3f tempest-TestMinimumBasicScenario-579410959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a15151cf-4aaf-48ba-9d6a-4c13bfdddcdb" returned: 0 in 0.504s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:45:23 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-6b27e9da-20d1-4952-a5fc-80c30942bc3f tempest-TestMinimumBasicScenario-579410959 None] <== create_volume: return (1191ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:45:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6b27e9da-20d1-4952-a5fc-80c30942bc3f tempest-TestMinimumBasicScenario-579410959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.197s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:45:23 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6b27e9da-20d1-4952-a5fc-80c30942bc3f tempest-TestMinimumBasicScenario-579410959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab1f8a12-6db8-4e6f-aab6-50472fab334c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a15151cf-4aaf-48ba-9d6a-4c13bfdddcdb', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:45:23 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6b27e9da-20d1-4952-a5fc-80c30942bc3f tempest-TestMinimumBasicScenario-579410959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15b0fa2e-912c-423b-95a4-b57cb9ac6f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:45:23 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-6b27e9da-20d1-4952-a5fc-80c30942bc3f tempest-TestMinimumBasicScenario-579410959 None] Volume volume-a15151cf-4aaf-48ba-9d6a-4c13bfdddcdb (a15151cf-4aaf-48ba-9d6a-4c13bfdddcdb): created successfully Sep 18 21:45:23 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6b27e9da-20d1-4952-a5fc-80c30942bc3f tempest-TestMinimumBasicScenario-579410959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15b0fa2e-912c-423b-95a4-b57cb9ac6f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:45:23 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6b27e9da-20d1-4952-a5fc-80c30942bc3f tempest-TestMinimumBasicScenario-579410959 None] Flow 'volume_create_manager' (03a8d497-ac1b-4c11-8b0d-ad3ab809587b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:45:23 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-03238791-180b-4032-8f90-7285d57352ec tempest-GroupSnapshotsTest-367307629 None] group_snapshot 1b918d4c-6a8b-4095-b6e7-64d63eb8bd68: deleting Sep 18 21:45:23 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-03238791-180b-4032-8f90-7285d57352ec tempest-GroupSnapshotsTest-367307629 None] group_snapshot 1b918d4c-6a8b-4095-b6e7-64d63eb8bd68: deleting {{(pid=86136) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 18 21:45:23 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-6b27e9da-20d1-4952-a5fc-80c30942bc3f tempest-TestMinimumBasicScenario-579410959 None] Created volume successfully. Sep 18 21:45:23 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-03238791-180b-4032-8f90-7285d57352ec tempest-GroupSnapshotsTest-367307629 None] Acquiring lock "cinder-quobyte-9f203882-6d29-4f07-bec4-0183c44eeb30" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:45:23 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-03238791-180b-4032-8f90-7285d57352ec tempest-GroupSnapshotsTest-367307629 None] Lock "cinder-quobyte-9f203882-6d29-4f07-bec4-0183c44eeb30" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:45:23 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-03238791-180b-4032-8f90-7285d57352ec tempest-GroupSnapshotsTest-367307629 None] Acquiring lock "cinder-quobyte-0d88226f-0b6c-4671-af82-be02f52e0ca7" by "_delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:45:23 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-03238791-180b-4032-8f90-7285d57352ec tempest-GroupSnapshotsTest-367307629 None] Lock "cinder-quobyte-0d88226f-0b6c-4671-af82-be02f52e0ca7" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:45:23 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-03238791-180b-4032-8f90-7285d57352ec tempest-GroupSnapshotsTest-367307629 None] Deleting offline snapshot 0d88226f-0b6c-4671-af82-be02f52e0ca7 of volume 9f203882-6d29-4f07-bec4-0183c44eeb30 {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 21:45:23 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-03238791-180b-4032-8f90-7285d57352ec tempest-GroupSnapshotsTest-367307629 None] snapshot_file for this snap is: volume-9f203882-6d29-4f07-bec4-0183c44eeb30.0d88226f-0b6c-4671-af82-be02f52e0ca7 {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 21:45:23 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[db372f81-c0f6-47a2-b063-c3d06016bca5]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:45:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-03238791-180b-4032-8f90-7285d57352ec tempest-GroupSnapshotsTest-367307629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9f203882-6d29-4f07-bec4-0183c44eeb30.0d88226f-0b6c-4671-af82-be02f52e0ca7 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:45:23 devstack sudo[99671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9f203882-6d29-4f07-bec4-0183c44eeb30.0d88226f-0b6c-4671-af82-be02f52e0ca7 Sep 18 21:45:23 devstack sudo[99671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:45:24 devstack sudo[99671]: pam_unix(sudo:session): session closed for user root Sep 18 21:45:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-03238791-180b-4032-8f90-7285d57352ec tempest-GroupSnapshotsTest-367307629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9f203882-6d29-4f07-bec4-0183c44eeb30.0d88226f-0b6c-4671-af82-be02f52e0ca7" returned: 0 in 0.583s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:45:24 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-03238791-180b-4032-8f90-7285d57352ec tempest-GroupSnapshotsTest-367307629 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f203882-6d29-4f07-bec4-0183c44eeb30(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86136) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 21:45:24 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[9382fe44-b9f6-4e6b-a5b4-567b8bf6ee64]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:45:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-03238791-180b-4032-8f90-7285d57352ec tempest-GroupSnapshotsTest-367307629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9f203882-6d29-4f07-bec4-0183c44eeb30 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:45:24 devstack sudo[99676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9f203882-6d29-4f07-bec4-0183c44eeb30 Sep 18 21:45:24 devstack sudo[99676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:45:25 devstack sudo[99676]: pam_unix(sudo:session): session closed for user root Sep 18 21:45:25 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-03238791-180b-4032-8f90-7285d57352ec tempest-GroupSnapshotsTest-367307629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9f203882-6d29-4f07-bec4-0183c44eeb30" returned: 0 in 1.068s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:45:25 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-03238791-180b-4032-8f90-7285d57352ec tempest-GroupSnapshotsTest-367307629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9f203882-6d29-4f07-bec4-0183c44eeb30.0d88226f-0b6c-4671-af82-be02f52e0ca7 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:45:25 devstack sudo[99684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9f203882-6d29-4f07-bec4-0183c44eeb30.0d88226f-0b6c-4671-af82-be02f52e0ca7 Sep 18 21:45:25 devstack sudo[99684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:45:26 devstack sudo[99684]: pam_unix(sudo:session): session closed for user root Sep 18 21:45:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-03238791-180b-4032-8f90-7285d57352ec tempest-GroupSnapshotsTest-367307629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9f203882-6d29-4f07-bec4-0183c44eeb30.0d88226f-0b6c-4671-af82-be02f52e0ca7" returned: 0 in 0.788s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:45:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-03238791-180b-4032-8f90-7285d57352ec tempest-GroupSnapshotsTest-367307629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9f203882-6d29-4f07-bec4-0183c44eeb30.0d88226f-0b6c-4671-af82-be02f52e0ca7 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:45:26 devstack sudo[99696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9f203882-6d29-4f07-bec4-0183c44eeb30.0d88226f-0b6c-4671-af82-be02f52e0ca7 Sep 18 21:45:26 devstack sudo[99696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:45:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-d579f07b-1fd8-4d6a-ac71-44c51173d9a8 req-c89de7fc-4413-40d1-bed8-6d174c29f2ad tempest-TestMinimumBasicScenario-579410959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:45:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-d579f07b-1fd8-4d6a-ac71-44c51173d9a8 req-c89de7fc-4413-40d1-bed8-6d174c29f2ad tempest-TestMinimumBasicScenario-579410959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:45:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-d579f07b-1fd8-4d6a-ac71-44c51173d9a8 req-c89de7fc-4413-40d1-bed8-6d174c29f2ad tempest-TestMinimumBasicScenario-579410959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.051s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:45:26 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [req-d579f07b-1fd8-4d6a-ac71-44c51173d9a8 req-c89de7fc-4413-40d1-bed8-6d174c29f2ad tempest-TestMinimumBasicScenario-579410959 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff', 'name': 'volume-a15151cf-4aaf-48ba-9d6a-4c13bfdddcdb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2e9d887e-e567-493b-a44f-ec0af86f747e', 'enforce_multipath': True} {{(pid=86136) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 18 21:45:26 devstack sudo[99696]: pam_unix(sudo:session): session closed for user root Sep 18 21:45:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-03238791-180b-4032-8f90-7285d57352ec tempest-GroupSnapshotsTest-367307629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9f203882-6d29-4f07-bec4-0183c44eeb30.0d88226f-0b6c-4671-af82-be02f52e0ca7" returned: 0 in 0.456s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:45:26 devstack cinder-volume[86136]: INFO cinder.volume.manager [req-d579f07b-1fd8-4d6a-ac71-44c51173d9a8 req-c89de7fc-4413-40d1-bed8-6d174c29f2ad tempest-TestMinimumBasicScenario-579410959 None] attachment_update completed successfully. Sep 18 21:45:26 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-03238791-180b-4032-8f90-7285d57352ec tempest-GroupSnapshotsTest-367307629 None] Lock "cinder-quobyte-0d88226f-0b6c-4671-af82-be02f52e0ca7" released by "_delete_snapshot" :: held 3.105s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:45:26 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-03238791-180b-4032-8f90-7285d57352ec tempest-GroupSnapshotsTest-367307629 None] Lock "cinder-quobyte-9f203882-6d29-4f07-bec4-0183c44eeb30" released by "delete_snapshot" :: held 3.157s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:45:26 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-03238791-180b-4032-8f90-7285d57352ec tempest-GroupSnapshotsTest-367307629 None] Acquiring lock "cinder-quobyte-60c956da-cc89-4da1-8307-233990837948" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:45:26 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-03238791-180b-4032-8f90-7285d57352ec tempest-GroupSnapshotsTest-367307629 None] Lock "cinder-quobyte-60c956da-cc89-4da1-8307-233990837948" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:45:26 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-03238791-180b-4032-8f90-7285d57352ec tempest-GroupSnapshotsTest-367307629 None] Acquiring lock "cinder-quobyte-b04f6cce-512f-4f9c-bd3e-33605dd0afc2" by "_delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:45:26 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-03238791-180b-4032-8f90-7285d57352ec tempest-GroupSnapshotsTest-367307629 None] Lock "cinder-quobyte-b04f6cce-512f-4f9c-bd3e-33605dd0afc2" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:45:26 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-03238791-180b-4032-8f90-7285d57352ec tempest-GroupSnapshotsTest-367307629 None] Deleting offline snapshot b04f6cce-512f-4f9c-bd3e-33605dd0afc2 of volume 60c956da-cc89-4da1-8307-233990837948 {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 21:45:26 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-03238791-180b-4032-8f90-7285d57352ec tempest-GroupSnapshotsTest-367307629 None] snapshot_file for this snap is: volume-60c956da-cc89-4da1-8307-233990837948.b04f6cce-512f-4f9c-bd3e-33605dd0afc2 {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 21:45:26 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[dabee9d8-f99a-4092-8e71-678081872767]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:45:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-03238791-180b-4032-8f90-7285d57352ec tempest-GroupSnapshotsTest-367307629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-60c956da-cc89-4da1-8307-233990837948.b04f6cce-512f-4f9c-bd3e-33605dd0afc2 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:45:27 devstack sudo[99726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-60c956da-cc89-4da1-8307-233990837948.b04f6cce-512f-4f9c-bd3e-33605dd0afc2 Sep 18 21:45:27 devstack sudo[99726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:45:27 devstack sudo[99726]: pam_unix(sudo:session): session closed for user root Sep 18 21:45:27 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-03238791-180b-4032-8f90-7285d57352ec tempest-GroupSnapshotsTest-367307629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-60c956da-cc89-4da1-8307-233990837948.b04f6cce-512f-4f9c-bd3e-33605dd0afc2" returned: 0 in 0.868s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:45:27 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-03238791-180b-4032-8f90-7285d57352ec tempest-GroupSnapshotsTest-367307629 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60c956da-cc89-4da1-8307-233990837948(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86136) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 21:45:27 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[4325f965-3ca0-4514-b53c-3f432c616868]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:45:27 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-03238791-180b-4032-8f90-7285d57352ec tempest-GroupSnapshotsTest-367307629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-60c956da-cc89-4da1-8307-233990837948 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:45:28 devstack sudo[100125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-60c956da-cc89-4da1-8307-233990837948 Sep 18 21:45:28 devstack sudo[100125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:45:28 devstack sudo[100125]: pam_unix(sudo:session): session closed for user root Sep 18 21:45:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-03238791-180b-4032-8f90-7285d57352ec tempest-GroupSnapshotsTest-367307629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-60c956da-cc89-4da1-8307-233990837948" returned: 0 in 0.778s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:45:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-03238791-180b-4032-8f90-7285d57352ec tempest-GroupSnapshotsTest-367307629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-60c956da-cc89-4da1-8307-233990837948.b04f6cce-512f-4f9c-bd3e-33605dd0afc2 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:45:28 devstack sudo[100130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-60c956da-cc89-4da1-8307-233990837948.b04f6cce-512f-4f9c-bd3e-33605dd0afc2 Sep 18 21:45:28 devstack sudo[100130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:45:29 devstack sudo[100130]: pam_unix(sudo:session): session closed for user root Sep 18 21:45:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-03238791-180b-4032-8f90-7285d57352ec tempest-GroupSnapshotsTest-367307629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-60c956da-cc89-4da1-8307-233990837948.b04f6cce-512f-4f9c-bd3e-33605dd0afc2" returned: 0 in 0.490s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:45:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-03238791-180b-4032-8f90-7285d57352ec tempest-GroupSnapshotsTest-367307629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-60c956da-cc89-4da1-8307-233990837948.b04f6cce-512f-4f9c-bd3e-33605dd0afc2 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:45:29 devstack sudo[100164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-60c956da-cc89-4da1-8307-233990837948.b04f6cce-512f-4f9c-bd3e-33605dd0afc2 Sep 18 21:45:29 devstack sudo[100164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:45:29 devstack sudo[100164]: pam_unix(sudo:session): session closed for user root Sep 18 21:45:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-03238791-180b-4032-8f90-7285d57352ec tempest-GroupSnapshotsTest-367307629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-60c956da-cc89-4da1-8307-233990837948.b04f6cce-512f-4f9c-bd3e-33605dd0afc2" returned: 0 in 0.420s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:45:29 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-03238791-180b-4032-8f90-7285d57352ec tempest-GroupSnapshotsTest-367307629 None] Lock "cinder-quobyte-b04f6cce-512f-4f9c-bd3e-33605dd0afc2" released by "_delete_snapshot" :: held 2.811s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:45:29 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-03238791-180b-4032-8f90-7285d57352ec tempest-GroupSnapshotsTest-367307629 None] Lock "cinder-quobyte-60c956da-cc89-4da1-8307-233990837948" released by "delete_snapshot" :: held 2.864s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:45:29 devstack cinder-volume[86136]: WARNING cinder.quota [None req-03238791-180b-4032-8f90-7285d57352ec tempest-GroupSnapshotsTest-367307629 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2033132643 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2033132643, it is now deprecated. Please use the default quota class for default quota. Sep 18 21:45:29 devstack cinder-volume[86136]: WARNING cinder.quota [None req-03238791-180b-4032-8f90-7285d57352ec tempest-GroupSnapshotsTest-367307629 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2033132643 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2033132643, it is now deprecated. Please use the default quota class for default quota. Sep 18 21:45:29 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-03238791-180b-4032-8f90-7285d57352ec tempest-GroupSnapshotsTest-367307629 None] Created reservations ['a88fa699-e951-4739-88b1-8ad35587d2bf', '73678d46-eb65-461f-860b-2c53ddf85a0f', 'aba7a1c6-8b26-44c4-8990-86893a7175f3', '9f92b72a-2136-4d45-bcc0-9149870dc662'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:45:29 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-03238791-180b-4032-8f90-7285d57352ec tempest-GroupSnapshotsTest-367307629 None] Created reservations ['88ae08ac-badb-429b-8443-9b65ced946b4', 'f6c3dabf-49af-41f4-b09c-edb89dc15881', '162888f3-4f24-4de3-9c99-042c7198aa24', 'db05657f-15f8-4ff3-8656-a2a81b329d02'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:45:29 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-03238791-180b-4032-8f90-7285d57352ec tempest-GroupSnapshotsTest-367307629 None] group_snapshot 1b918d4c-6a8b-4095-b6e7-64d63eb8bd68: deleted successfully Sep 18 21:45:30 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-c3b62d70-119f-4b23-af93-e271b40e12b5 tempest-GroupSnapshotsTest-367307629 None] Acquiring lock "cinder-quobyte-60c956da-cc89-4da1-8307-233990837948" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:45:30 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-c3b62d70-119f-4b23-af93-e271b40e12b5 tempest-GroupSnapshotsTest-367307629 None] Lock "cinder-quobyte-60c956da-cc89-4da1-8307-233990837948" acquired by "delete_volume" :: waited 0.039s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:45:31 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f0aed8-5871-47d2-9360-9f7ebb9d5ab5]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:45:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c3b62d70-119f-4b23-af93-e271b40e12b5 tempest-GroupSnapshotsTest-367307629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-60c956da-cc89-4da1-8307-233990837948 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:45:31 devstack sudo[100169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-60c956da-cc89-4da1-8307-233990837948 Sep 18 21:45:31 devstack sudo[100169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:45:31 devstack sudo[100169]: pam_unix(sudo:session): session closed for user root Sep 18 21:45:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c3b62d70-119f-4b23-af93-e271b40e12b5 tempest-GroupSnapshotsTest-367307629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-60c956da-cc89-4da1-8307-233990837948" returned: 0 in 0.435s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:45:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c3b62d70-119f-4b23-af93-e271b40e12b5 tempest-GroupSnapshotsTest-367307629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-60c956da-cc89-4da1-8307-233990837948 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:45:31 devstack sudo[100175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-60c956da-cc89-4da1-8307-233990837948 Sep 18 21:45:31 devstack sudo[100175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:45:31 devstack sudo[100175]: pam_unix(sudo:session): session closed for user root Sep 18 21:45:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c3b62d70-119f-4b23-af93-e271b40e12b5 tempest-GroupSnapshotsTest-367307629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-60c956da-cc89-4da1-8307-233990837948" returned: 0 in 0.290s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:45:31 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-c3b62d70-119f-4b23-af93-e271b40e12b5 tempest-GroupSnapshotsTest-367307629 None] Lock "cinder-quobyte-60c956da-cc89-4da1-8307-233990837948" released by "delete_volume" :: held 0.852s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:45:31 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-c3b62d70-119f-4b23-af93-e271b40e12b5 tempest-GroupSnapshotsTest-367307629 None] Acquiring lock "cinder-quobyte-9f203882-6d29-4f07-bec4-0183c44eeb30" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:45:31 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-c3b62d70-119f-4b23-af93-e271b40e12b5 tempest-GroupSnapshotsTest-367307629 None] Lock "cinder-quobyte-9f203882-6d29-4f07-bec4-0183c44eeb30" acquired by "delete_volume" :: waited 0.014s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:45:31 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a345535-bb11-4a61-9cf2-59ae989efea2]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:45:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c3b62d70-119f-4b23-af93-e271b40e12b5 tempest-GroupSnapshotsTest-367307629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9f203882-6d29-4f07-bec4-0183c44eeb30 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:45:32 devstack sudo[100178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9f203882-6d29-4f07-bec4-0183c44eeb30 Sep 18 21:45:32 devstack sudo[100178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:45:32 devstack sudo[100178]: pam_unix(sudo:session): session closed for user root Sep 18 21:45:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c3b62d70-119f-4b23-af93-e271b40e12b5 tempest-GroupSnapshotsTest-367307629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9f203882-6d29-4f07-bec4-0183c44eeb30" returned: 0 in 0.475s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:45:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c3b62d70-119f-4b23-af93-e271b40e12b5 tempest-GroupSnapshotsTest-367307629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9f203882-6d29-4f07-bec4-0183c44eeb30 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:45:32 devstack sudo[100184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9f203882-6d29-4f07-bec4-0183c44eeb30 Sep 18 21:45:32 devstack sudo[100184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:45:32 devstack sudo[100184]: pam_unix(sudo:session): session closed for user root Sep 18 21:45:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c3b62d70-119f-4b23-af93-e271b40e12b5 tempest-GroupSnapshotsTest-367307629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9f203882-6d29-4f07-bec4-0183c44eeb30" returned: 0 in 0.267s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:45:32 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-c3b62d70-119f-4b23-af93-e271b40e12b5 tempest-GroupSnapshotsTest-367307629 None] Lock "cinder-quobyte-9f203882-6d29-4f07-bec4-0183c44eeb30" released by "delete_volume" :: held 0.816s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:45:32 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-c3b62d70-119f-4b23-af93-e271b40e12b5 tempest-GroupSnapshotsTest-367307629 None] Created reservations ['94e0cac5-ecc6-49ce-bde0-b6d136723712'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:45:32 devstack cinder-volume[86136]: WARNING cinder.quota [None req-c3b62d70-119f-4b23-af93-e271b40e12b5 tempest-GroupSnapshotsTest-367307629 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2033132643 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2033132643, it is now deprecated. Please use the default quota class for default quota. Sep 18 21:45:32 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-c3b62d70-119f-4b23-af93-e271b40e12b5 tempest-GroupSnapshotsTest-367307629 None] Created reservations ['364f6c8c-4a91-465d-86ee-379cdeb3db32', '1aa7bad6-0e8c-48e4-a2c6-4140e3abe5ec', '26d20370-3c8b-43af-a1bc-09d9db9326bc', '6e796d11-f5c1-495c-a8e7-461141ca3d1c'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:45:32 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-c3b62d70-119f-4b23-af93-e271b40e12b5 tempest-GroupSnapshotsTest-367307629 None] Created reservations ['ac49285a-ec11-4f12-8efa-635577a749ac', 'ed7866d3-9641-418a-b66b-59356f0ce72d', '66317b0b-a995-417c-a5e8-c96966a3c9aa', '66905e18-ca26-44b3-b631-172e73894bc3'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:45:33 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c3b62d70-119f-4b23-af93-e271b40e12b5 tempest-GroupSnapshotsTest-367307629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:45:33 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c3b62d70-119f-4b23-af93-e271b40e12b5 tempest-GroupSnapshotsTest-367307629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:45:33 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-c3b62d70-119f-4b23-af93-e271b40e12b5 tempest-GroupSnapshotsTest-367307629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:45:33 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-c3b62d70-119f-4b23-af93-e271b40e12b5 tempest-GroupSnapshotsTest-367307629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:45:33 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c3b62d70-119f-4b23-af93-e271b40e12b5 tempest-GroupSnapshotsTest-367307629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:45:33 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c3b62d70-119f-4b23-af93-e271b40e12b5 tempest-GroupSnapshotsTest-367307629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:45:33 devstack sudo[100187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:45:33 devstack sudo[100187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:45:33 devstack sudo[100187]: pam_unix(sudo:session): session closed for user root Sep 18 21:45:33 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c3b62d70-119f-4b23-af93-e271b40e12b5 tempest-GroupSnapshotsTest-367307629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.384s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:45:33 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-c3b62d70-119f-4b23-af93-e271b40e12b5 tempest-GroupSnapshotsTest-367307629 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:45:33 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-c3b62d70-119f-4b23-af93-e271b40e12b5 tempest-GroupSnapshotsTest-367307629 None] Delete group completed successfully. Sep 18 21:45:33 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-1ac9ed44-9b34-47e5-9396-31f83360df85 tempest-GroupSnapshotsTest-367307629 None] Group tempest-GroupSnapshotsTest-Group-197032933: creating Sep 18 21:45:33 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-1ac9ed44-9b34-47e5-9396-31f83360df85 tempest-GroupSnapshotsTest-367307629 None] Group tempest-GroupSnapshotsTest-Group-197032933: created successfully Sep 18 21:45:33 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-1ac9ed44-9b34-47e5-9396-31f83360df85 tempest-GroupSnapshotsTest-367307629 None] Create group completed successfully. Sep 18 21:45:35 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd9db6fc-aedf-43fa-8fe3-521a3de2db70 tempest-GroupSnapshotsTest-367307629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:45:35 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-bd9db6fc-aedf-43fa-8fe3-521a3de2db70 tempest-GroupSnapshotsTest-367307629 None] Flow 'volume_create_manager' (9cb6f1ed-6238-48e0-93fd-0eb187f590c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:45:35 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-bd9db6fc-aedf-43fa-8fe3-521a3de2db70 tempest-GroupSnapshotsTest-367307629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e32c6ea3-32d0-4aa0-a50b-f83569d4d9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:45:35 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-bd9db6fc-aedf-43fa-8fe3-521a3de2db70 tempest-GroupSnapshotsTest-367307629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e32c6ea3-32d0-4aa0-a50b-f83569d4d9fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:45:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1635852764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=07ff67d0-7460-4b6f-896c-242d09e5cc87,host='devstack@QuobyteHD#QuobyteHD',id=b7e4e71b-1c8c-43f5-9da3-a67de9d47594,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1623a52b317543e9922e23aab834e567',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:45:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:45:36Z,use_quota=True,user_id='3f44c15c704a42e5b18ee6f61ea8b5d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1152d7db-7d7d-4b11-bbb2-346d1374af0e),volume_type_id=1152d7db-7d7d-4b11-bbb2-346d1374af0e)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:45:35 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-bd9db6fc-aedf-43fa-8fe3-521a3de2db70 tempest-GroupSnapshotsTest-367307629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9150f21-684a-421e-ac1f-8d1a7ef14d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:45:35 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-bd9db6fc-aedf-43fa-8fe3-521a3de2db70 tempest-GroupSnapshotsTest-367307629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9150f21-684a-421e-ac1f-8d1a7ef14d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:45:35 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-bd9db6fc-aedf-43fa-8fe3-521a3de2db70 tempest-GroupSnapshotsTest-367307629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d90846a-698b-49c2-a5d4-34ce9d8aa3b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:45:35 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-bd9db6fc-aedf-43fa-8fe3-521a3de2db70 tempest-GroupSnapshotsTest-367307629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d90846a-698b-49c2-a5d4-34ce9d8aa3b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7e4e71b-1c8c-43f5-9da3-a67de9d47594', 'volume_name': 'volume-b7e4e71b-1c8c-43f5-9da3-a67de9d47594', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:45:35 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-bd9db6fc-aedf-43fa-8fe3-521a3de2db70 tempest-GroupSnapshotsTest-367307629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a89d400-d425-452e-bda1-2c4d5ebc9dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:45:35 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-bd9db6fc-aedf-43fa-8fe3-521a3de2db70 tempest-GroupSnapshotsTest-367307629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a89d400-d425-452e-bda1-2c4d5ebc9dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:45:35 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-bd9db6fc-aedf-43fa-8fe3-521a3de2db70 tempest-GroupSnapshotsTest-367307629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (099747cb-181e-4213-8104-0b44e368e8d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:45:35 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-bd9db6fc-aedf-43fa-8fe3-521a3de2db70 tempest-GroupSnapshotsTest-367307629 None] Volume b7e4e71b-1c8c-43f5-9da3-a67de9d47594: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7e4e71b-1c8c-43f5-9da3-a67de9d47594', 'volume_size': 1} Sep 18 21:45:35 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-bd9db6fc-aedf-43fa-8fe3-521a3de2db70 tempest-GroupSnapshotsTest-367307629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:45:35 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-bd9db6fc-aedf-43fa-8fe3-521a3de2db70 tempest-GroupSnapshotsTest-367307629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:45:35 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-bd9db6fc-aedf-43fa-8fe3-521a3de2db70 tempest-GroupSnapshotsTest-367307629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=07ff67d0-7460-4b6f-896c-242d09e5cc87,created_at=2026-09-18T19:45:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1635852764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=07ff67d0-7460-4b6f-896c-242d09e5cc87,host='devstack@QuobyteHD#QuobyteHD',id=b7e4e71b-1c8c-43f5-9da3-a67de9d47594,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1623a52b317543e9922e23aab834e567',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:45:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:45:36Z,use_quota=True,user_id='3f44c15c704a42e5b18ee6f61ea8b5d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1152d7db-7d7d-4b11-bbb2-346d1374af0e),volume_type_id=1152d7db-7d7d-4b11-bbb2-346d1374af0e)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:45:35 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-bd9db6fc-aedf-43fa-8fe3-521a3de2db70 tempest-GroupSnapshotsTest-367307629 None] Creating volume b7e4e71b-1c8c-43f5-9da3-a67de9d47594 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:45:35 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-bd9db6fc-aedf-43fa-8fe3-521a3de2db70 tempest-GroupSnapshotsTest-367307629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:45:35 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-bd9db6fc-aedf-43fa-8fe3-521a3de2db70 tempest-GroupSnapshotsTest-367307629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:45:35 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-bd9db6fc-aedf-43fa-8fe3-521a3de2db70 tempest-GroupSnapshotsTest-367307629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:45:35 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-bd9db6fc-aedf-43fa-8fe3-521a3de2db70 tempest-GroupSnapshotsTest-367307629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:45:35 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-bd9db6fc-aedf-43fa-8fe3-521a3de2db70 tempest-GroupSnapshotsTest-367307629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:45:35 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-bd9db6fc-aedf-43fa-8fe3-521a3de2db70 tempest-GroupSnapshotsTest-367307629 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:45:35 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-bd9db6fc-aedf-43fa-8fe3-521a3de2db70 tempest-GroupSnapshotsTest-367307629 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:45:35 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-bd9db6fc-aedf-43fa-8fe3-521a3de2db70 tempest-GroupSnapshotsTest-367307629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7e4e71b-1c8c-43f5-9da3-a67de9d47594 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:45:35 devstack sudo[100192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7e4e71b-1c8c-43f5-9da3-a67de9d47594 1073741824 Sep 18 21:45:35 devstack sudo[100192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:45:36 devstack sudo[100192]: pam_unix(sudo:session): session closed for user root Sep 18 21:45:36 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-bd9db6fc-aedf-43fa-8fe3-521a3de2db70 tempest-GroupSnapshotsTest-367307629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7e4e71b-1c8c-43f5-9da3-a67de9d47594 1073741824" returned: 0 in 0.601s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:45:36 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-bd9db6fc-aedf-43fa-8fe3-521a3de2db70 tempest-GroupSnapshotsTest-367307629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7e4e71b-1c8c-43f5-9da3-a67de9d47594 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:45:36 devstack sudo[100199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7e4e71b-1c8c-43f5-9da3-a67de9d47594 Sep 18 21:45:36 devstack sudo[100199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:45:36 devstack sudo[100199]: pam_unix(sudo:session): session closed for user root Sep 18 21:45:36 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-bd9db6fc-aedf-43fa-8fe3-521a3de2db70 tempest-GroupSnapshotsTest-367307629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7e4e71b-1c8c-43f5-9da3-a67de9d47594" returned: 0 in 0.326s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:45:36 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-bd9db6fc-aedf-43fa-8fe3-521a3de2db70 tempest-GroupSnapshotsTest-367307629 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:45:36 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-bd9db6fc-aedf-43fa-8fe3-521a3de2db70 tempest-GroupSnapshotsTest-367307629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:45:36 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-bd9db6fc-aedf-43fa-8fe3-521a3de2db70 tempest-GroupSnapshotsTest-367307629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (099747cb-181e-4213-8104-0b44e368e8d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7e4e71b-1c8c-43f5-9da3-a67de9d47594', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:45:36 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-bd9db6fc-aedf-43fa-8fe3-521a3de2db70 tempest-GroupSnapshotsTest-367307629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09a22d7c-e490-4ac7-aa1b-c160bcc43bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:45:36 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-bd9db6fc-aedf-43fa-8fe3-521a3de2db70 tempest-GroupSnapshotsTest-367307629 None] Volume volume-b7e4e71b-1c8c-43f5-9da3-a67de9d47594 (b7e4e71b-1c8c-43f5-9da3-a67de9d47594): created successfully Sep 18 21:45:36 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-bd9db6fc-aedf-43fa-8fe3-521a3de2db70 tempest-GroupSnapshotsTest-367307629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09a22d7c-e490-4ac7-aa1b-c160bcc43bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:45:36 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-bd9db6fc-aedf-43fa-8fe3-521a3de2db70 tempest-GroupSnapshotsTest-367307629 None] Flow 'volume_create_manager' (9cb6f1ed-6238-48e0-93fd-0eb187f590c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:45:36 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-bd9db6fc-aedf-43fa-8fe3-521a3de2db70 tempest-GroupSnapshotsTest-367307629 None] Created volume successfully. Sep 18 21:45:38 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-45e3246d-97e1-43c9-bf86-aa62de8de41a tempest-GroupSnapshotsTest-367307629 None] GroupSnapshot d8bc28e1-4600-4226-9c46-2fc742895162: creating. Sep 18 21:45:38 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-45e3246d-97e1-43c9-bf86-aa62de8de41a tempest-GroupSnapshotsTest-367307629 None] Group snapshot d8bc28e1-4600-4226-9c46-2fc742895162: creating. {{(pid=86136) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 18 21:45:38 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-45e3246d-97e1-43c9-bf86-aa62de8de41a tempest-GroupSnapshotsTest-367307629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:45:38 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-45e3246d-97e1-43c9-bf86-aa62de8de41a tempest-GroupSnapshotsTest-367307629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:45:38 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-45e3246d-97e1-43c9-bf86-aa62de8de41a tempest-GroupSnapshotsTest-367307629 None] Creating offline snapshot 43f5293b-db71-4b7e-8243-3890ce6b07ff of volume b7e4e71b-1c8c-43f5-9da3-a67de9d47594 {{(pid=86136) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 21:45:38 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8f0b55-3d42-4726-aea4-726cd81061ba]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:45:38 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-45e3246d-97e1-43c9-bf86-aa62de8de41a tempest-GroupSnapshotsTest-367307629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7e4e71b-1c8c-43f5-9da3-a67de9d47594 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:45:38 devstack sudo[100202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7e4e71b-1c8c-43f5-9da3-a67de9d47594 Sep 18 21:45:38 devstack sudo[100202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:45:39 devstack sudo[100202]: pam_unix(sudo:session): session closed for user root Sep 18 21:45:39 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-45e3246d-97e1-43c9-bf86-aa62de8de41a tempest-GroupSnapshotsTest-367307629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7e4e71b-1c8c-43f5-9da3-a67de9d47594" returned: 0 in 0.540s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:45:39 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-45e3246d-97e1-43c9-bf86-aa62de8de41a tempest-GroupSnapshotsTest-367307629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7e4e71b-1c8c-43f5-9da3-a67de9d47594,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7e4e71b-1c8c-43f5-9da3-a67de9d47594.43f5293b-db71-4b7e-8243-3890ce6b07ff 1G {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:45:39 devstack sudo[100207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7e4e71b-1c8c-43f5-9da3-a67de9d47594,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7e4e71b-1c8c-43f5-9da3-a67de9d47594.43f5293b-db71-4b7e-8243-3890ce6b07ff 1G Sep 18 21:45:39 devstack sudo[100207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:45:40 devstack sudo[100207]: pam_unix(sudo:session): session closed for user root Sep 18 21:45:40 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-45e3246d-97e1-43c9-bf86-aa62de8de41a tempest-GroupSnapshotsTest-367307629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7e4e71b-1c8c-43f5-9da3-a67de9d47594,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7e4e71b-1c8c-43f5-9da3-a67de9d47594.43f5293b-db71-4b7e-8243-3890ce6b07ff 1G" returned: 0 in 0.737s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:45:40 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-45e3246d-97e1-43c9-bf86-aa62de8de41a tempest-GroupSnapshotsTest-367307629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7e4e71b-1c8c-43f5-9da3-a67de9d47594 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7e4e71b-1c8c-43f5-9da3-a67de9d47594.43f5293b-db71-4b7e-8243-3890ce6b07ff {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:45:40 devstack sudo[100213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7e4e71b-1c8c-43f5-9da3-a67de9d47594 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7e4e71b-1c8c-43f5-9da3-a67de9d47594.43f5293b-db71-4b7e-8243-3890ce6b07ff Sep 18 21:45:40 devstack sudo[100213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:45:40 devstack sudo[100213]: pam_unix(sudo:session): session closed for user root Sep 18 21:45:40 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-45e3246d-97e1-43c9-bf86-aa62de8de41a tempest-GroupSnapshotsTest-367307629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7e4e71b-1c8c-43f5-9da3-a67de9d47594 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7e4e71b-1c8c-43f5-9da3-a67de9d47594.43f5293b-db71-4b7e-8243-3890ce6b07ff" returned: 0 in 0.478s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:45:40 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-45e3246d-97e1-43c9-bf86-aa62de8de41a tempest-GroupSnapshotsTest-367307629 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7e4e71b-1c8c-43f5-9da3-a67de9d47594.43f5293b-db71-4b7e-8243-3890ce6b07ff is being set with open permissions: ugo+rw: NotImplementedError Sep 18 21:45:40 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-45e3246d-97e1-43c9-bf86-aa62de8de41a tempest-GroupSnapshotsTest-367307629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7e4e71b-1c8c-43f5-9da3-a67de9d47594.43f5293b-db71-4b7e-8243-3890ce6b07ff {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:45:40 devstack sudo[100219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7e4e71b-1c8c-43f5-9da3-a67de9d47594.43f5293b-db71-4b7e-8243-3890ce6b07ff Sep 18 21:45:40 devstack sudo[100219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:45:40 devstack sudo[100219]: pam_unix(sudo:session): session closed for user root Sep 18 21:45:40 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-45e3246d-97e1-43c9-bf86-aa62de8de41a tempest-GroupSnapshotsTest-367307629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7e4e71b-1c8c-43f5-9da3-a67de9d47594.43f5293b-db71-4b7e-8243-3890ce6b07ff" returned: 0 in 0.413s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:45:40 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-45e3246d-97e1-43c9-bf86-aa62de8de41a tempest-GroupSnapshotsTest-367307629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7e4e71b-1c8c-43f5-9da3-a67de9d47594.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:45:40 devstack sudo[100222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7e4e71b-1c8c-43f5-9da3-a67de9d47594.info Sep 18 21:45:40 devstack sudo[100222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:45:41 devstack sudo[100222]: pam_unix(sudo:session): session closed for user root Sep 18 21:45:41 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-45e3246d-97e1-43c9-bf86-aa62de8de41a tempest-GroupSnapshotsTest-367307629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7e4e71b-1c8c-43f5-9da3-a67de9d47594.info" returned: 0 in 0.307s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:45:41 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-45e3246d-97e1-43c9-bf86-aa62de8de41a tempest-GroupSnapshotsTest-367307629 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7e4e71b-1c8c-43f5-9da3-a67de9d47594.info is being set with open permissions: ugo+rw: NotImplementedError Sep 18 21:45:41 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-45e3246d-97e1-43c9-bf86-aa62de8de41a tempest-GroupSnapshotsTest-367307629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7e4e71b-1c8c-43f5-9da3-a67de9d47594.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:45:41 devstack sudo[100225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7e4e71b-1c8c-43f5-9da3-a67de9d47594.info Sep 18 21:45:41 devstack sudo[100225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:45:41 devstack sudo[100225]: pam_unix(sudo:session): session closed for user root Sep 18 21:45:41 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-45e3246d-97e1-43c9-bf86-aa62de8de41a tempest-GroupSnapshotsTest-367307629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7e4e71b-1c8c-43f5-9da3-a67de9d47594.info" returned: 0 in 0.288s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:45:41 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-45e3246d-97e1-43c9-bf86-aa62de8de41a tempest-GroupSnapshotsTest-367307629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.893s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:45:41 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-45e3246d-97e1-43c9-bf86-aa62de8de41a tempest-GroupSnapshotsTest-367307629 None] group_snapshot d8bc28e1-4600-4226-9c46-2fc742895162: created successfully Sep 18 21:45:42 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-e81146c3-ce54-423c-842b-c676660e1ff6 tempest-GroupSnapshotsTest-367307629 None] group_snapshot d8bc28e1-4600-4226-9c46-2fc742895162: deleting Sep 18 21:45:42 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-e81146c3-ce54-423c-842b-c676660e1ff6 tempest-GroupSnapshotsTest-367307629 None] group_snapshot d8bc28e1-4600-4226-9c46-2fc742895162: deleting {{(pid=86136) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 18 21:45:42 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-e81146c3-ce54-423c-842b-c676660e1ff6 tempest-GroupSnapshotsTest-367307629 None] Acquiring lock "cinder-quobyte-b7e4e71b-1c8c-43f5-9da3-a67de9d47594" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:45:42 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-e81146c3-ce54-423c-842b-c676660e1ff6 tempest-GroupSnapshotsTest-367307629 None] Lock "cinder-quobyte-b7e4e71b-1c8c-43f5-9da3-a67de9d47594" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:45:42 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-e81146c3-ce54-423c-842b-c676660e1ff6 tempest-GroupSnapshotsTest-367307629 None] Acquiring lock "cinder-quobyte-43f5293b-db71-4b7e-8243-3890ce6b07ff" by "_delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:45:42 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-e81146c3-ce54-423c-842b-c676660e1ff6 tempest-GroupSnapshotsTest-367307629 None] Lock "cinder-quobyte-43f5293b-db71-4b7e-8243-3890ce6b07ff" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:45:42 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-e81146c3-ce54-423c-842b-c676660e1ff6 tempest-GroupSnapshotsTest-367307629 None] Deleting offline snapshot 43f5293b-db71-4b7e-8243-3890ce6b07ff of volume b7e4e71b-1c8c-43f5-9da3-a67de9d47594 {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 21:45:42 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-e81146c3-ce54-423c-842b-c676660e1ff6 tempest-GroupSnapshotsTest-367307629 None] snapshot_file for this snap is: volume-b7e4e71b-1c8c-43f5-9da3-a67de9d47594.43f5293b-db71-4b7e-8243-3890ce6b07ff {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 21:45:42 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a9d49b-e637-49ec-95dd-3a6b8bd10ffa]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:45:42 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e81146c3-ce54-423c-842b-c676660e1ff6 tempest-GroupSnapshotsTest-367307629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7e4e71b-1c8c-43f5-9da3-a67de9d47594.43f5293b-db71-4b7e-8243-3890ce6b07ff {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:45:42 devstack sudo[100228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7e4e71b-1c8c-43f5-9da3-a67de9d47594.43f5293b-db71-4b7e-8243-3890ce6b07ff Sep 18 21:45:42 devstack sudo[100228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:45:43 devstack sudo[100228]: pam_unix(sudo:session): session closed for user root Sep 18 21:45:43 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e81146c3-ce54-423c-842b-c676660e1ff6 tempest-GroupSnapshotsTest-367307629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7e4e71b-1c8c-43f5-9da3-a67de9d47594.43f5293b-db71-4b7e-8243-3890ce6b07ff" returned: 0 in 0.578s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:45:43 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-e81146c3-ce54-423c-842b-c676660e1ff6 tempest-GroupSnapshotsTest-367307629 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7e4e71b-1c8c-43f5-9da3-a67de9d47594(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86136) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 21:45:43 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f0b2f45-5853-4739-a167-e78bbe8793c0]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:45:43 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e81146c3-ce54-423c-842b-c676660e1ff6 tempest-GroupSnapshotsTest-367307629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7e4e71b-1c8c-43f5-9da3-a67de9d47594 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:45:43 devstack sudo[100233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7e4e71b-1c8c-43f5-9da3-a67de9d47594 Sep 18 21:45:43 devstack sudo[100233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:45:43 devstack sudo[100233]: pam_unix(sudo:session): session closed for user root Sep 18 21:45:43 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e81146c3-ce54-423c-842b-c676660e1ff6 tempest-GroupSnapshotsTest-367307629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7e4e71b-1c8c-43f5-9da3-a67de9d47594" returned: 0 in 0.454s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:45:43 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e81146c3-ce54-423c-842b-c676660e1ff6 tempest-GroupSnapshotsTest-367307629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7e4e71b-1c8c-43f5-9da3-a67de9d47594.43f5293b-db71-4b7e-8243-3890ce6b07ff {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:45:43 devstack sudo[100238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7e4e71b-1c8c-43f5-9da3-a67de9d47594.43f5293b-db71-4b7e-8243-3890ce6b07ff Sep 18 21:45:43 devstack sudo[100238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:45:44 devstack sudo[100238]: pam_unix(sudo:session): session closed for user root Sep 18 21:45:44 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e81146c3-ce54-423c-842b-c676660e1ff6 tempest-GroupSnapshotsTest-367307629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7e4e71b-1c8c-43f5-9da3-a67de9d47594.43f5293b-db71-4b7e-8243-3890ce6b07ff" returned: 0 in 0.527s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:45:44 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e81146c3-ce54-423c-842b-c676660e1ff6 tempest-GroupSnapshotsTest-367307629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7e4e71b-1c8c-43f5-9da3-a67de9d47594.43f5293b-db71-4b7e-8243-3890ce6b07ff {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:45:44 devstack sudo[100243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7e4e71b-1c8c-43f5-9da3-a67de9d47594.43f5293b-db71-4b7e-8243-3890ce6b07ff Sep 18 21:45:44 devstack sudo[100243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:45:44 devstack sudo[100243]: pam_unix(sudo:session): session closed for user root Sep 18 21:45:44 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e81146c3-ce54-423c-842b-c676660e1ff6 tempest-GroupSnapshotsTest-367307629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7e4e71b-1c8c-43f5-9da3-a67de9d47594.43f5293b-db71-4b7e-8243-3890ce6b07ff" returned: 0 in 0.345s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:45:44 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-e81146c3-ce54-423c-842b-c676660e1ff6 tempest-GroupSnapshotsTest-367307629 None] Lock "cinder-quobyte-43f5293b-db71-4b7e-8243-3890ce6b07ff" released by "_delete_snapshot" :: held 2.079s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:45:44 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-e81146c3-ce54-423c-842b-c676660e1ff6 tempest-GroupSnapshotsTest-367307629 None] Lock "cinder-quobyte-b7e4e71b-1c8c-43f5-9da3-a67de9d47594" released by "delete_snapshot" :: held 2.118s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:45:44 devstack cinder-volume[86136]: WARNING cinder.quota [None req-e81146c3-ce54-423c-842b-c676660e1ff6 tempest-GroupSnapshotsTest-367307629 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1162618619 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1162618619, it is now deprecated. Please use the default quota class for default quota. Sep 18 21:45:44 devstack cinder-volume[86136]: WARNING cinder.quota [None req-e81146c3-ce54-423c-842b-c676660e1ff6 tempest-GroupSnapshotsTest-367307629 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1162618619 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1162618619, it is now deprecated. Please use the default quota class for default quota. Sep 18 21:45:44 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-e81146c3-ce54-423c-842b-c676660e1ff6 tempest-GroupSnapshotsTest-367307629 None] Created reservations ['0197a5df-4489-4e53-b176-fbf2e7c4518a', 'dae26d08-1548-4b80-b880-255c3f0e3e6b', 'dd4f78a4-5f79-4413-acb8-5d859ff5d062', 'ba9d045b-b7bb-42e3-846f-f5d2b6fe7339'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:45:44 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-e81146c3-ce54-423c-842b-c676660e1ff6 tempest-GroupSnapshotsTest-367307629 None] group_snapshot d8bc28e1-4600-4226-9c46-2fc742895162: deleted successfully Sep 18 21:45:45 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-8f23cd2f-4f98-4155-92d3-01470d7c33b2 tempest-GroupSnapshotsTest-367307629 None] Acquiring lock "cinder-quobyte-b7e4e71b-1c8c-43f5-9da3-a67de9d47594" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:45:45 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-8f23cd2f-4f98-4155-92d3-01470d7c33b2 tempest-GroupSnapshotsTest-367307629 None] Lock "cinder-quobyte-b7e4e71b-1c8c-43f5-9da3-a67de9d47594" acquired by "delete_volume" :: waited 0.042s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:45:45 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f940fef-1b87-44f2-9410-c59c1d0a4ca2]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:45:45 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-8f23cd2f-4f98-4155-92d3-01470d7c33b2 tempest-GroupSnapshotsTest-367307629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7e4e71b-1c8c-43f5-9da3-a67de9d47594 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:45:45 devstack sudo[100247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7e4e71b-1c8c-43f5-9da3-a67de9d47594 Sep 18 21:45:45 devstack sudo[100247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:45:45 devstack sudo[100247]: pam_unix(sudo:session): session closed for user root Sep 18 21:45:45 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-8f23cd2f-4f98-4155-92d3-01470d7c33b2 tempest-GroupSnapshotsTest-367307629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7e4e71b-1c8c-43f5-9da3-a67de9d47594" returned: 0 in 0.515s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:45:45 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-8f23cd2f-4f98-4155-92d3-01470d7c33b2 tempest-GroupSnapshotsTest-367307629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7e4e71b-1c8c-43f5-9da3-a67de9d47594 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:45:46 devstack sudo[100252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7e4e71b-1c8c-43f5-9da3-a67de9d47594 Sep 18 21:45:46 devstack sudo[100252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:45:46 devstack sudo[100252]: pam_unix(sudo:session): session closed for user root Sep 18 21:45:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-8f23cd2f-4f98-4155-92d3-01470d7c33b2 tempest-GroupSnapshotsTest-367307629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b7e4e71b-1c8c-43f5-9da3-a67de9d47594" returned: 0 in 0.346s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:45:46 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-8f23cd2f-4f98-4155-92d3-01470d7c33b2 tempest-GroupSnapshotsTest-367307629 None] Lock "cinder-quobyte-b7e4e71b-1c8c-43f5-9da3-a67de9d47594" released by "delete_volume" :: held 0.971s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:45:46 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-8f23cd2f-4f98-4155-92d3-01470d7c33b2 tempest-GroupSnapshotsTest-367307629 None] Created reservations ['88bd44c4-d72b-4a39-8463-454cf51171fb'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:45:46 devstack cinder-volume[86136]: WARNING cinder.quota [None req-8f23cd2f-4f98-4155-92d3-01470d7c33b2 tempest-GroupSnapshotsTest-367307629 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1162618619 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1162618619, it is now deprecated. Please use the default quota class for default quota. Sep 18 21:45:46 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-8f23cd2f-4f98-4155-92d3-01470d7c33b2 tempest-GroupSnapshotsTest-367307629 None] Created reservations ['9a3a23f0-25cf-45d9-8bf4-f5876bc4a54e', 'd4c08986-a625-4e9e-85e8-324eeac47d52', 'e0a5baa9-a5ec-4834-9a80-9f19e12eb9e4', '61a607d5-09f6-4590-ba69-01c5c1438e4d'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:45:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-8f23cd2f-4f98-4155-92d3-01470d7c33b2 tempest-GroupSnapshotsTest-367307629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:45:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-8f23cd2f-4f98-4155-92d3-01470d7c33b2 tempest-GroupSnapshotsTest-367307629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:45:46 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-8f23cd2f-4f98-4155-92d3-01470d7c33b2 tempest-GroupSnapshotsTest-367307629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:45:46 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-8f23cd2f-4f98-4155-92d3-01470d7c33b2 tempest-GroupSnapshotsTest-367307629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:45:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-8f23cd2f-4f98-4155-92d3-01470d7c33b2 tempest-GroupSnapshotsTest-367307629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:45:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-8f23cd2f-4f98-4155-92d3-01470d7c33b2 tempest-GroupSnapshotsTest-367307629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:45:46 devstack sudo[100257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:45:46 devstack sudo[100257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:45:47 devstack sudo[100257]: pam_unix(sudo:session): session closed for user root Sep 18 21:45:47 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-8f23cd2f-4f98-4155-92d3-01470d7c33b2 tempest-GroupSnapshotsTest-367307629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.378s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:45:47 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-8f23cd2f-4f98-4155-92d3-01470d7c33b2 tempest-GroupSnapshotsTest-367307629 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:45:47 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-8f23cd2f-4f98-4155-92d3-01470d7c33b2 tempest-GroupSnapshotsTest-367307629 None] Delete group completed successfully. Sep 18 21:45:49 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddee9a42-95ee-4cbd-9655-2c54a4cdd2ea tempest-TestShelveInstance-1002688398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:45:49 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ddee9a42-95ee-4cbd-9655-2c54a4cdd2ea tempest-TestShelveInstance-1002688398 None] Flow 'volume_create_manager' (e72b47bf-4774-40fd-ac96-6a7f7070552b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:45:49 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ddee9a42-95ee-4cbd-9655-2c54a4cdd2ea tempest-TestShelveInstance-1002688398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33bde553-d15b-40ce-925e-f1ba8f064d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:45:49 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ddee9a42-95ee-4cbd-9655-2c54a4cdd2ea tempest-TestShelveInstance-1002688398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33bde553-d15b-40ce-925e-f1ba8f064d02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:45:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1610286246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45edcf0b-344c-40f8-bf50-766ce05c30ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0a05382a3974490895fdcee193a76ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:45:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:45:50Z,use_quota=True,user_id='5700fbccf28543589577295cbe131713',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:45:49 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ddee9a42-95ee-4cbd-9655-2c54a4cdd2ea tempest-TestShelveInstance-1002688398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33a713dd-b1a4-4319-b203-00e2dbf38605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:45:49 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ddee9a42-95ee-4cbd-9655-2c54a4cdd2ea tempest-TestShelveInstance-1002688398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33a713dd-b1a4-4319-b203-00e2dbf38605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:45:49 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ddee9a42-95ee-4cbd-9655-2c54a4cdd2ea tempest-TestShelveInstance-1002688398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e51dad5-8578-472b-8f84-c35015db6c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:45:49 devstack cinder-volume[86136]: DEBUG cinder.image.glance [None req-ddee9a42-95ee-4cbd-9655-2c54a4cdd2ea tempest-TestShelveInstance-1002688398 None] Creating Keystone auth plugin from conf {{(pid=86136) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 18 21:45:50 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ddee9a42-95ee-4cbd-9655-2c54a4cdd2ea tempest-TestShelveInstance-1002688398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e51dad5-8578-472b-8f84-c35015db6c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '45edcf0b-344c-40f8-bf50-766ce05c30ac', 'volume_name': 'volume-45edcf0b-344c-40f8-bf50-766ce05c30ac', 'volume_size': 1, 'image_id': 'a7adbe6d-c72a-4ef2-82c6-e788c5101a2c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a7adbe6d-c72a-4ef2-82c6-e788c5101a2c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'eae9b2cfe4f146fb9d7ac38006d73cd9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a7adbe6d-c72a-4ef2-82c6-e788c5101a2c', 'created_at': datetime.datetime(2026, 9, 18, 19, 27, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 18, 19, 27, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a7adbe6d-c72a-4ef2-82c6-e788c5101a2c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:45:50 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ddee9a42-95ee-4cbd-9655-2c54a4cdd2ea tempest-TestShelveInstance-1002688398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22b0e5e9-493f-4df2-803d-6a48bb70bafa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:45:50 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ddee9a42-95ee-4cbd-9655-2c54a4cdd2ea tempest-TestShelveInstance-1002688398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22b0e5e9-493f-4df2-803d-6a48bb70bafa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:45:50 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ddee9a42-95ee-4cbd-9655-2c54a4cdd2ea tempest-TestShelveInstance-1002688398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d62819e-acf7-4b97-88e4-8fa12fa27e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:45:50 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-ddee9a42-95ee-4cbd-9655-2c54a4cdd2ea tempest-TestShelveInstance-1002688398 None] Volume 45edcf0b-344c-40f8-bf50-766ce05c30ac: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-45edcf0b-344c-40f8-bf50-766ce05c30ac', 'volume_size': 1, 'image_id': 'a7adbe6d-c72a-4ef2-82c6-e788c5101a2c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a7adbe6d-c72a-4ef2-82c6-e788c5101a2c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'eae9b2cfe4f146fb9d7ac38006d73cd9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a7adbe6d-c72a-4ef2-82c6-e788c5101a2c', 'created_at': datetime.datetime(2026, 9, 18, 19, 27, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 18, 19, 27, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a7adbe6d-c72a-4ef2-82c6-e788c5101a2c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 18 21:45:50 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddee9a42-95ee-4cbd-9655-2c54a4cdd2ea tempest-TestShelveInstance-1002688398 None] Trying to clone 45edcf0b-344c-40f8-bf50-766ce05c30ac from image a7adbe6d-c72a-4ef2-82c6-e788c5101a2c at location (None, [{'url': 'file:///opt/stack/data/glance/images/a7adbe6d-c72a-4ef2-82c6-e788c5101a2c', 'metadata': {}}]). {{(pid=86136) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 18 21:45:50 devstack cinder-volume[86136]: DEBUG cinder.image.image_utils [None req-ddee9a42-95ee-4cbd-9655-2c54a4cdd2ea tempest-TestShelveInstance-1002688398 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_3abexp0pdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86136) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 18 21:45:50 devstack cinder-volume[86136]: INFO cinder.image.image_utils [None req-ddee9a42-95ee-4cbd-9655-2c54a4cdd2ea tempest-TestShelveInstance-1002688398 None] Image download 20.69 MB at 20.69 MB/s Sep 18 21:45:51 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[df4c78d7-9823-4af3-a089-66873ed6de82]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:45:51 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ddee9a42-95ee-4cbd-9655-2c54a4cdd2ea tempest-TestShelveInstance-1002688398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_3abexp0pdevstack@QuobyteHD {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:45:51 devstack sudo[100289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_3abexp0pdevstack@QuobyteHD Sep 18 21:45:51 devstack sudo[100289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:45:51 devstack sudo[100289]: pam_unix(sudo:session): session closed for user root Sep 18 21:45:51 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ddee9a42-95ee-4cbd-9655-2c54a4cdd2ea tempest-TestShelveInstance-1002688398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_3abexp0pdevstack@QuobyteHD" returned: 0 in 0.407s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:45:51 devstack cinder-volume[86136]: DEBUG cinder.image.image_utils [None req-ddee9a42-95ee-4cbd-9655-2c54a4cdd2ea tempest-TestShelveInstance-1002688398 None] Temporary image a7adbe6d-c72a-4ef2-82c6-e788c5101a2c is fetched for user 5700fbccf28543589577295cbe131713. {{(pid=86136) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 18 21:45:51 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[5572f8bb-8d37-4160-b327-0f012e844cfa]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:45:51 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ddee9a42-95ee-4cbd-9655-2c54a4cdd2ea tempest-TestShelveInstance-1002688398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_3abexp0pdevstack@QuobyteHD {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:45:51 devstack sudo[100294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_3abexp0pdevstack@QuobyteHD Sep 18 21:45:51 devstack sudo[100294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:45:51 devstack sudo[100294]: pam_unix(sudo:session): session closed for user root Sep 18 21:45:51 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ddee9a42-95ee-4cbd-9655-2c54a4cdd2ea tempest-TestShelveInstance-1002688398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_3abexp0pdevstack@QuobyteHD" returned: 0 in 0.419s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:45:51 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-ddee9a42-95ee-4cbd-9655-2c54a4cdd2ea tempest-TestShelveInstance-1002688398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:45:51 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-ddee9a42-95ee-4cbd-9655-2c54a4cdd2ea tempest-TestShelveInstance-1002688398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:45:51 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-ddee9a42-95ee-4cbd-9655-2c54a4cdd2ea tempest-TestShelveInstance-1002688398 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:45:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1610286246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45edcf0b-344c-40f8-bf50-766ce05c30ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0a05382a3974490895fdcee193a76ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:45:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:45:50Z,use_quota=True,user_id='5700fbccf28543589577295cbe131713',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:45:51 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-ddee9a42-95ee-4cbd-9655-2c54a4cdd2ea tempest-TestShelveInstance-1002688398 None] Creating volume 45edcf0b-344c-40f8-bf50-766ce05c30ac {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:45:51 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-ddee9a42-95ee-4cbd-9655-2c54a4cdd2ea tempest-TestShelveInstance-1002688398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:45:51 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-ddee9a42-95ee-4cbd-9655-2c54a4cdd2ea tempest-TestShelveInstance-1002688398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:45:51 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-ddee9a42-95ee-4cbd-9655-2c54a4cdd2ea tempest-TestShelveInstance-1002688398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:45:51 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-ddee9a42-95ee-4cbd-9655-2c54a4cdd2ea tempest-TestShelveInstance-1002688398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:45:51 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-ddee9a42-95ee-4cbd-9655-2c54a4cdd2ea tempest-TestShelveInstance-1002688398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:45:51 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-ddee9a42-95ee-4cbd-9655-2c54a4cdd2ea tempest-TestShelveInstance-1002688398 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:45:51 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-ddee9a42-95ee-4cbd-9655-2c54a4cdd2ea tempest-TestShelveInstance-1002688398 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:45:51 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ddee9a42-95ee-4cbd-9655-2c54a4cdd2ea tempest-TestShelveInstance-1002688398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-45edcf0b-344c-40f8-bf50-766ce05c30ac 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:45:52 devstack sudo[100299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-45edcf0b-344c-40f8-bf50-766ce05c30ac 1073741824 Sep 18 21:45:52 devstack sudo[100299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:45:52 devstack sudo[100299]: pam_unix(sudo:session): session closed for user root Sep 18 21:45:52 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ddee9a42-95ee-4cbd-9655-2c54a4cdd2ea tempest-TestShelveInstance-1002688398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-45edcf0b-344c-40f8-bf50-766ce05c30ac 1073741824" returned: 0 in 0.605s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:45:52 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ddee9a42-95ee-4cbd-9655-2c54a4cdd2ea tempest-TestShelveInstance-1002688398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-45edcf0b-344c-40f8-bf50-766ce05c30ac {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:45:52 devstack sudo[100305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-45edcf0b-344c-40f8-bf50-766ce05c30ac Sep 18 21:45:52 devstack sudo[100305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:45:52 devstack sudo[100305]: pam_unix(sudo:session): session closed for user root Sep 18 21:45:52 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ddee9a42-95ee-4cbd-9655-2c54a4cdd2ea tempest-TestShelveInstance-1002688398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-45edcf0b-344c-40f8-bf50-766ce05c30ac" returned: 0 in 0.308s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:45:52 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-ddee9a42-95ee-4cbd-9655-2c54a4cdd2ea tempest-TestShelveInstance-1002688398 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:45:52 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-ddee9a42-95ee-4cbd-9655-2c54a4cdd2ea tempest-TestShelveInstance-1002688398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:45:52 devstack cinder-volume[86136]: DEBUG cinder.volume.volume_utils [None req-ddee9a42-95ee-4cbd-9655-2c54a4cdd2ea tempest-TestShelveInstance-1002688398 None] Attempting download of a7adbe6d-c72a-4ef2-82c6-e788c5101a2c ((None, [{'url': 'file:///opt/stack/data/glance/images/a7adbe6d-c72a-4ef2-82c6-e788c5101a2c', 'metadata': {}}])) to volume 45edcf0b-344c-40f8-bf50-766ce05c30ac. {{(pid=86136) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 18 21:45:53 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b6697b-eb2a-44b5-a0a0-22f3ed284d1c]: (4, 'raw') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:45:53 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ddee9a42-95ee-4cbd-9655-2c54a4cdd2ea tempest-TestShelveInstance-1002688398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_ivlj3318 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:45:53 devstack sudo[100308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_ivlj3318 Sep 18 21:45:53 devstack sudo[100308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:45:53 devstack sudo[100308]: pam_unix(sudo:session): session closed for user root Sep 18 21:45:53 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ddee9a42-95ee-4cbd-9655-2c54a4cdd2ea tempest-TestShelveInstance-1002688398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_ivlj3318" returned: 0 in 0.626s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:45:53 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ddee9a42-95ee-4cbd-9655-2c54a4cdd2ea tempest-TestShelveInstance-1002688398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_ivlj3318 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:45:53 devstack sudo[100312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_ivlj3318 Sep 18 21:45:53 devstack sudo[100312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:45:54 devstack sudo[100312]: pam_unix(sudo:session): session closed for user root Sep 18 21:45:54 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ddee9a42-95ee-4cbd-9655-2c54a4cdd2ea tempest-TestShelveInstance-1002688398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_ivlj3318" returned: 1 in 0.392s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:45:54 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ddee9a42-95ee-4cbd-9655-2c54a4cdd2ea tempest-TestShelveInstance-1002688398 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_ivlj3318' failed. Not Retrying. {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 18 21:45:54 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[067ccb49-db1b-481b-9dd5-3055a1374d7b]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:45:54 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ddee9a42-95ee-4cbd-9655-2c54a4cdd2ea tempest-TestShelveInstance-1002688398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_3abexp0pdevstack@QuobyteHD {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:45:54 devstack sudo[100316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_3abexp0pdevstack@QuobyteHD Sep 18 21:45:54 devstack sudo[100316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:45:54 devstack sudo[100316]: pam_unix(sudo:session): session closed for user root Sep 18 21:45:54 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ddee9a42-95ee-4cbd-9655-2c54a4cdd2ea tempest-TestShelveInstance-1002688398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_3abexp0pdevstack@QuobyteHD" returned: 0 in 0.387s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:45:54 devstack cinder-volume[86136]: DEBUG cinder.image.image_utils [None req-ddee9a42-95ee-4cbd-9655-2c54a4cdd2ea tempest-TestShelveInstance-1002688398 None] a7adbe6d-c72a-4ef2-82c6-e788c5101a2c was qcow2, converting to qcow2 {{(pid=86136) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 18 21:45:54 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ddee9a42-95ee-4cbd-9655-2c54a4cdd2ea tempest-TestShelveInstance-1002688398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_3abexp0pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-45edcf0b-344c-40f8-bf50-766ce05c30ac {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:45:54 devstack sudo[100322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_3abexp0pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-45edcf0b-344c-40f8-bf50-766ce05c30ac Sep 18 21:45:54 devstack sudo[100322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:45:55 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-30522453-03b8-4631-ab8b-af8f9536539a tempest-GroupsTest-593842659 None] Group tempest-Group1-222923816: creating Sep 18 21:45:55 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-30522453-03b8-4631-ab8b-af8f9536539a tempest-GroupsTest-593842659 None] Group tempest-Group1-222923816: created successfully Sep 18 21:45:55 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-30522453-03b8-4631-ab8b-af8f9536539a tempest-GroupsTest-593842659 None] Create group completed successfully. Sep 18 21:45:56 devstack sudo[100322]: pam_unix(sudo:session): session closed for user root Sep 18 21:45:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ddee9a42-95ee-4cbd-9655-2c54a4cdd2ea tempest-TestShelveInstance-1002688398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_3abexp0pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-45edcf0b-344c-40f8-bf50-766ce05c30ac" returned: 0 in 2.328s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:45:56 devstack cinder-volume[86136]: DEBUG cinder.image.image_utils [None req-ddee9a42-95ee-4cbd-9655-2c54a4cdd2ea tempest-TestShelveInstance-1002688398 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_3abexp0pdevstack@QuobyteHD, size 112.00 MB, duration 2.33 sec, destination /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-45edcf0b-344c-40f8-bf50-766ce05c30ac {{(pid=86136) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 18 21:45:56 devstack cinder-volume[86136]: INFO cinder.image.image_utils [None req-ddee9a42-95ee-4cbd-9655-2c54a4cdd2ea tempest-TestShelveInstance-1002688398 None] Converted 112.00 MB image at 48.08 MB/s Sep 18 21:45:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ddee9a42-95ee-4cbd-9655-2c54a4cdd2ea tempest-TestShelveInstance-1002688398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-45edcf0b-344c-40f8-bf50-766ce05c30ac 1G {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:45:56 devstack sudo[100335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-45edcf0b-344c-40f8-bf50-766ce05c30ac 1G Sep 18 21:45:56 devstack sudo[100335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:45:57 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-5da62cef-5434-4fb5-9342-69589a6cbc96 tempest-GroupsTest-593842659 None] Group tempest-Group2-758591356: creating Sep 18 21:45:57 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-5da62cef-5434-4fb5-9342-69589a6cbc96 tempest-GroupsTest-593842659 None] Group tempest-Group2-758591356: created successfully Sep 18 21:45:57 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-5da62cef-5434-4fb5-9342-69589a6cbc96 tempest-GroupsTest-593842659 None] Create group completed successfully. Sep 18 21:45:57 devstack sudo[100335]: pam_unix(sudo:session): session closed for user root Sep 18 21:45:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ddee9a42-95ee-4cbd-9655-2c54a4cdd2ea tempest-TestShelveInstance-1002688398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-45edcf0b-344c-40f8-bf50-766ce05c30ac 1G" returned: 0 in 0.445s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:45:57 devstack cinder-volume[86136]: DEBUG cinder.volume.volume_utils [None req-ddee9a42-95ee-4cbd-9655-2c54a4cdd2ea tempest-TestShelveInstance-1002688398 None] Downloaded image a7adbe6d-c72a-4ef2-82c6-e788c5101a2c ((None, [{'url': 'file:///opt/stack/data/glance/images/a7adbe6d-c72a-4ef2-82c6-e788c5101a2c', 'metadata': {}}])) to volume 45edcf0b-344c-40f8-bf50-766ce05c30ac successfully. {{(pid=86136) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 18 21:45:57 devstack cinder-volume[86136]: DEBUG cinder.image.image_utils [None req-ddee9a42-95ee-4cbd-9655-2c54a4cdd2ea tempest-TestShelveInstance-1002688398 None] Temporary image a7adbe6d-c72a-4ef2-82c6-e788c5101a2c for user 5700fbccf28543589577295cbe131713 is deleted. {{(pid=86136) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 18 21:45:57 devstack cinder-volume[86136]: DEBUG cinder.volume.volume_utils [None req-ddee9a42-95ee-4cbd-9655-2c54a4cdd2ea tempest-TestShelveInstance-1002688398 None] Marking volume 45edcf0b-344c-40f8-bf50-766ce05c30ac as bootable. {{(pid=86136) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 18 21:45:57 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddee9a42-95ee-4cbd-9655-2c54a4cdd2ea tempest-TestShelveInstance-1002688398 None] Copying metadata from image a7adbe6d-c72a-4ef2-82c6-e788c5101a2c to 45edcf0b-344c-40f8-bf50-766ce05c30ac. {{(pid=86136) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 18 21:45:57 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddee9a42-95ee-4cbd-9655-2c54a4cdd2ea tempest-TestShelveInstance-1002688398 None] Creating volume glance metadata for volume 45edcf0b-344c-40f8-bf50-766ce05c30ac backed by image a7adbe6d-c72a-4ef2-82c6-e788c5101a2c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a7adbe6d-c72a-4ef2-82c6-e788c5101a2c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86136) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 18 21:45:57 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ddee9a42-95ee-4cbd-9655-2c54a4cdd2ea tempest-TestShelveInstance-1002688398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d62819e-acf7-4b97-88e4-8fa12fa27e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45edcf0b-344c-40f8-bf50-766ce05c30ac', 'volume_size': 1, 'image_id': 'a7adbe6d-c72a-4ef2-82c6-e788c5101a2c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a7adbe6d-c72a-4ef2-82c6-e788c5101a2c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'eae9b2cfe4f146fb9d7ac38006d73cd9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a7adbe6d-c72a-4ef2-82c6-e788c5101a2c', 'created_at': datetime.datetime(2026, 9, 18, 19, 27, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 18, 19, 27, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a7adbe6d-c72a-4ef2-82c6-e788c5101a2c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:45:57 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ddee9a42-95ee-4cbd-9655-2c54a4cdd2ea tempest-TestShelveInstance-1002688398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9008d20b-00d1-46a6-a546-2dfa53ed5257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:45:57 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-ddee9a42-95ee-4cbd-9655-2c54a4cdd2ea tempest-TestShelveInstance-1002688398 None] Volume volume-45edcf0b-344c-40f8-bf50-766ce05c30ac (45edcf0b-344c-40f8-bf50-766ce05c30ac): created successfully Sep 18 21:45:57 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ddee9a42-95ee-4cbd-9655-2c54a4cdd2ea tempest-TestShelveInstance-1002688398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9008d20b-00d1-46a6-a546-2dfa53ed5257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:45:57 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ddee9a42-95ee-4cbd-9655-2c54a4cdd2ea tempest-TestShelveInstance-1002688398 None] Flow 'volume_create_manager' (e72b47bf-4774-40fd-ac96-6a7f7070552b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:45:57 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-ddee9a42-95ee-4cbd-9655-2c54a4cdd2ea tempest-TestShelveInstance-1002688398 None] Created volume successfully. Sep 18 21:45:58 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8f91276-b33c-4e23-b527-5af21df9d5b1 tempest-GroupsTest-593842659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:45:58 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b8f91276-b33c-4e23-b527-5af21df9d5b1 tempest-GroupsTest-593842659 None] Flow 'volume_create_manager' (f9872efb-ea7e-404f-a361-4129a1d73115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:45:58 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b8f91276-b33c-4e23-b527-5af21df9d5b1 tempest-GroupsTest-593842659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1984dc68-6c9b-4461-8856-2446d863ca7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:45:58 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b8f91276-b33c-4e23-b527-5af21df9d5b1 tempest-GroupsTest-593842659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1984dc68-6c9b-4461-8856-2446d863ca7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:45:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1104946337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=50bebe66-adc2-428a-9aa3-57d738dcd701,host='devstack@QuobyteHD#QuobyteHD',id=51b82107-94aa-427d-8085-4f6dae7f0bec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ab4e0a5cf214447a2ea75bda5ea5755',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:45:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:45:59Z,use_quota=True,user_id='a9c4ae67b1964718bc9f44063af7de98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9f0c0cfd-0ea5-4a37-9254-c2508a401923),volume_type_id=9f0c0cfd-0ea5-4a37-9254-c2508a401923)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:45:58 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b8f91276-b33c-4e23-b527-5af21df9d5b1 tempest-GroupsTest-593842659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9585f007-5142-4b7a-83fd-4878d215ddf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:45:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b8f91276-b33c-4e23-b527-5af21df9d5b1 tempest-GroupsTest-593842659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9585f007-5142-4b7a-83fd-4878d215ddf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:45:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b8f91276-b33c-4e23-b527-5af21df9d5b1 tempest-GroupsTest-593842659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91dba481-bb15-4e35-99a5-6cf4c784e1b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:45:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b8f91276-b33c-4e23-b527-5af21df9d5b1 tempest-GroupsTest-593842659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91dba481-bb15-4e35-99a5-6cf4c784e1b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51b82107-94aa-427d-8085-4f6dae7f0bec', 'volume_name': 'volume-51b82107-94aa-427d-8085-4f6dae7f0bec', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:45:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b8f91276-b33c-4e23-b527-5af21df9d5b1 tempest-GroupsTest-593842659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36d4d855-545a-4837-bd19-0efc60b697cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:45:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b8f91276-b33c-4e23-b527-5af21df9d5b1 tempest-GroupsTest-593842659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36d4d855-545a-4837-bd19-0efc60b697cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:45:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b8f91276-b33c-4e23-b527-5af21df9d5b1 tempest-GroupsTest-593842659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a93a347-8fcb-48a9-8b78-8c94308446c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:45:59 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-b8f91276-b33c-4e23-b527-5af21df9d5b1 tempest-GroupsTest-593842659 None] Volume 51b82107-94aa-427d-8085-4f6dae7f0bec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51b82107-94aa-427d-8085-4f6dae7f0bec', 'volume_size': 1} Sep 18 21:45:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-b8f91276-b33c-4e23-b527-5af21df9d5b1 tempest-GroupsTest-593842659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:45:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-b8f91276-b33c-4e23-b527-5af21df9d5b1 tempest-GroupsTest-593842659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:45:59 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-b8f91276-b33c-4e23-b527-5af21df9d5b1 tempest-GroupsTest-593842659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=50bebe66-adc2-428a-9aa3-57d738dcd701,created_at=2026-09-18T19:45:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1104946337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=50bebe66-adc2-428a-9aa3-57d738dcd701,host='devstack@QuobyteHD#QuobyteHD',id=51b82107-94aa-427d-8085-4f6dae7f0bec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ab4e0a5cf214447a2ea75bda5ea5755',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:45:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:45:59Z,use_quota=True,user_id='a9c4ae67b1964718bc9f44063af7de98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9f0c0cfd-0ea5-4a37-9254-c2508a401923),volume_type_id=9f0c0cfd-0ea5-4a37-9254-c2508a401923)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:45:59 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-b8f91276-b33c-4e23-b527-5af21df9d5b1 tempest-GroupsTest-593842659 None] Creating volume 51b82107-94aa-427d-8085-4f6dae7f0bec {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:45:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-b8f91276-b33c-4e23-b527-5af21df9d5b1 tempest-GroupsTest-593842659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:45:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-b8f91276-b33c-4e23-b527-5af21df9d5b1 tempest-GroupsTest-593842659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:45:59 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-b8f91276-b33c-4e23-b527-5af21df9d5b1 tempest-GroupsTest-593842659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:45:59 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-b8f91276-b33c-4e23-b527-5af21df9d5b1 tempest-GroupsTest-593842659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:45:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-b8f91276-b33c-4e23-b527-5af21df9d5b1 tempest-GroupsTest-593842659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:45:59 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-b8f91276-b33c-4e23-b527-5af21df9d5b1 tempest-GroupsTest-593842659 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:45:59 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-b8f91276-b33c-4e23-b527-5af21df9d5b1 tempest-GroupsTest-593842659 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:45:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-b8f91276-b33c-4e23-b527-5af21df9d5b1 tempest-GroupsTest-593842659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-51b82107-94aa-427d-8085-4f6dae7f0bec 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:45:59 devstack sudo[100364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-51b82107-94aa-427d-8085-4f6dae7f0bec 1073741824 Sep 18 21:45:59 devstack sudo[100364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:45:59 devstack sudo[100364]: pam_unix(sudo:session): session closed for user root Sep 18 21:45:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-b8f91276-b33c-4e23-b527-5af21df9d5b1 tempest-GroupsTest-593842659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-51b82107-94aa-427d-8085-4f6dae7f0bec 1073741824" returned: 0 in 0.727s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:45:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-b8f91276-b33c-4e23-b527-5af21df9d5b1 tempest-GroupsTest-593842659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-51b82107-94aa-427d-8085-4f6dae7f0bec {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:45:59 devstack sudo[100370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-51b82107-94aa-427d-8085-4f6dae7f0bec Sep 18 21:45:59 devstack sudo[100370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:46:00 devstack sudo[100370]: pam_unix(sudo:session): session closed for user root Sep 18 21:46:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-b8f91276-b33c-4e23-b527-5af21df9d5b1 tempest-GroupsTest-593842659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-51b82107-94aa-427d-8085-4f6dae7f0bec" returned: 0 in 0.539s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:46:00 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-b8f91276-b33c-4e23-b527-5af21df9d5b1 tempest-GroupsTest-593842659 None] <== create_volume: return (1357ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:46:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-b8f91276-b33c-4e23-b527-5af21df9d5b1 tempest-GroupsTest-593842659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.365s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:46:00 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b8f91276-b33c-4e23-b527-5af21df9d5b1 tempest-GroupsTest-593842659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a93a347-8fcb-48a9-8b78-8c94308446c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51b82107-94aa-427d-8085-4f6dae7f0bec', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:46:00 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b8f91276-b33c-4e23-b527-5af21df9d5b1 tempest-GroupsTest-593842659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83f05834-dccd-4829-9a0a-bf578222efef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:46:00 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-b8f91276-b33c-4e23-b527-5af21df9d5b1 tempest-GroupsTest-593842659 None] Volume volume-51b82107-94aa-427d-8085-4f6dae7f0bec (51b82107-94aa-427d-8085-4f6dae7f0bec): created successfully Sep 18 21:46:00 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b8f91276-b33c-4e23-b527-5af21df9d5b1 tempest-GroupsTest-593842659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83f05834-dccd-4829-9a0a-bf578222efef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:46:00 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b8f91276-b33c-4e23-b527-5af21df9d5b1 tempest-GroupsTest-593842659 None] Flow 'volume_create_manager' (f9872efb-ea7e-404f-a361-4129a1d73115) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:46:00 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-b8f91276-b33c-4e23-b527-5af21df9d5b1 tempest-GroupsTest-593842659 None] Created volume successfully. Sep 18 21:46:02 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-14e27185-ebaf-4a9e-b747-5df01beac381 tempest-GroupsTest-593842659 None] Acquiring lock "cinder-quobyte-51b82107-94aa-427d-8085-4f6dae7f0bec" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:46:02 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-14e27185-ebaf-4a9e-b747-5df01beac381 tempest-GroupsTest-593842659 None] Lock "cinder-quobyte-51b82107-94aa-427d-8085-4f6dae7f0bec" acquired by "delete_volume" :: waited 0.019s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:46:02 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[174e82dd-1e97-4fa8-a2e3-085c05101830]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:46:02 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-14e27185-ebaf-4a9e-b747-5df01beac381 tempest-GroupsTest-593842659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-51b82107-94aa-427d-8085-4f6dae7f0bec {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:46:02 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-3cff5424-22af-4399-8aa5-84496b6bd191 req-9878080f-64fe-4b32-9ce1-04718efde19c tempest-TestShelveInstance-1002688398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:46:02 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-3cff5424-22af-4399-8aa5-84496b6bd191 req-9878080f-64fe-4b32-9ce1-04718efde19c tempest-TestShelveInstance-1002688398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:46:02 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-3cff5424-22af-4399-8aa5-84496b6bd191 req-9878080f-64fe-4b32-9ce1-04718efde19c tempest-TestShelveInstance-1002688398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:46:02 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [req-3cff5424-22af-4399-8aa5-84496b6bd191 req-9878080f-64fe-4b32-9ce1-04718efde19c tempest-TestShelveInstance-1002688398 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff', 'name': 'volume-45edcf0b-344c-40f8-bf50-766ce05c30ac', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '668f3eb7-2bf9-48c5-96ff-9544dd194289', 'enforce_multipath': True} {{(pid=86136) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 18 21:46:02 devstack sudo[100385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-51b82107-94aa-427d-8085-4f6dae7f0bec Sep 18 21:46:02 devstack sudo[100385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:46:03 devstack cinder-volume[86136]: INFO cinder.volume.manager [req-3cff5424-22af-4399-8aa5-84496b6bd191 req-9878080f-64fe-4b32-9ce1-04718efde19c tempest-TestShelveInstance-1002688398 None] attachment_update completed successfully. Sep 18 21:46:03 devstack sudo[100385]: pam_unix(sudo:session): session closed for user root Sep 18 21:46:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-14e27185-ebaf-4a9e-b747-5df01beac381 tempest-GroupsTest-593842659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-51b82107-94aa-427d-8085-4f6dae7f0bec" returned: 0 in 0.582s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:46:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-14e27185-ebaf-4a9e-b747-5df01beac381 tempest-GroupsTest-593842659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-51b82107-94aa-427d-8085-4f6dae7f0bec {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:46:03 devstack sudo[100390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-51b82107-94aa-427d-8085-4f6dae7f0bec Sep 18 21:46:03 devstack sudo[100390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:46:03 devstack sudo[100390]: pam_unix(sudo:session): session closed for user root Sep 18 21:46:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-14e27185-ebaf-4a9e-b747-5df01beac381 tempest-GroupsTest-593842659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-51b82107-94aa-427d-8085-4f6dae7f0bec" returned: 0 in 0.499s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:46:03 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-14e27185-ebaf-4a9e-b747-5df01beac381 tempest-GroupsTest-593842659 None] Lock "cinder-quobyte-51b82107-94aa-427d-8085-4f6dae7f0bec" released by "delete_volume" :: held 1.183s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:46:03 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-14e27185-ebaf-4a9e-b747-5df01beac381 tempest-GroupsTest-593842659 None] Created reservations ['9a8f42d2-c5a3-4a06-a889-c97f68b4d854'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:46:03 devstack cinder-volume[86136]: WARNING cinder.quota [None req-14e27185-ebaf-4a9e-b747-5df01beac381 tempest-GroupsTest-593842659 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-557330657 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-557330657, it is now deprecated. Please use the default quota class for default quota. Sep 18 21:46:03 devstack cinder-volume[86136]: WARNING cinder.quota [None req-14e27185-ebaf-4a9e-b747-5df01beac381 tempest-GroupsTest-593842659 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-557330657 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-557330657, it is now deprecated. Please use the default quota class for default quota. Sep 18 21:46:04 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-14e27185-ebaf-4a9e-b747-5df01beac381 tempest-GroupsTest-593842659 None] Created reservations ['03c18d36-9543-4892-ac57-75a083ea7c65', '3171f7af-c93b-4c15-9e53-1521dcd007e0', '94cc1f00-f37d-40e9-b2cb-025918e6e324', '77ef1b87-6ae6-4c26-8b14-4cbec33df27c'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:46:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-14e27185-ebaf-4a9e-b747-5df01beac381 tempest-GroupsTest-593842659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:46:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-14e27185-ebaf-4a9e-b747-5df01beac381 tempest-GroupsTest-593842659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:46:04 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-14e27185-ebaf-4a9e-b747-5df01beac381 tempest-GroupsTest-593842659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:46:04 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-14e27185-ebaf-4a9e-b747-5df01beac381 tempest-GroupsTest-593842659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:46:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-14e27185-ebaf-4a9e-b747-5df01beac381 tempest-GroupsTest-593842659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:46:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-14e27185-ebaf-4a9e-b747-5df01beac381 tempest-GroupsTest-593842659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:46:04 devstack sudo[100393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:46:04 devstack sudo[100393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:46:04 devstack sudo[100393]: pam_unix(sudo:session): session closed for user root Sep 18 21:46:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-14e27185-ebaf-4a9e-b747-5df01beac381 tempest-GroupsTest-593842659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.387s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:46:04 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-14e27185-ebaf-4a9e-b747-5df01beac381 tempest-GroupsTest-593842659 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:46:04 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-14e27185-ebaf-4a9e-b747-5df01beac381 tempest-GroupsTest-593842659 None] Delete group completed successfully. Sep 18 21:46:05 devstack cinder-volume[86136]: DEBUG oslo_service.periodic_task [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86136) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 21:46:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:46:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:46:05 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:46:05 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:46:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:46:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:46:05 devstack sudo[100404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:46:05 devstack sudo[100404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:46:05 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-c30ef681-914d-42da-87ca-9dcb9d2f07bb tempest-GroupsTest-593842659 None] Created reservations ['eda364cc-e357-458c-914c-863090decb86'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:46:05 devstack sudo[100404]: pam_unix(sudo:session): session closed for user root Sep 18 21:46:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.557s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:46:05 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:46:05 devstack cinder-volume[86136]: DEBUG oslo_service.periodic_task [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Running periodic task VolumeManager._thread_info {{(pid=86136) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 21:46:05 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] thread count: 28 {{(pid=86136) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 18 21:46:05 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] thread info: [<_MainThread(MainThread, started 138548347871360)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86136) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 18 21:46:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c30ef681-914d-42da-87ca-9dcb9d2f07bb tempest-GroupsTest-593842659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:46:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c30ef681-914d-42da-87ca-9dcb9d2f07bb tempest-GroupsTest-593842659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:46:05 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-c30ef681-914d-42da-87ca-9dcb9d2f07bb tempest-GroupsTest-593842659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:46:05 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-c30ef681-914d-42da-87ca-9dcb9d2f07bb tempest-GroupsTest-593842659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:46:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c30ef681-914d-42da-87ca-9dcb9d2f07bb tempest-GroupsTest-593842659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:46:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c30ef681-914d-42da-87ca-9dcb9d2f07bb tempest-GroupsTest-593842659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:46:05 devstack sudo[100407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:46:05 devstack sudo[100407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:46:06 devstack sudo[100407]: pam_unix(sudo:session): session closed for user root Sep 18 21:46:06 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c30ef681-914d-42da-87ca-9dcb9d2f07bb tempest-GroupsTest-593842659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.386s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:46:06 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-c30ef681-914d-42da-87ca-9dcb9d2f07bb tempest-GroupsTest-593842659 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:46:06 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-c30ef681-914d-42da-87ca-9dcb9d2f07bb tempest-GroupsTest-593842659 None] Delete group completed successfully. Sep 18 21:46:07 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-db9c3d75-9a2d-465e-afe7-80964d248df0 tempest-GroupsTest-593842659 None] Group tempest-GroupsTest-Group-1327227898: creating Sep 18 21:46:07 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-db9c3d75-9a2d-465e-afe7-80964d248df0 tempest-GroupsTest-593842659 None] Group tempest-GroupsTest-Group-1327227898: created successfully Sep 18 21:46:07 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-db9c3d75-9a2d-465e-afe7-80964d248df0 tempest-GroupsTest-593842659 None] Create group completed successfully. Sep 18 21:46:10 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d97ba63-f3e7-4584-8719-6321cb388ec3 tempest-GroupsTest-593842659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:46:10 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6d97ba63-f3e7-4584-8719-6321cb388ec3 tempest-GroupsTest-593842659 None] Flow 'volume_create_manager' (28a52a41-06bd-4556-b0c8-257bc37c6380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:46:10 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6d97ba63-f3e7-4584-8719-6321cb388ec3 tempest-GroupsTest-593842659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7886c021-23f3-449c-b854-c3e6a3d82ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:46:10 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6d97ba63-f3e7-4584-8719-6321cb388ec3 tempest-GroupsTest-593842659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7886c021-23f3-449c-b854-c3e6a3d82ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:46:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-325393428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=83597f06-394a-4033-ad6f-70afd1f6a34b,host='devstack@QuobyteHD#QuobyteHD',id=66822c4b-1b95-4b21-8e6b-8e4f53830fbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ab4e0a5cf214447a2ea75bda5ea5755',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:46:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:46:10Z,use_quota=True,user_id='a9c4ae67b1964718bc9f44063af7de98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f330556d-5640-4d12-b3f9-f6dd216096e6),volume_type_id=f330556d-5640-4d12-b3f9-f6dd216096e6)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:46:10 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6d97ba63-f3e7-4584-8719-6321cb388ec3 tempest-GroupsTest-593842659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22515d4c-1b65-4109-af99-511d2cc1492b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:46:10 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6d97ba63-f3e7-4584-8719-6321cb388ec3 tempest-GroupsTest-593842659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22515d4c-1b65-4109-af99-511d2cc1492b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:46:10 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6d97ba63-f3e7-4584-8719-6321cb388ec3 tempest-GroupsTest-593842659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c7e9b1d-463d-4485-a9db-9f47826bf4ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:46:10 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6d97ba63-f3e7-4584-8719-6321cb388ec3 tempest-GroupsTest-593842659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c7e9b1d-463d-4485-a9db-9f47826bf4ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66822c4b-1b95-4b21-8e6b-8e4f53830fbc', 'volume_name': 'volume-66822c4b-1b95-4b21-8e6b-8e4f53830fbc', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:46:10 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6d97ba63-f3e7-4584-8719-6321cb388ec3 tempest-GroupsTest-593842659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2642491-9231-4fde-9d70-6ad45cdcdcd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:46:10 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6d97ba63-f3e7-4584-8719-6321cb388ec3 tempest-GroupsTest-593842659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2642491-9231-4fde-9d70-6ad45cdcdcd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:46:10 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6d97ba63-f3e7-4584-8719-6321cb388ec3 tempest-GroupsTest-593842659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c66d2fc9-e93d-45b3-9187-90fcd9f44b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:46:10 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-6d97ba63-f3e7-4584-8719-6321cb388ec3 tempest-GroupsTest-593842659 None] Volume 66822c4b-1b95-4b21-8e6b-8e4f53830fbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66822c4b-1b95-4b21-8e6b-8e4f53830fbc', 'volume_size': 1} Sep 18 21:46:10 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6d97ba63-f3e7-4584-8719-6321cb388ec3 tempest-GroupsTest-593842659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:46:10 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6d97ba63-f3e7-4584-8719-6321cb388ec3 tempest-GroupsTest-593842659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:46:10 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-6d97ba63-f3e7-4584-8719-6321cb388ec3 tempest-GroupsTest-593842659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=83597f06-394a-4033-ad6f-70afd1f6a34b,created_at=2026-09-18T19:46:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-325393428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=83597f06-394a-4033-ad6f-70afd1f6a34b,host='devstack@QuobyteHD#QuobyteHD',id=66822c4b-1b95-4b21-8e6b-8e4f53830fbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ab4e0a5cf214447a2ea75bda5ea5755',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:46:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:46:10Z,use_quota=True,user_id='a9c4ae67b1964718bc9f44063af7de98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f330556d-5640-4d12-b3f9-f6dd216096e6),volume_type_id=f330556d-5640-4d12-b3f9-f6dd216096e6)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:46:10 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-6d97ba63-f3e7-4584-8719-6321cb388ec3 tempest-GroupsTest-593842659 None] Creating volume 66822c4b-1b95-4b21-8e6b-8e4f53830fbc {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:46:10 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6d97ba63-f3e7-4584-8719-6321cb388ec3 tempest-GroupsTest-593842659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:46:10 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6d97ba63-f3e7-4584-8719-6321cb388ec3 tempest-GroupsTest-593842659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:46:10 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-6d97ba63-f3e7-4584-8719-6321cb388ec3 tempest-GroupsTest-593842659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:46:10 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-6d97ba63-f3e7-4584-8719-6321cb388ec3 tempest-GroupsTest-593842659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:46:10 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6d97ba63-f3e7-4584-8719-6321cb388ec3 tempest-GroupsTest-593842659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:46:10 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-6d97ba63-f3e7-4584-8719-6321cb388ec3 tempest-GroupsTest-593842659 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:46:10 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-6d97ba63-f3e7-4584-8719-6321cb388ec3 tempest-GroupsTest-593842659 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:46:10 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6d97ba63-f3e7-4584-8719-6321cb388ec3 tempest-GroupsTest-593842659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-66822c4b-1b95-4b21-8e6b-8e4f53830fbc 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:46:10 devstack sudo[100475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-66822c4b-1b95-4b21-8e6b-8e4f53830fbc 1073741824 Sep 18 21:46:10 devstack sudo[100475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:46:11 devstack sudo[100475]: pam_unix(sudo:session): session closed for user root Sep 18 21:46:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6d97ba63-f3e7-4584-8719-6321cb388ec3 tempest-GroupsTest-593842659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-66822c4b-1b95-4b21-8e6b-8e4f53830fbc 1073741824" returned: 0 in 0.617s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:46:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6d97ba63-f3e7-4584-8719-6321cb388ec3 tempest-GroupsTest-593842659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-66822c4b-1b95-4b21-8e6b-8e4f53830fbc {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:46:11 devstack sudo[100483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-66822c4b-1b95-4b21-8e6b-8e4f53830fbc Sep 18 21:46:11 devstack sudo[100483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:46:11 devstack sudo[100483]: pam_unix(sudo:session): session closed for user root Sep 18 21:46:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6d97ba63-f3e7-4584-8719-6321cb388ec3 tempest-GroupsTest-593842659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-66822c4b-1b95-4b21-8e6b-8e4f53830fbc" returned: 0 in 0.503s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:46:11 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-6d97ba63-f3e7-4584-8719-6321cb388ec3 tempest-GroupsTest-593842659 None] <== create_volume: return (1209ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:46:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6d97ba63-f3e7-4584-8719-6321cb388ec3 tempest-GroupsTest-593842659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.217s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:46:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6d97ba63-f3e7-4584-8719-6321cb388ec3 tempest-GroupsTest-593842659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c66d2fc9-e93d-45b3-9187-90fcd9f44b81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66822c4b-1b95-4b21-8e6b-8e4f53830fbc', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:46:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6d97ba63-f3e7-4584-8719-6321cb388ec3 tempest-GroupsTest-593842659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65c14b37-5d75-4374-9530-bab506b8a73b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:46:11 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-6d97ba63-f3e7-4584-8719-6321cb388ec3 tempest-GroupsTest-593842659 None] Volume volume-66822c4b-1b95-4b21-8e6b-8e4f53830fbc (66822c4b-1b95-4b21-8e6b-8e4f53830fbc): created successfully Sep 18 21:46:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6d97ba63-f3e7-4584-8719-6321cb388ec3 tempest-GroupsTest-593842659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65c14b37-5d75-4374-9530-bab506b8a73b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:46:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6d97ba63-f3e7-4584-8719-6321cb388ec3 tempest-GroupsTest-593842659 None] Flow 'volume_create_manager' (28a52a41-06bd-4556-b0c8-257bc37c6380) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:46:11 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-6d97ba63-f3e7-4584-8719-6321cb388ec3 tempest-GroupsTest-593842659 None] Created volume successfully. Sep 18 21:46:14 devstack cinder-volume[86136]: DEBUG dbcounter [-] [86136] Writing DB stats cinder:SELECT=103,cinder:UPDATE=99,cinder:INSERT=37,cinder:DELETE=2 {{(pid=86136) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 21:46:14 devstack cinder-volume[86136]: DEBUG dbcounter [-] [86136] Writing DB stats cinder:UPDATE=100,cinder:SELECT=115,cinder:INSERT=20,cinder:DELETE=4 {{(pid=86136) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 21:46:14 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e4cd509-233d-4daf-a6a4-61ab8d33ba27 tempest-GroupsTest-593842659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:46:14 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6e4cd509-233d-4daf-a6a4-61ab8d33ba27 tempest-GroupsTest-593842659 None] Flow 'volume_create_manager' (5e40c57a-37aa-4d17-a4e7-3c5cc4e86bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:46:14 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6e4cd509-233d-4daf-a6a4-61ab8d33ba27 tempest-GroupsTest-593842659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f05db41-4e85-4b89-a2d0-8effe8a90bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:46:14 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6e4cd509-233d-4daf-a6a4-61ab8d33ba27 tempest-GroupsTest-593842659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f05db41-4e85-4b89-a2d0-8effe8a90bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:46:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1921469158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=83597f06-394a-4033-ad6f-70afd1f6a34b,host='devstack@QuobyteHD#QuobyteHD',id=d3282fd3-521d-4fa9-9124-6b4c5443c2a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ab4e0a5cf214447a2ea75bda5ea5755',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:46:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:46:14Z,use_quota=True,user_id='a9c4ae67b1964718bc9f44063af7de98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f330556d-5640-4d12-b3f9-f6dd216096e6),volume_type_id=f330556d-5640-4d12-b3f9-f6dd216096e6)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:46:14 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6e4cd509-233d-4daf-a6a4-61ab8d33ba27 tempest-GroupsTest-593842659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e247f390-87e0-498b-be35-009abce44a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:46:14 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6e4cd509-233d-4daf-a6a4-61ab8d33ba27 tempest-GroupsTest-593842659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e247f390-87e0-498b-be35-009abce44a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:46:14 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6e4cd509-233d-4daf-a6a4-61ab8d33ba27 tempest-GroupsTest-593842659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc2558ad-d7dc-4b46-a201-5fa931e69e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:46:14 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6e4cd509-233d-4daf-a6a4-61ab8d33ba27 tempest-GroupsTest-593842659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc2558ad-d7dc-4b46-a201-5fa931e69e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3282fd3-521d-4fa9-9124-6b4c5443c2a0', 'volume_name': 'volume-d3282fd3-521d-4fa9-9124-6b4c5443c2a0', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:46:14 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6e4cd509-233d-4daf-a6a4-61ab8d33ba27 tempest-GroupsTest-593842659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92e40df6-7a7e-4068-aa74-038b20760059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:46:14 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6e4cd509-233d-4daf-a6a4-61ab8d33ba27 tempest-GroupsTest-593842659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92e40df6-7a7e-4068-aa74-038b20760059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:46:14 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6e4cd509-233d-4daf-a6a4-61ab8d33ba27 tempest-GroupsTest-593842659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3d7090b-c978-47b3-a483-15f59625902a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:46:14 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-6e4cd509-233d-4daf-a6a4-61ab8d33ba27 tempest-GroupsTest-593842659 None] Volume d3282fd3-521d-4fa9-9124-6b4c5443c2a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3282fd3-521d-4fa9-9124-6b4c5443c2a0', 'volume_size': 1} Sep 18 21:46:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6e4cd509-233d-4daf-a6a4-61ab8d33ba27 tempest-GroupsTest-593842659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:46:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6e4cd509-233d-4daf-a6a4-61ab8d33ba27 tempest-GroupsTest-593842659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:46:14 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-6e4cd509-233d-4daf-a6a4-61ab8d33ba27 tempest-GroupsTest-593842659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=83597f06-394a-4033-ad6f-70afd1f6a34b,created_at=2026-09-18T19:46:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1921469158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=83597f06-394a-4033-ad6f-70afd1f6a34b,host='devstack@QuobyteHD#QuobyteHD',id=d3282fd3-521d-4fa9-9124-6b4c5443c2a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ab4e0a5cf214447a2ea75bda5ea5755',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:46:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:46:14Z,use_quota=True,user_id='a9c4ae67b1964718bc9f44063af7de98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f330556d-5640-4d12-b3f9-f6dd216096e6),volume_type_id=f330556d-5640-4d12-b3f9-f6dd216096e6)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:46:14 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-6e4cd509-233d-4daf-a6a4-61ab8d33ba27 tempest-GroupsTest-593842659 None] Creating volume d3282fd3-521d-4fa9-9124-6b4c5443c2a0 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:46:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6e4cd509-233d-4daf-a6a4-61ab8d33ba27 tempest-GroupsTest-593842659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:46:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6e4cd509-233d-4daf-a6a4-61ab8d33ba27 tempest-GroupsTest-593842659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:46:14 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-6e4cd509-233d-4daf-a6a4-61ab8d33ba27 tempest-GroupsTest-593842659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:46:14 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-6e4cd509-233d-4daf-a6a4-61ab8d33ba27 tempest-GroupsTest-593842659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:46:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6e4cd509-233d-4daf-a6a4-61ab8d33ba27 tempest-GroupsTest-593842659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:46:14 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-6e4cd509-233d-4daf-a6a4-61ab8d33ba27 tempest-GroupsTest-593842659 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:46:14 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-6e4cd509-233d-4daf-a6a4-61ab8d33ba27 tempest-GroupsTest-593842659 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:46:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6e4cd509-233d-4daf-a6a4-61ab8d33ba27 tempest-GroupsTest-593842659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-d3282fd3-521d-4fa9-9124-6b4c5443c2a0 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:46:14 devstack sudo[100490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-d3282fd3-521d-4fa9-9124-6b4c5443c2a0 1073741824 Sep 18 21:46:14 devstack sudo[100490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:46:15 devstack sudo[100490]: pam_unix(sudo:session): session closed for user root Sep 18 21:46:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6e4cd509-233d-4daf-a6a4-61ab8d33ba27 tempest-GroupsTest-593842659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-d3282fd3-521d-4fa9-9124-6b4c5443c2a0 1073741824" returned: 0 in 0.708s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:46:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6e4cd509-233d-4daf-a6a4-61ab8d33ba27 tempest-GroupsTest-593842659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-d3282fd3-521d-4fa9-9124-6b4c5443c2a0 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:46:15 devstack sudo[100496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-d3282fd3-521d-4fa9-9124-6b4c5443c2a0 Sep 18 21:46:15 devstack sudo[100496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:46:15 devstack sudo[100496]: pam_unix(sudo:session): session closed for user root Sep 18 21:46:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6e4cd509-233d-4daf-a6a4-61ab8d33ba27 tempest-GroupsTest-593842659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-d3282fd3-521d-4fa9-9124-6b4c5443c2a0" returned: 0 in 0.306s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:46:15 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-6e4cd509-233d-4daf-a6a4-61ab8d33ba27 tempest-GroupsTest-593842659 None] <== create_volume: return (1136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:46:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6e4cd509-233d-4daf-a6a4-61ab8d33ba27 tempest-GroupsTest-593842659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:46:15 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6e4cd509-233d-4daf-a6a4-61ab8d33ba27 tempest-GroupsTest-593842659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3d7090b-c978-47b3-a483-15f59625902a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3282fd3-521d-4fa9-9124-6b4c5443c2a0', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:46:15 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6e4cd509-233d-4daf-a6a4-61ab8d33ba27 tempest-GroupsTest-593842659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f865b45-2c73-4797-a882-0de819f0b4be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:46:15 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-6e4cd509-233d-4daf-a6a4-61ab8d33ba27 tempest-GroupsTest-593842659 None] Volume volume-d3282fd3-521d-4fa9-9124-6b4c5443c2a0 (d3282fd3-521d-4fa9-9124-6b4c5443c2a0): created successfully Sep 18 21:46:15 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6e4cd509-233d-4daf-a6a4-61ab8d33ba27 tempest-GroupsTest-593842659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f865b45-2c73-4797-a882-0de819f0b4be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:46:15 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6e4cd509-233d-4daf-a6a4-61ab8d33ba27 tempest-GroupsTest-593842659 None] Flow 'volume_create_manager' (5e40c57a-37aa-4d17-a4e7-3c5cc4e86bc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:46:15 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-6e4cd509-233d-4daf-a6a4-61ab8d33ba27 tempest-GroupsTest-593842659 None] Created volume successfully. Sep 18 21:46:16 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-c6d3243e-0390-42fc-93c4-4a40e57606b6 tempest-GroupsTest-593842659 None] Update group completed successfully. Sep 18 21:46:18 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-15943a28-3fbe-49f4-9dd3-77d7696160f8 tempest-GroupsTest-593842659 None] Update group completed successfully. Sep 18 21:46:19 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a543c6d-d765-4788-ba9d-3a33380998e2 tempest-TestStampPattern-580697789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:46:19 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9a543c6d-d765-4788-ba9d-3a33380998e2 tempest-TestStampPattern-580697789 None] Flow 'volume_create_manager' (beaf1b42-de13-40fc-a6b1-53295c3fdf56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:46:19 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9a543c6d-d765-4788-ba9d-3a33380998e2 tempest-TestStampPattern-580697789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4edfcff1-26bc-4e7e-8fe9-342e0a1205dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:46:19 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9a543c6d-d765-4788-ba9d-3a33380998e2 tempest-TestStampPattern-580697789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4edfcff1-26bc-4e7e-8fe9-342e0a1205dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:46:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1090689981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6eaf836-5be5-4ea9-a3b4-497ffeaa19df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b245feedd48146d1b794023eb000c839',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:46:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:46:19Z,use_quota=True,user_id='96da43a2f59c470db810c162533a0558',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:46:19 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9a543c6d-d765-4788-ba9d-3a33380998e2 tempest-TestStampPattern-580697789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ebccc83-36b0-49ea-91a2-db014b15dc5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:46:19 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9a543c6d-d765-4788-ba9d-3a33380998e2 tempest-TestStampPattern-580697789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ebccc83-36b0-49ea-91a2-db014b15dc5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:46:19 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9a543c6d-d765-4788-ba9d-3a33380998e2 tempest-TestStampPattern-580697789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0455783f-a242-4808-bffa-438d2d4d4390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:46:19 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9a543c6d-d765-4788-ba9d-3a33380998e2 tempest-TestStampPattern-580697789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0455783f-a242-4808-bffa-438d2d4d4390) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6eaf836-5be5-4ea9-a3b4-497ffeaa19df', 'volume_name': 'volume-a6eaf836-5be5-4ea9-a3b4-497ffeaa19df', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:46:19 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9a543c6d-d765-4788-ba9d-3a33380998e2 tempest-TestStampPattern-580697789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (703b18d5-e0bd-44c0-a20f-11b1d25ddefe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:46:19 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9a543c6d-d765-4788-ba9d-3a33380998e2 tempest-TestStampPattern-580697789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (703b18d5-e0bd-44c0-a20f-11b1d25ddefe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:46:19 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9a543c6d-d765-4788-ba9d-3a33380998e2 tempest-TestStampPattern-580697789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23a0bd6b-037d-4a11-be82-ef835241d549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:46:19 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-9a543c6d-d765-4788-ba9d-3a33380998e2 tempest-TestStampPattern-580697789 None] Volume a6eaf836-5be5-4ea9-a3b4-497ffeaa19df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6eaf836-5be5-4ea9-a3b4-497ffeaa19df', 'volume_size': 1} Sep 18 21:46:19 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-9a543c6d-d765-4788-ba9d-3a33380998e2 tempest-TestStampPattern-580697789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:46:19 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-9a543c6d-d765-4788-ba9d-3a33380998e2 tempest-TestStampPattern-580697789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:46:19 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-9a543c6d-d765-4788-ba9d-3a33380998e2 tempest-TestStampPattern-580697789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:46:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1090689981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6eaf836-5be5-4ea9-a3b4-497ffeaa19df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b245feedd48146d1b794023eb000c839',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:46:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:46:19Z,use_quota=True,user_id='96da43a2f59c470db810c162533a0558',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:46:19 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-9a543c6d-d765-4788-ba9d-3a33380998e2 tempest-TestStampPattern-580697789 None] Creating volume a6eaf836-5be5-4ea9-a3b4-497ffeaa19df {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:46:19 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-9a543c6d-d765-4788-ba9d-3a33380998e2 tempest-TestStampPattern-580697789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:46:19 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-9a543c6d-d765-4788-ba9d-3a33380998e2 tempest-TestStampPattern-580697789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:46:19 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-9a543c6d-d765-4788-ba9d-3a33380998e2 tempest-TestStampPattern-580697789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:46:19 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-9a543c6d-d765-4788-ba9d-3a33380998e2 tempest-TestStampPattern-580697789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:46:19 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-9a543c6d-d765-4788-ba9d-3a33380998e2 tempest-TestStampPattern-580697789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:46:19 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-9a543c6d-d765-4788-ba9d-3a33380998e2 tempest-TestStampPattern-580697789 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:46:19 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-9a543c6d-d765-4788-ba9d-3a33380998e2 tempest-TestStampPattern-580697789 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:46:19 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9a543c6d-d765-4788-ba9d-3a33380998e2 tempest-TestStampPattern-580697789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a6eaf836-5be5-4ea9-a3b4-497ffeaa19df 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:46:19 devstack sudo[100503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a6eaf836-5be5-4ea9-a3b4-497ffeaa19df 1073741824 Sep 18 21:46:19 devstack sudo[100503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:46:19 devstack sudo[100503]: pam_unix(sudo:session): session closed for user root Sep 18 21:46:19 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9a543c6d-d765-4788-ba9d-3a33380998e2 tempest-TestStampPattern-580697789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a6eaf836-5be5-4ea9-a3b4-497ffeaa19df 1073741824" returned: 0 in 0.648s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:46:19 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9a543c6d-d765-4788-ba9d-3a33380998e2 tempest-TestStampPattern-580697789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a6eaf836-5be5-4ea9-a3b4-497ffeaa19df {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:46:19 devstack sudo[100509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a6eaf836-5be5-4ea9-a3b4-497ffeaa19df Sep 18 21:46:19 devstack sudo[100509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:46:20 devstack sudo[100509]: pam_unix(sudo:session): session closed for user root Sep 18 21:46:20 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9a543c6d-d765-4788-ba9d-3a33380998e2 tempest-TestStampPattern-580697789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a6eaf836-5be5-4ea9-a3b4-497ffeaa19df" returned: 0 in 0.352s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:46:20 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-9a543c6d-d765-4788-ba9d-3a33380998e2 tempest-TestStampPattern-580697789 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:46:20 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-9a543c6d-d765-4788-ba9d-3a33380998e2 tempest-TestStampPattern-580697789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:46:20 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9a543c6d-d765-4788-ba9d-3a33380998e2 tempest-TestStampPattern-580697789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23a0bd6b-037d-4a11-be82-ef835241d549) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6eaf836-5be5-4ea9-a3b4-497ffeaa19df', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:46:20 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9a543c6d-d765-4788-ba9d-3a33380998e2 tempest-TestStampPattern-580697789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95510a9b-519c-486b-a0e5-90fa1ff58ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:46:20 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-9a543c6d-d765-4788-ba9d-3a33380998e2 tempest-TestStampPattern-580697789 None] Volume volume-a6eaf836-5be5-4ea9-a3b4-497ffeaa19df (a6eaf836-5be5-4ea9-a3b4-497ffeaa19df): created successfully Sep 18 21:46:20 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9a543c6d-d765-4788-ba9d-3a33380998e2 tempest-TestStampPattern-580697789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95510a9b-519c-486b-a0e5-90fa1ff58ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:46:20 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9a543c6d-d765-4788-ba9d-3a33380998e2 tempest-TestStampPattern-580697789 None] Flow 'volume_create_manager' (beaf1b42-de13-40fc-a6b1-53295c3fdf56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:46:20 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-9a543c6d-d765-4788-ba9d-3a33380998e2 tempest-TestStampPattern-580697789 None] Created volume successfully. Sep 18 21:46:20 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-496d894b-c962-4d27-99c1-ad7bcd4e82b2 tempest-GroupsTest-593842659 None] Acquiring lock "cinder-quobyte-66822c4b-1b95-4b21-8e6b-8e4f53830fbc" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:46:20 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-496d894b-c962-4d27-99c1-ad7bcd4e82b2 tempest-GroupsTest-593842659 None] Lock "cinder-quobyte-66822c4b-1b95-4b21-8e6b-8e4f53830fbc" acquired by "delete_volume" :: waited 0.027s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:46:20 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[f606426c-f121-464b-999c-4a1ccef1b82e]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:46:20 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-496d894b-c962-4d27-99c1-ad7bcd4e82b2 tempest-GroupsTest-593842659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-66822c4b-1b95-4b21-8e6b-8e4f53830fbc {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:46:20 devstack sudo[100518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-66822c4b-1b95-4b21-8e6b-8e4f53830fbc Sep 18 21:46:20 devstack sudo[100518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:46:21 devstack sudo[100518]: pam_unix(sudo:session): session closed for user root Sep 18 21:46:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-496d894b-c962-4d27-99c1-ad7bcd4e82b2 tempest-GroupsTest-593842659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-66822c4b-1b95-4b21-8e6b-8e4f53830fbc" returned: 0 in 0.626s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:46:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-496d894b-c962-4d27-99c1-ad7bcd4e82b2 tempest-GroupsTest-593842659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-66822c4b-1b95-4b21-8e6b-8e4f53830fbc {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:46:21 devstack sudo[100559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-66822c4b-1b95-4b21-8e6b-8e4f53830fbc Sep 18 21:46:21 devstack sudo[100559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:46:21 devstack sudo[100559]: pam_unix(sudo:session): session closed for user root Sep 18 21:46:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-496d894b-c962-4d27-99c1-ad7bcd4e82b2 tempest-GroupsTest-593842659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-66822c4b-1b95-4b21-8e6b-8e4f53830fbc" returned: 0 in 0.536s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:46:21 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-496d894b-c962-4d27-99c1-ad7bcd4e82b2 tempest-GroupsTest-593842659 None] Lock "cinder-quobyte-66822c4b-1b95-4b21-8e6b-8e4f53830fbc" released by "delete_volume" :: held 1.229s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:46:21 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-496d894b-c962-4d27-99c1-ad7bcd4e82b2 tempest-GroupsTest-593842659 None] Acquiring lock "cinder-quobyte-d3282fd3-521d-4fa9-9124-6b4c5443c2a0" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:46:21 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-496d894b-c962-4d27-99c1-ad7bcd4e82b2 tempest-GroupsTest-593842659 None] Lock "cinder-quobyte-d3282fd3-521d-4fa9-9124-6b4c5443c2a0" acquired by "delete_volume" :: waited 0.033s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:46:21 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c1d2fc-20aa-4021-b82f-3e2552649248]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:46:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-496d894b-c962-4d27-99c1-ad7bcd4e82b2 tempest-GroupsTest-593842659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-d3282fd3-521d-4fa9-9124-6b4c5443c2a0 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:46:22 devstack sudo[100564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-d3282fd3-521d-4fa9-9124-6b4c5443c2a0 Sep 18 21:46:22 devstack sudo[100564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:46:22 devstack sudo[100564]: pam_unix(sudo:session): session closed for user root Sep 18 21:46:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-496d894b-c962-4d27-99c1-ad7bcd4e82b2 tempest-GroupsTest-593842659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-d3282fd3-521d-4fa9-9124-6b4c5443c2a0" returned: 0 in 0.738s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:46:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-496d894b-c962-4d27-99c1-ad7bcd4e82b2 tempest-GroupsTest-593842659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-d3282fd3-521d-4fa9-9124-6b4c5443c2a0 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:46:22 devstack sudo[100571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-d3282fd3-521d-4fa9-9124-6b4c5443c2a0 Sep 18 21:46:22 devstack sudo[100571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:46:23 devstack sudo[100571]: pam_unix(sudo:session): session closed for user root Sep 18 21:46:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-496d894b-c962-4d27-99c1-ad7bcd4e82b2 tempest-GroupsTest-593842659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-d3282fd3-521d-4fa9-9124-6b4c5443c2a0" returned: 0 in 0.568s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:46:23 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-496d894b-c962-4d27-99c1-ad7bcd4e82b2 tempest-GroupsTest-593842659 None] Lock "cinder-quobyte-d3282fd3-521d-4fa9-9124-6b4c5443c2a0" released by "delete_volume" :: held 1.416s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:46:23 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-496d894b-c962-4d27-99c1-ad7bcd4e82b2 tempest-GroupsTest-593842659 None] Created reservations ['eeaa1a7c-cd92-44d6-b51c-6303087b94c3'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:46:23 devstack cinder-volume[86136]: WARNING cinder.quota [None req-496d894b-c962-4d27-99c1-ad7bcd4e82b2 tempest-GroupsTest-593842659 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-158111571 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-158111571, it is now deprecated. Please use the default quota class for default quota. Sep 18 21:46:23 devstack cinder-volume[86136]: WARNING cinder.quota [None req-496d894b-c962-4d27-99c1-ad7bcd4e82b2 tempest-GroupsTest-593842659 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-158111571 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-158111571, it is now deprecated. Please use the default quota class for default quota. Sep 18 21:46:23 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-496d894b-c962-4d27-99c1-ad7bcd4e82b2 tempest-GroupsTest-593842659 None] Created reservations ['a9b68bb7-fbd7-418b-83d2-d9686bb3a418', '38e16d10-31f9-4fd5-8e3f-9427dbbe7508', 'fad300dc-2e02-41b4-8543-5dc232f3443b', '277c5c21-4fdb-420e-bcd4-3677d90f3f53'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:46:23 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-496d894b-c962-4d27-99c1-ad7bcd4e82b2 tempest-GroupsTest-593842659 None] Created reservations ['8c8a0478-ccb4-4b0f-97ef-fb601b1a9873', '6e609303-adbf-4d18-8cb3-3078636bf5dd', 'f4f5fd31-74b9-4b63-9e5d-3e2eacb2864a', 'ebd2f7d3-27ec-4f44-87e8-67fe44ef56ad'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:46:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-496d894b-c962-4d27-99c1-ad7bcd4e82b2 tempest-GroupsTest-593842659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:46:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-496d894b-c962-4d27-99c1-ad7bcd4e82b2 tempest-GroupsTest-593842659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:46:23 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-496d894b-c962-4d27-99c1-ad7bcd4e82b2 tempest-GroupsTest-593842659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:46:23 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-496d894b-c962-4d27-99c1-ad7bcd4e82b2 tempest-GroupsTest-593842659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:46:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-496d894b-c962-4d27-99c1-ad7bcd4e82b2 tempest-GroupsTest-593842659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:46:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-496d894b-c962-4d27-99c1-ad7bcd4e82b2 tempest-GroupsTest-593842659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:46:23 devstack sudo[100589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:46:23 devstack sudo[100589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:46:24 devstack sudo[100589]: pam_unix(sudo:session): session closed for user root Sep 18 21:46:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-496d894b-c962-4d27-99c1-ad7bcd4e82b2 tempest-GroupsTest-593842659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.374s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:46:24 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-496d894b-c962-4d27-99c1-ad7bcd4e82b2 tempest-GroupsTest-593842659 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:46:24 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-496d894b-c962-4d27-99c1-ad7bcd4e82b2 tempest-GroupsTest-593842659 None] Delete group completed successfully. Sep 18 21:46:26 devstack cinder-volume[86136]: INFO cinder.volume.manager [req-7fcf5a31-716c-4636-8903-b1fde9188b88 req-54275733-06c9-411e-b1fe-473265f0b60f tempest-TestMinimumBasicScenario-579410959 None] Terminate volume connection completed successfully. Sep 18 21:46:26 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [req-7fcf5a31-716c-4636-8903-b1fde9188b88 req-54275733-06c9-411e-b1fe-473265f0b60f tempest-TestMinimumBasicScenario-579410959 None] Deleting attachment 2e9d887e-e567-493b-a44f-ec0af86f747e. {{(pid=86136) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 18 21:46:27 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-f717a710-19c0-44eb-b3e3-61cfd99d51f4 tempest-TestMinimumBasicScenario-579410959 None] Acquiring lock "cinder-a15151cf-4aaf-48ba-9d6a-4c13bfdddcdb-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:46:27 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-f717a710-19c0-44eb-b3e3-61cfd99d51f4 tempest-TestMinimumBasicScenario-579410959 None] Lock "cinder-a15151cf-4aaf-48ba-9d6a-4c13bfdddcdb-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:46:27 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-f717a710-19c0-44eb-b3e3-61cfd99d51f4 tempest-TestMinimumBasicScenario-579410959 None] Acquiring lock "cinder-quobyte-a15151cf-4aaf-48ba-9d6a-4c13bfdddcdb" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:46:27 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-f717a710-19c0-44eb-b3e3-61cfd99d51f4 tempest-TestMinimumBasicScenario-579410959 None] Lock "cinder-quobyte-a15151cf-4aaf-48ba-9d6a-4c13bfdddcdb" acquired by "delete_volume" :: waited 0.023s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:46:27 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[011e7279-abc8-4c03-9d2f-74420c06fc11]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:46:27 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f717a710-19c0-44eb-b3e3-61cfd99d51f4 tempest-TestMinimumBasicScenario-579410959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a15151cf-4aaf-48ba-9d6a-4c13bfdddcdb {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:46:27 devstack sudo[100642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a15151cf-4aaf-48ba-9d6a-4c13bfdddcdb Sep 18 21:46:27 devstack sudo[100642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:46:28 devstack sudo[100642]: pam_unix(sudo:session): session closed for user root Sep 18 21:46:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f717a710-19c0-44eb-b3e3-61cfd99d51f4 tempest-TestMinimumBasicScenario-579410959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a15151cf-4aaf-48ba-9d6a-4c13bfdddcdb" returned: 0 in 1.076s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:46:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f717a710-19c0-44eb-b3e3-61cfd99d51f4 tempest-TestMinimumBasicScenario-579410959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a15151cf-4aaf-48ba-9d6a-4c13bfdddcdb {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:46:28 devstack sudo[100675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a15151cf-4aaf-48ba-9d6a-4c13bfdddcdb Sep 18 21:46:28 devstack sudo[100675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:46:29 devstack sudo[100675]: pam_unix(sudo:session): session closed for user root Sep 18 21:46:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f717a710-19c0-44eb-b3e3-61cfd99d51f4 tempest-TestMinimumBasicScenario-579410959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a15151cf-4aaf-48ba-9d6a-4c13bfdddcdb" returned: 0 in 0.601s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:46:29 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-f717a710-19c0-44eb-b3e3-61cfd99d51f4 tempest-TestMinimumBasicScenario-579410959 None] Lock "cinder-quobyte-a15151cf-4aaf-48ba-9d6a-4c13bfdddcdb" released by "delete_volume" :: held 1.807s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:46:29 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-f717a710-19c0-44eb-b3e3-61cfd99d51f4 tempest-TestMinimumBasicScenario-579410959 None] Created reservations ['580087dc-54fd-4f91-952d-c340691ef256', '33477fdd-cb94-46da-ac5a-e986f212f1b9', 'f783fea0-6106-4e72-9fd8-73c2c0d88c12', 'e03f4682-1356-436f-b89d-fb50ca08991c'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:46:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-f717a710-19c0-44eb-b3e3-61cfd99d51f4 tempest-TestMinimumBasicScenario-579410959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:46:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-f717a710-19c0-44eb-b3e3-61cfd99d51f4 tempest-TestMinimumBasicScenario-579410959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:46:29 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-f717a710-19c0-44eb-b3e3-61cfd99d51f4 tempest-TestMinimumBasicScenario-579410959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:46:29 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-f717a710-19c0-44eb-b3e3-61cfd99d51f4 tempest-TestMinimumBasicScenario-579410959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:46:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-f717a710-19c0-44eb-b3e3-61cfd99d51f4 tempest-TestMinimumBasicScenario-579410959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:46:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f717a710-19c0-44eb-b3e3-61cfd99d51f4 tempest-TestMinimumBasicScenario-579410959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:46:29 devstack sudo[100681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:46:29 devstack sudo[100681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:46:29 devstack sudo[100681]: pam_unix(sudo:session): session closed for user root Sep 18 21:46:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f717a710-19c0-44eb-b3e3-61cfd99d51f4 tempest-TestMinimumBasicScenario-579410959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.392s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:46:29 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-f717a710-19c0-44eb-b3e3-61cfd99d51f4 tempest-TestMinimumBasicScenario-579410959 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:46:29 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-f717a710-19c0-44eb-b3e3-61cfd99d51f4 tempest-TestMinimumBasicScenario-579410959 None] Deleted volume successfully. Sep 18 21:46:30 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-f717a710-19c0-44eb-b3e3-61cfd99d51f4 tempest-TestMinimumBasicScenario-579410959 None] Lock "cinder-a15151cf-4aaf-48ba-9d6a-4c13bfdddcdb-delete_volume" released by "delete_volume" :: held 2.721s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:46:39 devstack cinder-volume[86136]: DEBUG dbcounter [-] [86136] Writing DB stats cinder:SELECT=30,cinder:UPDATE=35,cinder:INSERT=8,cinder:DELETE=1 {{(pid=86136) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 21:46:39 devstack cinder-volume[86136]: DEBUG dbcounter [-] [86136] Writing DB stats cinder:SELECT=23,cinder:UPDATE=33,cinder:DELETE=2,cinder:INSERT=7 {{(pid=86136) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 21:46:43 devstack cinder-volume[86136]: INFO cinder.volume.manager [req-a6e88fb4-1910-43bb-9bfe-f20d858ded4e req-33254844-0d9a-455f-a2c5-e65974b1ea25 tempest-TestShelveInstance-1002688398 None] Terminate volume connection completed successfully. Sep 18 21:46:43 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [req-a6e88fb4-1910-43bb-9bfe-f20d858ded4e req-33254844-0d9a-455f-a2c5-e65974b1ea25 tempest-TestShelveInstance-1002688398 None] Deleting attachment 668f3eb7-2bf9-48c5-96ff-9544dd194289. {{(pid=86136) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 18 21:46:45 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c6487d9-73d9-40a8-852f-53343e8dacc3 tempest-VolumesServicesTestJSON-753939982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:46:45 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6c6487d9-73d9-40a8-852f-53343e8dacc3 tempest-VolumesServicesTestJSON-753939982 None] Flow 'volume_create_manager' (2bcc34c6-f191-47b1-90a6-e5ab057a464f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:46:45 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6c6487d9-73d9-40a8-852f-53343e8dacc3 tempest-VolumesServicesTestJSON-753939982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f4f20b4-551d-4c86-9f26-44717cf1b3aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:46:45 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6c6487d9-73d9-40a8-852f-53343e8dacc3 tempest-VolumesServicesTestJSON-753939982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f4f20b4-551d-4c86-9f26-44717cf1b3aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:46:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-610169441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63a1731e-9abc-4348-bc28-1ee59b27c47f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98c111c9c62648ea92af4f8236b849d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:46:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:46:45Z,use_quota=True,user_id='272f2f314f8e493489e44b079ce5a595',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:46:45 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6c6487d9-73d9-40a8-852f-53343e8dacc3 tempest-VolumesServicesTestJSON-753939982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d28f8f30-8e2b-47c6-9cf4-bca29ce40804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:46:45 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6c6487d9-73d9-40a8-852f-53343e8dacc3 tempest-VolumesServicesTestJSON-753939982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d28f8f30-8e2b-47c6-9cf4-bca29ce40804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:46:45 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6c6487d9-73d9-40a8-852f-53343e8dacc3 tempest-VolumesServicesTestJSON-753939982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b1e570a-9b41-4717-b890-03348bc6beb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:46:45 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6c6487d9-73d9-40a8-852f-53343e8dacc3 tempest-VolumesServicesTestJSON-753939982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b1e570a-9b41-4717-b890-03348bc6beb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63a1731e-9abc-4348-bc28-1ee59b27c47f', 'volume_name': 'volume-63a1731e-9abc-4348-bc28-1ee59b27c47f', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:46:45 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6c6487d9-73d9-40a8-852f-53343e8dacc3 tempest-VolumesServicesTestJSON-753939982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e4edfe0-d31c-426c-8e69-87098bf5729a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:46:45 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6c6487d9-73d9-40a8-852f-53343e8dacc3 tempest-VolumesServicesTestJSON-753939982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e4edfe0-d31c-426c-8e69-87098bf5729a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:46:45 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6c6487d9-73d9-40a8-852f-53343e8dacc3 tempest-VolumesServicesTestJSON-753939982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (502d0c9e-172d-4c9d-b4a8-9eb47295a640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:46:45 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-6c6487d9-73d9-40a8-852f-53343e8dacc3 tempest-VolumesServicesTestJSON-753939982 None] Volume 63a1731e-9abc-4348-bc28-1ee59b27c47f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63a1731e-9abc-4348-bc28-1ee59b27c47f', 'volume_size': 1} Sep 18 21:46:45 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6c6487d9-73d9-40a8-852f-53343e8dacc3 tempest-VolumesServicesTestJSON-753939982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:46:45 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6c6487d9-73d9-40a8-852f-53343e8dacc3 tempest-VolumesServicesTestJSON-753939982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:46:45 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-6c6487d9-73d9-40a8-852f-53343e8dacc3 tempest-VolumesServicesTestJSON-753939982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:46:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-610169441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63a1731e-9abc-4348-bc28-1ee59b27c47f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98c111c9c62648ea92af4f8236b849d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:46:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:46:45Z,use_quota=True,user_id='272f2f314f8e493489e44b079ce5a595',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:46:45 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-6c6487d9-73d9-40a8-852f-53343e8dacc3 tempest-VolumesServicesTestJSON-753939982 None] Creating volume 63a1731e-9abc-4348-bc28-1ee59b27c47f {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:46:45 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6c6487d9-73d9-40a8-852f-53343e8dacc3 tempest-VolumesServicesTestJSON-753939982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:46:45 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6c6487d9-73d9-40a8-852f-53343e8dacc3 tempest-VolumesServicesTestJSON-753939982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:46:45 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-6c6487d9-73d9-40a8-852f-53343e8dacc3 tempest-VolumesServicesTestJSON-753939982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:46:45 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-6c6487d9-73d9-40a8-852f-53343e8dacc3 tempest-VolumesServicesTestJSON-753939982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:46:45 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6c6487d9-73d9-40a8-852f-53343e8dacc3 tempest-VolumesServicesTestJSON-753939982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:46:45 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-6c6487d9-73d9-40a8-852f-53343e8dacc3 tempest-VolumesServicesTestJSON-753939982 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:46:45 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-6c6487d9-73d9-40a8-852f-53343e8dacc3 tempest-VolumesServicesTestJSON-753939982 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:46:45 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6c6487d9-73d9-40a8-852f-53343e8dacc3 tempest-VolumesServicesTestJSON-753939982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-63a1731e-9abc-4348-bc28-1ee59b27c47f 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:46:45 devstack sudo[100776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-63a1731e-9abc-4348-bc28-1ee59b27c47f 1073741824 Sep 18 21:46:45 devstack sudo[100776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:46:46 devstack sudo[100776]: pam_unix(sudo:session): session closed for user root Sep 18 21:46:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6c6487d9-73d9-40a8-852f-53343e8dacc3 tempest-VolumesServicesTestJSON-753939982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-63a1731e-9abc-4348-bc28-1ee59b27c47f 1073741824" returned: 0 in 0.487s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:46:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6c6487d9-73d9-40a8-852f-53343e8dacc3 tempest-VolumesServicesTestJSON-753939982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-63a1731e-9abc-4348-bc28-1ee59b27c47f {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:46:46 devstack sudo[100782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-63a1731e-9abc-4348-bc28-1ee59b27c47f Sep 18 21:46:46 devstack sudo[100782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:46:46 devstack sudo[100782]: pam_unix(sudo:session): session closed for user root Sep 18 21:46:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6c6487d9-73d9-40a8-852f-53343e8dacc3 tempest-VolumesServicesTestJSON-753939982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-63a1731e-9abc-4348-bc28-1ee59b27c47f" returned: 0 in 0.321s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:46:46 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-6c6487d9-73d9-40a8-852f-53343e8dacc3 tempest-VolumesServicesTestJSON-753939982 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:46:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6c6487d9-73d9-40a8-852f-53343e8dacc3 tempest-VolumesServicesTestJSON-753939982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:46:46 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6c6487d9-73d9-40a8-852f-53343e8dacc3 tempest-VolumesServicesTestJSON-753939982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (502d0c9e-172d-4c9d-b4a8-9eb47295a640) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63a1731e-9abc-4348-bc28-1ee59b27c47f', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:46:46 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6c6487d9-73d9-40a8-852f-53343e8dacc3 tempest-VolumesServicesTestJSON-753939982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f316260-72c7-4961-b387-c0c48b886081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:46:46 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-6c6487d9-73d9-40a8-852f-53343e8dacc3 tempest-VolumesServicesTestJSON-753939982 None] Volume volume-63a1731e-9abc-4348-bc28-1ee59b27c47f (63a1731e-9abc-4348-bc28-1ee59b27c47f): created successfully Sep 18 21:46:46 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6c6487d9-73d9-40a8-852f-53343e8dacc3 tempest-VolumesServicesTestJSON-753939982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f316260-72c7-4961-b387-c0c48b886081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:46:46 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6c6487d9-73d9-40a8-852f-53343e8dacc3 tempest-VolumesServicesTestJSON-753939982 None] Flow 'volume_create_manager' (2bcc34c6-f191-47b1-90a6-e5ab057a464f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:46:46 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-6c6487d9-73d9-40a8-852f-53343e8dacc3 tempest-VolumesServicesTestJSON-753939982 None] Created volume successfully. Sep 18 21:46:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-82e14394-17d7-4637-bea1-9512fb7d1d6d req-c317fbe4-f7e6-4c2f-8491-3e1a2bccca8f tempest-TestShelveInstance-1002688398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:46:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-82e14394-17d7-4637-bea1-9512fb7d1d6d req-c317fbe4-f7e6-4c2f-8491-3e1a2bccca8f tempest-TestShelveInstance-1002688398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:46:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-82e14394-17d7-4637-bea1-9512fb7d1d6d req-c317fbe4-f7e6-4c2f-8491-3e1a2bccca8f tempest-TestShelveInstance-1002688398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:46:46 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [req-82e14394-17d7-4637-bea1-9512fb7d1d6d req-c317fbe4-f7e6-4c2f-8491-3e1a2bccca8f tempest-TestShelveInstance-1002688398 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff', 'name': 'volume-45edcf0b-344c-40f8-bf50-766ce05c30ac', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b7f0a0b7-6e1b-4794-a678-1569308c10c3', 'enforce_multipath': True} {{(pid=86136) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 18 21:46:46 devstack cinder-volume[86136]: INFO cinder.volume.manager [req-82e14394-17d7-4637-bea1-9512fb7d1d6d req-c317fbe4-f7e6-4c2f-8491-3e1a2bccca8f tempest-TestShelveInstance-1002688398 None] attachment_update completed successfully. Sep 18 21:46:47 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-bb523357-a3b8-4a1a-8f54-a544f09f08f8 tempest-VolumesServicesTestJSON-753939982 None] Acquiring lock "cinder-63a1731e-9abc-4348-bc28-1ee59b27c47f-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:46:47 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-bb523357-a3b8-4a1a-8f54-a544f09f08f8 tempest-VolumesServicesTestJSON-753939982 None] Lock "cinder-63a1731e-9abc-4348-bc28-1ee59b27c47f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:46:47 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-bb523357-a3b8-4a1a-8f54-a544f09f08f8 tempest-VolumesServicesTestJSON-753939982 None] Acquiring lock "cinder-quobyte-63a1731e-9abc-4348-bc28-1ee59b27c47f" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:46:47 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-bb523357-a3b8-4a1a-8f54-a544f09f08f8 tempest-VolumesServicesTestJSON-753939982 None] Lock "cinder-quobyte-63a1731e-9abc-4348-bc28-1ee59b27c47f" acquired by "delete_volume" :: waited 0.021s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:46:47 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[244853fa-1d7a-4a64-877e-21fd4c64cf11]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:46:47 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-bb523357-a3b8-4a1a-8f54-a544f09f08f8 tempest-VolumesServicesTestJSON-753939982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-63a1731e-9abc-4348-bc28-1ee59b27c47f {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:46:47 devstack sudo[100795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-63a1731e-9abc-4348-bc28-1ee59b27c47f Sep 18 21:46:47 devstack sudo[100795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:46:48 devstack sudo[100795]: pam_unix(sudo:session): session closed for user root Sep 18 21:46:48 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-bb523357-a3b8-4a1a-8f54-a544f09f08f8 tempest-VolumesServicesTestJSON-753939982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-63a1731e-9abc-4348-bc28-1ee59b27c47f" returned: 0 in 0.409s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:46:48 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-bb523357-a3b8-4a1a-8f54-a544f09f08f8 tempest-VolumesServicesTestJSON-753939982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-63a1731e-9abc-4348-bc28-1ee59b27c47f {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:46:48 devstack sudo[100801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-63a1731e-9abc-4348-bc28-1ee59b27c47f Sep 18 21:46:48 devstack sudo[100801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:46:48 devstack sudo[100801]: pam_unix(sudo:session): session closed for user root Sep 18 21:46:48 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-bb523357-a3b8-4a1a-8f54-a544f09f08f8 tempest-VolumesServicesTestJSON-753939982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-63a1731e-9abc-4348-bc28-1ee59b27c47f" returned: 0 in 0.303s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:46:48 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-bb523357-a3b8-4a1a-8f54-a544f09f08f8 tempest-VolumesServicesTestJSON-753939982 None] Lock "cinder-quobyte-63a1731e-9abc-4348-bc28-1ee59b27c47f" released by "delete_volume" :: held 0.775s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:46:48 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-bb523357-a3b8-4a1a-8f54-a544f09f08f8 tempest-VolumesServicesTestJSON-753939982 None] Created reservations ['48de4278-ee01-45e7-ae47-b6fc4c12e6bb', '9377e9d0-9d8f-454d-a5c7-03799d43d070', '0957786d-87ff-4faf-bd35-1c6cb5d166e2', '0f602584-1339-49c7-9c8b-1b84b898347b'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:46:48 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-bb523357-a3b8-4a1a-8f54-a544f09f08f8 tempest-VolumesServicesTestJSON-753939982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:46:48 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-bb523357-a3b8-4a1a-8f54-a544f09f08f8 tempest-VolumesServicesTestJSON-753939982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:46:48 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-bb523357-a3b8-4a1a-8f54-a544f09f08f8 tempest-VolumesServicesTestJSON-753939982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:46:48 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-bb523357-a3b8-4a1a-8f54-a544f09f08f8 tempest-VolumesServicesTestJSON-753939982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:46:48 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-bb523357-a3b8-4a1a-8f54-a544f09f08f8 tempest-VolumesServicesTestJSON-753939982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:46:48 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-bb523357-a3b8-4a1a-8f54-a544f09f08f8 tempest-VolumesServicesTestJSON-753939982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:46:48 devstack sudo[100805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:46:48 devstack sudo[100805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:46:48 devstack sudo[100805]: pam_unix(sudo:session): session closed for user root Sep 18 21:46:49 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-bb523357-a3b8-4a1a-8f54-a544f09f08f8 tempest-VolumesServicesTestJSON-753939982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.324s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:46:49 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-bb523357-a3b8-4a1a-8f54-a544f09f08f8 tempest-VolumesServicesTestJSON-753939982 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:46:49 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-bb523357-a3b8-4a1a-8f54-a544f09f08f8 tempest-VolumesServicesTestJSON-753939982 None] Deleted volume successfully. Sep 18 21:46:49 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-bb523357-a3b8-4a1a-8f54-a544f09f08f8 tempest-VolumesServicesTestJSON-753939982 None] Lock "cinder-63a1731e-9abc-4348-bc28-1ee59b27c47f-delete_volume" released by "delete_volume" :: held 1.396s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:46:51 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-78957cc1-c486-43bb-b1d1-45663e902c3e tempest-CreateVolumesFromSnapshotTest-382606126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:46:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-78957cc1-c486-43bb-b1d1-45663e902c3e tempest-CreateVolumesFromSnapshotTest-382606126 None] Flow 'volume_create_manager' (371e13c6-8bc7-47f3-b0be-d90978ddf748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:46:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-78957cc1-c486-43bb-b1d1-45663e902c3e tempest-CreateVolumesFromSnapshotTest-382606126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (856e5ad6-c816-4b0d-8e79-60b955b67967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:46:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-78957cc1-c486-43bb-b1d1-45663e902c3e tempest-CreateVolumesFromSnapshotTest-382606126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (856e5ad6-c816-4b0d-8e79-60b955b67967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:46:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1152103245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d78f91c6-812b-4466-943c-2dac24f72c11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='158d2d360c5648458441386f95f0a070',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:46:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:46:52Z,use_quota=True,user_id='894671b2d79d4f63ba2ddb35ba7c4c10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:46:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-78957cc1-c486-43bb-b1d1-45663e902c3e tempest-CreateVolumesFromSnapshotTest-382606126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5dabd65-ef8b-4634-83f8-623c2fcab94f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:46:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-78957cc1-c486-43bb-b1d1-45663e902c3e tempest-CreateVolumesFromSnapshotTest-382606126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5dabd65-ef8b-4634-83f8-623c2fcab94f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:46:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-78957cc1-c486-43bb-b1d1-45663e902c3e tempest-CreateVolumesFromSnapshotTest-382606126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c401f1c-a3c3-4597-a91e-f38119d79a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:46:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-78957cc1-c486-43bb-b1d1-45663e902c3e tempest-CreateVolumesFromSnapshotTest-382606126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c401f1c-a3c3-4597-a91e-f38119d79a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd78f91c6-812b-4466-943c-2dac24f72c11', 'volume_name': 'volume-d78f91c6-812b-4466-943c-2dac24f72c11', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:46:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-78957cc1-c486-43bb-b1d1-45663e902c3e tempest-CreateVolumesFromSnapshotTest-382606126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8102e58b-e2c9-4472-82e4-02e35049d724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:46:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-78957cc1-c486-43bb-b1d1-45663e902c3e tempest-CreateVolumesFromSnapshotTest-382606126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8102e58b-e2c9-4472-82e4-02e35049d724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:46:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-78957cc1-c486-43bb-b1d1-45663e902c3e tempest-CreateVolumesFromSnapshotTest-382606126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62392691-6de8-40fd-ba60-9e084edb3c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:46:52 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-78957cc1-c486-43bb-b1d1-45663e902c3e tempest-CreateVolumesFromSnapshotTest-382606126 None] Volume d78f91c6-812b-4466-943c-2dac24f72c11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d78f91c6-812b-4466-943c-2dac24f72c11', 'volume_size': 1} Sep 18 21:46:52 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-78957cc1-c486-43bb-b1d1-45663e902c3e tempest-CreateVolumesFromSnapshotTest-382606126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:46:52 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-78957cc1-c486-43bb-b1d1-45663e902c3e tempest-CreateVolumesFromSnapshotTest-382606126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:46:52 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-78957cc1-c486-43bb-b1d1-45663e902c3e tempest-CreateVolumesFromSnapshotTest-382606126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:46:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1152103245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d78f91c6-812b-4466-943c-2dac24f72c11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='158d2d360c5648458441386f95f0a070',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:46:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:46:52Z,use_quota=True,user_id='894671b2d79d4f63ba2ddb35ba7c4c10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:46:52 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-78957cc1-c486-43bb-b1d1-45663e902c3e tempest-CreateVolumesFromSnapshotTest-382606126 None] Creating volume d78f91c6-812b-4466-943c-2dac24f72c11 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:46:52 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-78957cc1-c486-43bb-b1d1-45663e902c3e tempest-CreateVolumesFromSnapshotTest-382606126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:46:52 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-78957cc1-c486-43bb-b1d1-45663e902c3e tempest-CreateVolumesFromSnapshotTest-382606126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:46:52 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-78957cc1-c486-43bb-b1d1-45663e902c3e tempest-CreateVolumesFromSnapshotTest-382606126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:46:52 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-78957cc1-c486-43bb-b1d1-45663e902c3e tempest-CreateVolumesFromSnapshotTest-382606126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:46:52 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-78957cc1-c486-43bb-b1d1-45663e902c3e tempest-CreateVolumesFromSnapshotTest-382606126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:46:52 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-78957cc1-c486-43bb-b1d1-45663e902c3e tempest-CreateVolumesFromSnapshotTest-382606126 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:46:52 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-78957cc1-c486-43bb-b1d1-45663e902c3e tempest-CreateVolumesFromSnapshotTest-382606126 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:46:52 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-78957cc1-c486-43bb-b1d1-45663e902c3e tempest-CreateVolumesFromSnapshotTest-382606126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-d78f91c6-812b-4466-943c-2dac24f72c11 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:46:52 devstack sudo[101285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-d78f91c6-812b-4466-943c-2dac24f72c11 1073741824 Sep 18 21:46:52 devstack sudo[101285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:46:52 devstack sudo[101285]: pam_unix(sudo:session): session closed for user root Sep 18 21:46:52 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-78957cc1-c486-43bb-b1d1-45663e902c3e tempest-CreateVolumesFromSnapshotTest-382606126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-d78f91c6-812b-4466-943c-2dac24f72c11 1073741824" returned: 0 in 0.629s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:46:52 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-78957cc1-c486-43bb-b1d1-45663e902c3e tempest-CreateVolumesFromSnapshotTest-382606126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-d78f91c6-812b-4466-943c-2dac24f72c11 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:46:52 devstack sudo[101293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-d78f91c6-812b-4466-943c-2dac24f72c11 Sep 18 21:46:52 devstack sudo[101293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:46:53 devstack sudo[101293]: pam_unix(sudo:session): session closed for user root Sep 18 21:46:53 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-78957cc1-c486-43bb-b1d1-45663e902c3e tempest-CreateVolumesFromSnapshotTest-382606126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-d78f91c6-812b-4466-943c-2dac24f72c11" returned: 0 in 0.346s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:46:53 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-78957cc1-c486-43bb-b1d1-45663e902c3e tempest-CreateVolumesFromSnapshotTest-382606126 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:46:53 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-78957cc1-c486-43bb-b1d1-45663e902c3e tempest-CreateVolumesFromSnapshotTest-382606126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:46:53 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-78957cc1-c486-43bb-b1d1-45663e902c3e tempest-CreateVolumesFromSnapshotTest-382606126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62392691-6de8-40fd-ba60-9e084edb3c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d78f91c6-812b-4466-943c-2dac24f72c11', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:46:53 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-78957cc1-c486-43bb-b1d1-45663e902c3e tempest-CreateVolumesFromSnapshotTest-382606126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (849c5a70-fc57-4972-97d7-ff61fcddf455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:46:53 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-78957cc1-c486-43bb-b1d1-45663e902c3e tempest-CreateVolumesFromSnapshotTest-382606126 None] Volume volume-d78f91c6-812b-4466-943c-2dac24f72c11 (d78f91c6-812b-4466-943c-2dac24f72c11): created successfully Sep 18 21:46:53 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-78957cc1-c486-43bb-b1d1-45663e902c3e tempest-CreateVolumesFromSnapshotTest-382606126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (849c5a70-fc57-4972-97d7-ff61fcddf455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:46:53 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-78957cc1-c486-43bb-b1d1-45663e902c3e tempest-CreateVolumesFromSnapshotTest-382606126 None] Flow 'volume_create_manager' (371e13c6-8bc7-47f3-b0be-d90978ddf748) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:46:53 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-78957cc1-c486-43bb-b1d1-45663e902c3e tempest-CreateVolumesFromSnapshotTest-382606126 None] Created volume successfully. Sep 18 21:46:54 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-e370a367-a407-4b1b-b9f7-c3c0010ef5b3 tempest-CreateVolumesFromSnapshotTest-382606126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:46:54 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-e370a367-a407-4b1b-b9f7-c3c0010ef5b3 tempest-CreateVolumesFromSnapshotTest-382606126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:46:54 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-e370a367-a407-4b1b-b9f7-c3c0010ef5b3 tempest-CreateVolumesFromSnapshotTest-382606126 None] Creating offline snapshot c585f3a7-416e-4d86-8e1d-c89606382dd0 of volume d78f91c6-812b-4466-943c-2dac24f72c11 {{(pid=86136) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 21:46:54 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fbf1827-1c57-4441-b5f2-471b8cc6e18f]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:46:54 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e370a367-a407-4b1b-b9f7-c3c0010ef5b3 tempest-CreateVolumesFromSnapshotTest-382606126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-d78f91c6-812b-4466-943c-2dac24f72c11 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:46:54 devstack sudo[101296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-d78f91c6-812b-4466-943c-2dac24f72c11 Sep 18 21:46:54 devstack sudo[101296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:46:55 devstack sudo[101296]: pam_unix(sudo:session): session closed for user root Sep 18 21:46:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e370a367-a407-4b1b-b9f7-c3c0010ef5b3 tempest-CreateVolumesFromSnapshotTest-382606126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-d78f91c6-812b-4466-943c-2dac24f72c11" returned: 0 in 0.492s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:46:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e370a367-a407-4b1b-b9f7-c3c0010ef5b3 tempest-CreateVolumesFromSnapshotTest-382606126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-d78f91c6-812b-4466-943c-2dac24f72c11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-d78f91c6-812b-4466-943c-2dac24f72c11.c585f3a7-416e-4d86-8e1d-c89606382dd0 1G {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:46:55 devstack sudo[101306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-d78f91c6-812b-4466-943c-2dac24f72c11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-d78f91c6-812b-4466-943c-2dac24f72c11.c585f3a7-416e-4d86-8e1d-c89606382dd0 1G Sep 18 21:46:55 devstack sudo[101306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:46:55 devstack sudo[101306]: pam_unix(sudo:session): session closed for user root Sep 18 21:46:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e370a367-a407-4b1b-b9f7-c3c0010ef5b3 tempest-CreateVolumesFromSnapshotTest-382606126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-d78f91c6-812b-4466-943c-2dac24f72c11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-d78f91c6-812b-4466-943c-2dac24f72c11.c585f3a7-416e-4d86-8e1d-c89606382dd0 1G" returned: 0 in 0.674s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:46:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e370a367-a407-4b1b-b9f7-c3c0010ef5b3 tempest-CreateVolumesFromSnapshotTest-382606126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d78f91c6-812b-4466-943c-2dac24f72c11 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-d78f91c6-812b-4466-943c-2dac24f72c11.c585f3a7-416e-4d86-8e1d-c89606382dd0 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:46:55 devstack sudo[101315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d78f91c6-812b-4466-943c-2dac24f72c11 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-d78f91c6-812b-4466-943c-2dac24f72c11.c585f3a7-416e-4d86-8e1d-c89606382dd0 Sep 18 21:46:55 devstack sudo[101315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:46:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-2901983d-1edf-421e-b795-929453b965cc req-3183fb5e-e69d-4430-acb6-d0d9f92c0862 tempest-TestStampPattern-580697789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:46:56 devstack sudo[101315]: pam_unix(sudo:session): session closed for user root Sep 18 21:46:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e370a367-a407-4b1b-b9f7-c3c0010ef5b3 tempest-CreateVolumesFromSnapshotTest-382606126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d78f91c6-812b-4466-943c-2dac24f72c11 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-d78f91c6-812b-4466-943c-2dac24f72c11.c585f3a7-416e-4d86-8e1d-c89606382dd0" returned: 0 in 0.493s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:46:56 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-e370a367-a407-4b1b-b9f7-c3c0010ef5b3 tempest-CreateVolumesFromSnapshotTest-382606126 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-d78f91c6-812b-4466-943c-2dac24f72c11.c585f3a7-416e-4d86-8e1d-c89606382dd0 is being set with open permissions: ugo+rw Sep 18 21:46:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e370a367-a407-4b1b-b9f7-c3c0010ef5b3 tempest-CreateVolumesFromSnapshotTest-382606126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-d78f91c6-812b-4466-943c-2dac24f72c11.c585f3a7-416e-4d86-8e1d-c89606382dd0 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:46:56 devstack sudo[101329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-d78f91c6-812b-4466-943c-2dac24f72c11.c585f3a7-416e-4d86-8e1d-c89606382dd0 Sep 18 21:46:56 devstack sudo[101329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:46:56 devstack sudo[101329]: pam_unix(sudo:session): session closed for user root Sep 18 21:46:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e370a367-a407-4b1b-b9f7-c3c0010ef5b3 tempest-CreateVolumesFromSnapshotTest-382606126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-d78f91c6-812b-4466-943c-2dac24f72c11.c585f3a7-416e-4d86-8e1d-c89606382dd0" returned: 0 in 0.324s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:46:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e370a367-a407-4b1b-b9f7-c3c0010ef5b3 tempest-CreateVolumesFromSnapshotTest-382606126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-d78f91c6-812b-4466-943c-2dac24f72c11.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:46:56 devstack sudo[101332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-d78f91c6-812b-4466-943c-2dac24f72c11.info Sep 18 21:46:56 devstack sudo[101332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:46:56 devstack sudo[101332]: pam_unix(sudo:session): session closed for user root Sep 18 21:46:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e370a367-a407-4b1b-b9f7-c3c0010ef5b3 tempest-CreateVolumesFromSnapshotTest-382606126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-d78f91c6-812b-4466-943c-2dac24f72c11.info" returned: 0 in 0.291s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:46:56 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-e370a367-a407-4b1b-b9f7-c3c0010ef5b3 tempest-CreateVolumesFromSnapshotTest-382606126 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-d78f91c6-812b-4466-943c-2dac24f72c11.info is being set with open permissions: ugo+rw Sep 18 21:46:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e370a367-a407-4b1b-b9f7-c3c0010ef5b3 tempest-CreateVolumesFromSnapshotTest-382606126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-d78f91c6-812b-4466-943c-2dac24f72c11.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:46:56 devstack sudo[101335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-d78f91c6-812b-4466-943c-2dac24f72c11.info Sep 18 21:46:56 devstack sudo[101335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:46:57 devstack sudo[101335]: pam_unix(sudo:session): session closed for user root Sep 18 21:46:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e370a367-a407-4b1b-b9f7-c3c0010ef5b3 tempest-CreateVolumesFromSnapshotTest-382606126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-d78f91c6-812b-4466-943c-2dac24f72c11.info" returned: 0 in 0.303s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:46:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-e370a367-a407-4b1b-b9f7-c3c0010ef5b3 tempest-CreateVolumesFromSnapshotTest-382606126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.723s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:46:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-2901983d-1edf-421e-b795-929453b965cc req-3183fb5e-e69d-4430-acb6-d0d9f92c0862 tempest-TestStampPattern-580697789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.024s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:46:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-2901983d-1edf-421e-b795-929453b965cc req-3183fb5e-e69d-4430-acb6-d0d9f92c0862 tempest-TestStampPattern-580697789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.042s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:46:57 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-e370a367-a407-4b1b-b9f7-c3c0010ef5b3 tempest-CreateVolumesFromSnapshotTest-382606126 None] Create snapshot completed successfully Sep 18 21:46:57 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [req-2901983d-1edf-421e-b795-929453b965cc req-3183fb5e-e69d-4430-acb6-d0d9f92c0862 tempest-TestStampPattern-580697789 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff', 'name': 'volume-a6eaf836-5be5-4ea9-a3b4-497ffeaa19df', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f0a4e3b5-3f69-4b6b-8212-f3a672c6491b', 'enforce_multipath': True} {{(pid=86136) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 18 21:46:57 devstack cinder-volume[86136]: INFO cinder.volume.manager [req-2901983d-1edf-421e-b795-929453b965cc req-3183fb5e-e69d-4430-acb6-d0d9f92c0862 tempest-TestStampPattern-580697789 None] attachment_update completed successfully. Sep 18 21:46:57 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf89980f-ce5d-4032-af83-5b44401deb81 tempest-VolumesListAdminTestJSON-1184658396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:46:57 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-bf89980f-ce5d-4032-af83-5b44401deb81 tempest-VolumesListAdminTestJSON-1184658396 None] Flow 'volume_create_manager' (563ab452-f026-456d-9143-13530e9a8230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:46:57 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-bf89980f-ce5d-4032-af83-5b44401deb81 tempest-VolumesListAdminTestJSON-1184658396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af41b251-bea6-4e99-b143-809cc891ab46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:46:57 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-bf89980f-ce5d-4032-af83-5b44401deb81 tempest-VolumesListAdminTestJSON-1184658396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af41b251-bea6-4e99-b143-809cc891ab46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:46:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-591555747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35984821-2cd8-4184-84a7-dacda62bb9c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e93921b539f4c1f82194fe06c10ea94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:46:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:46:58Z,use_quota=True,user_id='7d57d36b405949869f1c0904ef5798ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:46:57 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-bf89980f-ce5d-4032-af83-5b44401deb81 tempest-VolumesListAdminTestJSON-1184658396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (612b3316-fa19-498f-9e56-d6f3a773ae76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:46:57 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-bf89980f-ce5d-4032-af83-5b44401deb81 tempest-VolumesListAdminTestJSON-1184658396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (612b3316-fa19-498f-9e56-d6f3a773ae76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:46:57 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-bf89980f-ce5d-4032-af83-5b44401deb81 tempest-VolumesListAdminTestJSON-1184658396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc406f2b-561b-470c-9dab-d7bb7de22575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:46:57 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-bf89980f-ce5d-4032-af83-5b44401deb81 tempest-VolumesListAdminTestJSON-1184658396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc406f2b-561b-470c-9dab-d7bb7de22575) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35984821-2cd8-4184-84a7-dacda62bb9c8', 'volume_name': 'volume-35984821-2cd8-4184-84a7-dacda62bb9c8', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:46:57 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-bf89980f-ce5d-4032-af83-5b44401deb81 tempest-VolumesListAdminTestJSON-1184658396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcb6ad39-00d9-41dc-89ef-ff5b18ee389e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:46:57 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-bf89980f-ce5d-4032-af83-5b44401deb81 tempest-VolumesListAdminTestJSON-1184658396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcb6ad39-00d9-41dc-89ef-ff5b18ee389e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:46:57 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-bf89980f-ce5d-4032-af83-5b44401deb81 tempest-VolumesListAdminTestJSON-1184658396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (451a2818-f04a-48fb-bad9-6985e746d8e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:46:57 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-bf89980f-ce5d-4032-af83-5b44401deb81 tempest-VolumesListAdminTestJSON-1184658396 None] Volume 35984821-2cd8-4184-84a7-dacda62bb9c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35984821-2cd8-4184-84a7-dacda62bb9c8', 'volume_size': 1} Sep 18 21:46:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-bf89980f-ce5d-4032-af83-5b44401deb81 tempest-VolumesListAdminTestJSON-1184658396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:46:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-bf89980f-ce5d-4032-af83-5b44401deb81 tempest-VolumesListAdminTestJSON-1184658396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:46:57 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-bf89980f-ce5d-4032-af83-5b44401deb81 tempest-VolumesListAdminTestJSON-1184658396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:46:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-591555747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35984821-2cd8-4184-84a7-dacda62bb9c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e93921b539f4c1f82194fe06c10ea94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:46:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:46:58Z,use_quota=True,user_id='7d57d36b405949869f1c0904ef5798ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:46:57 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-bf89980f-ce5d-4032-af83-5b44401deb81 tempest-VolumesListAdminTestJSON-1184658396 None] Creating volume 35984821-2cd8-4184-84a7-dacda62bb9c8 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:46:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-bf89980f-ce5d-4032-af83-5b44401deb81 tempest-VolumesListAdminTestJSON-1184658396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:46:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-bf89980f-ce5d-4032-af83-5b44401deb81 tempest-VolumesListAdminTestJSON-1184658396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:46:57 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-bf89980f-ce5d-4032-af83-5b44401deb81 tempest-VolumesListAdminTestJSON-1184658396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:46:57 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-bf89980f-ce5d-4032-af83-5b44401deb81 tempest-VolumesListAdminTestJSON-1184658396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:46:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-bf89980f-ce5d-4032-af83-5b44401deb81 tempest-VolumesListAdminTestJSON-1184658396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:46:57 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-bf89980f-ce5d-4032-af83-5b44401deb81 tempest-VolumesListAdminTestJSON-1184658396 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:46:57 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-bf89980f-ce5d-4032-af83-5b44401deb81 tempest-VolumesListAdminTestJSON-1184658396 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:46:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-bf89980f-ce5d-4032-af83-5b44401deb81 tempest-VolumesListAdminTestJSON-1184658396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-35984821-2cd8-4184-84a7-dacda62bb9c8 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:46:57 devstack sudo[101341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-35984821-2cd8-4184-84a7-dacda62bb9c8 1073741824 Sep 18 21:46:57 devstack sudo[101341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:46:58 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-d15a1e39-fdb5-456e-bfc7-777acd0110c7 tempest-CreateVolumesFromSnapshotTest-382606126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:46:58 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d15a1e39-fdb5-456e-bfc7-777acd0110c7 tempest-CreateVolumesFromSnapshotTest-382606126 None] Flow 'volume_create_manager' (ad47e327-3891-4f85-9229-7ceec10d0f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:46:58 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d15a1e39-fdb5-456e-bfc7-777acd0110c7 tempest-CreateVolumesFromSnapshotTest-382606126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfe37ce0-96fd-41e8-8546-7a87cbcab2e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:46:58 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d15a1e39-fdb5-456e-bfc7-777acd0110c7 tempest-CreateVolumesFromSnapshotTest-382606126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfe37ce0-96fd-41e8-8546-7a87cbcab2e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:46:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-336303833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a44f1e54-c69f-4e7c-ab32-670ebcd820d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='158d2d360c5648458441386f95f0a070',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:46:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:46:58Z,use_quota=True,user_id='894671b2d79d4f63ba2ddb35ba7c4c10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:46:58 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d15a1e39-fdb5-456e-bfc7-777acd0110c7 tempest-CreateVolumesFromSnapshotTest-382606126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55baa9a9-147c-426c-bd4e-892d7531825b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:46:58 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d15a1e39-fdb5-456e-bfc7-777acd0110c7 tempest-CreateVolumesFromSnapshotTest-382606126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55baa9a9-147c-426c-bd4e-892d7531825b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:46:58 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d15a1e39-fdb5-456e-bfc7-777acd0110c7 tempest-CreateVolumesFromSnapshotTest-382606126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dce7b0c1-0f50-49d6-a839-c9aeb3d4302e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:46:58 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d15a1e39-fdb5-456e-bfc7-777acd0110c7 tempest-CreateVolumesFromSnapshotTest-382606126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dce7b0c1-0f50-49d6-a839-c9aeb3d4302e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a44f1e54-c69f-4e7c-ab32-670ebcd820d7', 'volume_name': 'volume-a44f1e54-c69f-4e7c-ab32-670ebcd820d7', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:46:58 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d15a1e39-fdb5-456e-bfc7-777acd0110c7 tempest-CreateVolumesFromSnapshotTest-382606126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ae1fe85-a349-48d0-b8c3-166d12078e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:46:58 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d15a1e39-fdb5-456e-bfc7-777acd0110c7 tempest-CreateVolumesFromSnapshotTest-382606126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ae1fe85-a349-48d0-b8c3-166d12078e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:46:58 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d15a1e39-fdb5-456e-bfc7-777acd0110c7 tempest-CreateVolumesFromSnapshotTest-382606126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9350048e-82fd-4822-87ce-8a4cc7b365cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:46:58 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-d15a1e39-fdb5-456e-bfc7-777acd0110c7 tempest-CreateVolumesFromSnapshotTest-382606126 None] Volume a44f1e54-c69f-4e7c-ab32-670ebcd820d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a44f1e54-c69f-4e7c-ab32-670ebcd820d7', 'volume_size': 1} Sep 18 21:46:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-d15a1e39-fdb5-456e-bfc7-777acd0110c7 tempest-CreateVolumesFromSnapshotTest-382606126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:46:58 devstack sudo[101341]: pam_unix(sudo:session): session closed for user root Sep 18 21:46:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-bf89980f-ce5d-4032-af83-5b44401deb81 tempest-VolumesListAdminTestJSON-1184658396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-35984821-2cd8-4184-84a7-dacda62bb9c8 1073741824" returned: 0 in 0.816s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:46:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-bf89980f-ce5d-4032-af83-5b44401deb81 tempest-VolumesListAdminTestJSON-1184658396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-35984821-2cd8-4184-84a7-dacda62bb9c8 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:46:58 devstack sudo[101347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-35984821-2cd8-4184-84a7-dacda62bb9c8 Sep 18 21:46:58 devstack sudo[101347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:46:58 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc0feccf-a2f6-4c51-8b0d-0654b82ea2dc tempest-CreateVolumesFromSnapshotTest-382606126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:46:58 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-fc0feccf-a2f6-4c51-8b0d-0654b82ea2dc tempest-CreateVolumesFromSnapshotTest-382606126 None] Flow 'volume_create_manager' (5bcc2505-7b2c-42ab-be59-a6075ec2e0eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:46:58 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-fc0feccf-a2f6-4c51-8b0d-0654b82ea2dc tempest-CreateVolumesFromSnapshotTest-382606126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b490ba4-a1be-447c-b3c7-99812adb4e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:46:58 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-fc0feccf-a2f6-4c51-8b0d-0654b82ea2dc tempest-CreateVolumesFromSnapshotTest-382606126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b490ba4-a1be-447c-b3c7-99812adb4e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:46:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1592762623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a88be75b-a92b-45f2-9943-275fa2a3af1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='158d2d360c5648458441386f95f0a070',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:46:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:46:59Z,use_quota=True,user_id='894671b2d79d4f63ba2ddb35ba7c4c10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:46:58 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-fc0feccf-a2f6-4c51-8b0d-0654b82ea2dc tempest-CreateVolumesFromSnapshotTest-382606126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45086625-d60d-4fed-bf24-c66e73e57d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:46:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-fc0feccf-a2f6-4c51-8b0d-0654b82ea2dc tempest-CreateVolumesFromSnapshotTest-382606126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45086625-d60d-4fed-bf24-c66e73e57d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:46:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-fc0feccf-a2f6-4c51-8b0d-0654b82ea2dc tempest-CreateVolumesFromSnapshotTest-382606126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c292079b-2717-4496-8b8a-9c3b37dde025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:46:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-fc0feccf-a2f6-4c51-8b0d-0654b82ea2dc tempest-CreateVolumesFromSnapshotTest-382606126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c292079b-2717-4496-8b8a-9c3b37dde025) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a88be75b-a92b-45f2-9943-275fa2a3af1c', 'volume_name': 'volume-a88be75b-a92b-45f2-9943-275fa2a3af1c', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:46:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-fc0feccf-a2f6-4c51-8b0d-0654b82ea2dc tempest-CreateVolumesFromSnapshotTest-382606126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0b9d958-e170-4a82-bb70-f9fe017b4977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:46:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-fc0feccf-a2f6-4c51-8b0d-0654b82ea2dc tempest-CreateVolumesFromSnapshotTest-382606126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0b9d958-e170-4a82-bb70-f9fe017b4977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:46:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-fc0feccf-a2f6-4c51-8b0d-0654b82ea2dc tempest-CreateVolumesFromSnapshotTest-382606126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fa42fd1-b26f-43dc-a1d6-e84725e39eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:46:59 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-fc0feccf-a2f6-4c51-8b0d-0654b82ea2dc tempest-CreateVolumesFromSnapshotTest-382606126 None] Volume a88be75b-a92b-45f2-9943-275fa2a3af1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a88be75b-a92b-45f2-9943-275fa2a3af1c', 'volume_size': 1} Sep 18 21:46:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-fc0feccf-a2f6-4c51-8b0d-0654b82ea2dc tempest-CreateVolumesFromSnapshotTest-382606126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:46:59 devstack sudo[101347]: pam_unix(sudo:session): session closed for user root Sep 18 21:46:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-bf89980f-ce5d-4032-af83-5b44401deb81 tempest-VolumesListAdminTestJSON-1184658396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-35984821-2cd8-4184-84a7-dacda62bb9c8" returned: 0 in 0.336s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:46:59 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-bf89980f-ce5d-4032-af83-5b44401deb81 tempest-VolumesListAdminTestJSON-1184658396 None] <== create_volume: return (1215ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:46:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-bf89980f-ce5d-4032-af83-5b44401deb81 tempest-VolumesListAdminTestJSON-1184658396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.219s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:46:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-d15a1e39-fdb5-456e-bfc7-777acd0110c7 tempest-CreateVolumesFromSnapshotTest-382606126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.415s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:46:59 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-d15a1e39-fdb5-456e-bfc7-777acd0110c7 tempest-CreateVolumesFromSnapshotTest-382606126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:46:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-336303833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a44f1e54-c69f-4e7c-ab32-670ebcd820d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='158d2d360c5648458441386f95f0a070',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:46:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:46:58Z,use_quota=True,user_id='894671b2d79d4f63ba2ddb35ba7c4c10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:46:59 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-d15a1e39-fdb5-456e-bfc7-777acd0110c7 tempest-CreateVolumesFromSnapshotTest-382606126 None] Creating volume a44f1e54-c69f-4e7c-ab32-670ebcd820d7 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:46:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-d15a1e39-fdb5-456e-bfc7-777acd0110c7 tempest-CreateVolumesFromSnapshotTest-382606126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:46:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-d15a1e39-fdb5-456e-bfc7-777acd0110c7 tempest-CreateVolumesFromSnapshotTest-382606126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:46:59 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-d15a1e39-fdb5-456e-bfc7-777acd0110c7 tempest-CreateVolumesFromSnapshotTest-382606126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:46:59 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-d15a1e39-fdb5-456e-bfc7-777acd0110c7 tempest-CreateVolumesFromSnapshotTest-382606126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:46:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-d15a1e39-fdb5-456e-bfc7-777acd0110c7 tempest-CreateVolumesFromSnapshotTest-382606126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:46:59 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-d15a1e39-fdb5-456e-bfc7-777acd0110c7 tempest-CreateVolumesFromSnapshotTest-382606126 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:46:59 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-d15a1e39-fdb5-456e-bfc7-777acd0110c7 tempest-CreateVolumesFromSnapshotTest-382606126 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:46:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d15a1e39-fdb5-456e-bfc7-777acd0110c7 tempest-CreateVolumesFromSnapshotTest-382606126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a44f1e54-c69f-4e7c-ab32-670ebcd820d7 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:46:59 devstack sudo[101350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a44f1e54-c69f-4e7c-ab32-670ebcd820d7 1073741824 Sep 18 21:46:59 devstack sudo[101350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:46:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-bf89980f-ce5d-4032-af83-5b44401deb81 tempest-VolumesListAdminTestJSON-1184658396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (451a2818-f04a-48fb-bad9-6985e746d8e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35984821-2cd8-4184-84a7-dacda62bb9c8', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:46:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-bf89980f-ce5d-4032-af83-5b44401deb81 tempest-VolumesListAdminTestJSON-1184658396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03ca7bb1-c234-40e0-b2ba-fd8b6b7c3007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:46:59 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-bf89980f-ce5d-4032-af83-5b44401deb81 tempest-VolumesListAdminTestJSON-1184658396 None] Volume volume-35984821-2cd8-4184-84a7-dacda62bb9c8 (35984821-2cd8-4184-84a7-dacda62bb9c8): created successfully Sep 18 21:46:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-bf89980f-ce5d-4032-af83-5b44401deb81 tempest-VolumesListAdminTestJSON-1184658396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03ca7bb1-c234-40e0-b2ba-fd8b6b7c3007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:46:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-bf89980f-ce5d-4032-af83-5b44401deb81 tempest-VolumesListAdminTestJSON-1184658396 None] Flow 'volume_create_manager' (563ab452-f026-456d-9143-13530e9a8230) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:46:59 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-bf89980f-ce5d-4032-af83-5b44401deb81 tempest-VolumesListAdminTestJSON-1184658396 None] Created volume successfully. Sep 18 21:46:59 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-a79265a7-c7cc-4ba8-82fc-a20f01170922 tempest-CreateVolumesFromSnapshotTest-382606126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:46:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-a79265a7-c7cc-4ba8-82fc-a20f01170922 tempest-CreateVolumesFromSnapshotTest-382606126 None] Flow 'volume_create_manager' (8d646f79-b7fc-47b8-8fb1-1378cf514fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:46:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-a79265a7-c7cc-4ba8-82fc-a20f01170922 tempest-CreateVolumesFromSnapshotTest-382606126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69105ecc-c5df-4289-b0bd-ac9a4ba7feb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:46:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-a79265a7-c7cc-4ba8-82fc-a20f01170922 tempest-CreateVolumesFromSnapshotTest-382606126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69105ecc-c5df-4289-b0bd-ac9a4ba7feb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:46:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1244223397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c790b51a-fabb-4a0a-a471-54e9c186adef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='158d2d360c5648458441386f95f0a070',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:46:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:46:59Z,use_quota=True,user_id='894671b2d79d4f63ba2ddb35ba7c4c10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:46:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-a79265a7-c7cc-4ba8-82fc-a20f01170922 tempest-CreateVolumesFromSnapshotTest-382606126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (040eb2b8-e1d8-49e3-a1ca-41abc4d9d0a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:46:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-a79265a7-c7cc-4ba8-82fc-a20f01170922 tempest-CreateVolumesFromSnapshotTest-382606126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (040eb2b8-e1d8-49e3-a1ca-41abc4d9d0a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:46:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-a79265a7-c7cc-4ba8-82fc-a20f01170922 tempest-CreateVolumesFromSnapshotTest-382606126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ff725dc-e7bf-4ec2-a237-4ddbf2cda239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:46:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-a79265a7-c7cc-4ba8-82fc-a20f01170922 tempest-CreateVolumesFromSnapshotTest-382606126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ff725dc-e7bf-4ec2-a237-4ddbf2cda239) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c790b51a-fabb-4a0a-a471-54e9c186adef', 'volume_name': 'volume-c790b51a-fabb-4a0a-a471-54e9c186adef', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:46:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-a79265a7-c7cc-4ba8-82fc-a20f01170922 tempest-CreateVolumesFromSnapshotTest-382606126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c50f115-7b33-47c2-b551-2315a8d56b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:46:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-a79265a7-c7cc-4ba8-82fc-a20f01170922 tempest-CreateVolumesFromSnapshotTest-382606126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c50f115-7b33-47c2-b551-2315a8d56b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:46:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-a79265a7-c7cc-4ba8-82fc-a20f01170922 tempest-CreateVolumesFromSnapshotTest-382606126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eae9a43e-0e8a-4b37-be7d-ce10cf97f3a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:46:59 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-a79265a7-c7cc-4ba8-82fc-a20f01170922 tempest-CreateVolumesFromSnapshotTest-382606126 None] Volume c790b51a-fabb-4a0a-a471-54e9c186adef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c790b51a-fabb-4a0a-a471-54e9c186adef', 'volume_size': 1} Sep 18 21:46:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-a79265a7-c7cc-4ba8-82fc-a20f01170922 tempest-CreateVolumesFromSnapshotTest-382606126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:46:59 devstack sudo[101350]: pam_unix(sudo:session): session closed for user root Sep 18 21:46:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d15a1e39-fdb5-456e-bfc7-777acd0110c7 tempest-CreateVolumesFromSnapshotTest-382606126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a44f1e54-c69f-4e7c-ab32-670ebcd820d7 1073741824" returned: 0 in 0.796s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:46:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d15a1e39-fdb5-456e-bfc7-777acd0110c7 tempest-CreateVolumesFromSnapshotTest-382606126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a44f1e54-c69f-4e7c-ab32-670ebcd820d7 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:00 devstack sudo[101366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a44f1e54-c69f-4e7c-ab32-670ebcd820d7 Sep 18 21:47:00 devstack sudo[101366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:00 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f2e5811-6788-4307-8e0e-dd166a33d2a8 tempest-CreateVolumesFromSnapshotTest-382606126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:47:00 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6f2e5811-6788-4307-8e0e-dd166a33d2a8 tempest-CreateVolumesFromSnapshotTest-382606126 None] Flow 'volume_create_manager' (04c516eb-1548-4fc1-a67a-4c5efeb37278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:47:00 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6f2e5811-6788-4307-8e0e-dd166a33d2a8 tempest-CreateVolumesFromSnapshotTest-382606126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28139122-3d53-4955-9e80-df9d3c7dfdc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:47:00 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6f2e5811-6788-4307-8e0e-dd166a33d2a8 tempest-CreateVolumesFromSnapshotTest-382606126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28139122-3d53-4955-9e80-df9d3c7dfdc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:46:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2041401097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d68e512-e012-4860-9319-e675791f6a6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='158d2d360c5648458441386f95f0a070',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:47:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:47:00Z,use_quota=True,user_id='894671b2d79d4f63ba2ddb35ba7c4c10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:47:00 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6f2e5811-6788-4307-8e0e-dd166a33d2a8 tempest-CreateVolumesFromSnapshotTest-382606126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87b29cba-15c4-433d-91d7-4a682decb028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:47:00 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6f2e5811-6788-4307-8e0e-dd166a33d2a8 tempest-CreateVolumesFromSnapshotTest-382606126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87b29cba-15c4-433d-91d7-4a682decb028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:47:00 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6f2e5811-6788-4307-8e0e-dd166a33d2a8 tempest-CreateVolumesFromSnapshotTest-382606126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e471d9e-719a-4284-91c0-77f673421534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:47:00 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6f2e5811-6788-4307-8e0e-dd166a33d2a8 tempest-CreateVolumesFromSnapshotTest-382606126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e471d9e-719a-4284-91c0-77f673421534) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d68e512-e012-4860-9319-e675791f6a6e', 'volume_name': 'volume-0d68e512-e012-4860-9319-e675791f6a6e', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:47:00 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6f2e5811-6788-4307-8e0e-dd166a33d2a8 tempest-CreateVolumesFromSnapshotTest-382606126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93e8bc47-542a-498e-8734-2c713dd76232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:47:00 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6f2e5811-6788-4307-8e0e-dd166a33d2a8 tempest-CreateVolumesFromSnapshotTest-382606126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93e8bc47-542a-498e-8734-2c713dd76232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:47:00 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6f2e5811-6788-4307-8e0e-dd166a33d2a8 tempest-CreateVolumesFromSnapshotTest-382606126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59bd90ec-e9b9-43d7-a3c3-63ebbe4a28d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:47:00 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-6f2e5811-6788-4307-8e0e-dd166a33d2a8 tempest-CreateVolumesFromSnapshotTest-382606126 None] Volume 0d68e512-e012-4860-9319-e675791f6a6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d68e512-e012-4860-9319-e675791f6a6e', 'volume_size': 1} Sep 18 21:47:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6f2e5811-6788-4307-8e0e-dd166a33d2a8 tempest-CreateVolumesFromSnapshotTest-382606126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:47:00 devstack sudo[101366]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d15a1e39-fdb5-456e-bfc7-777acd0110c7 tempest-CreateVolumesFromSnapshotTest-382606126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a44f1e54-c69f-4e7c-ab32-670ebcd820d7" returned: 0 in 0.604s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:00 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-d15a1e39-fdb5-456e-bfc7-777acd0110c7 tempest-CreateVolumesFromSnapshotTest-382606126 None] <== create_volume: return (1486ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:47:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-d15a1e39-fdb5-456e-bfc7-777acd0110c7 tempest-CreateVolumesFromSnapshotTest-382606126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.491s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:47:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-fc0feccf-a2f6-4c51-8b0d-0654b82ea2dc tempest-CreateVolumesFromSnapshotTest-382606126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.550s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:47:00 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-fc0feccf-a2f6-4c51-8b0d-0654b82ea2dc tempest-CreateVolumesFromSnapshotTest-382606126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:46:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1592762623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a88be75b-a92b-45f2-9943-275fa2a3af1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='158d2d360c5648458441386f95f0a070',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:46:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:46:59Z,use_quota=True,user_id='894671b2d79d4f63ba2ddb35ba7c4c10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:47:00 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-fc0feccf-a2f6-4c51-8b0d-0654b82ea2dc tempest-CreateVolumesFromSnapshotTest-382606126 None] Creating volume a88be75b-a92b-45f2-9943-275fa2a3af1c {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:47:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-fc0feccf-a2f6-4c51-8b0d-0654b82ea2dc tempest-CreateVolumesFromSnapshotTest-382606126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:47:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-fc0feccf-a2f6-4c51-8b0d-0654b82ea2dc tempest-CreateVolumesFromSnapshotTest-382606126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:47:00 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-fc0feccf-a2f6-4c51-8b0d-0654b82ea2dc tempest-CreateVolumesFromSnapshotTest-382606126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:47:00 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-fc0feccf-a2f6-4c51-8b0d-0654b82ea2dc tempest-CreateVolumesFromSnapshotTest-382606126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:47:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-fc0feccf-a2f6-4c51-8b0d-0654b82ea2dc tempest-CreateVolumesFromSnapshotTest-382606126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:47:00 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-fc0feccf-a2f6-4c51-8b0d-0654b82ea2dc tempest-CreateVolumesFromSnapshotTest-382606126 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:47:00 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-fc0feccf-a2f6-4c51-8b0d-0654b82ea2dc tempest-CreateVolumesFromSnapshotTest-382606126 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:47:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-fc0feccf-a2f6-4c51-8b0d-0654b82ea2dc tempest-CreateVolumesFromSnapshotTest-382606126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a88be75b-a92b-45f2-9943-275fa2a3af1c 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:00 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d15a1e39-fdb5-456e-bfc7-777acd0110c7 tempest-CreateVolumesFromSnapshotTest-382606126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9350048e-82fd-4822-87ce-8a4cc7b365cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a44f1e54-c69f-4e7c-ab32-670ebcd820d7', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:47:00 devstack sudo[101370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a88be75b-a92b-45f2-9943-275fa2a3af1c 1073741824 Sep 18 21:47:00 devstack sudo[101370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:00 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d15a1e39-fdb5-456e-bfc7-777acd0110c7 tempest-CreateVolumesFromSnapshotTest-382606126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0052425-5d7b-4dc5-87d9-b4d66a3a457e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:47:00 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-d15a1e39-fdb5-456e-bfc7-777acd0110c7 tempest-CreateVolumesFromSnapshotTest-382606126 None] Volume volume-a44f1e54-c69f-4e7c-ab32-670ebcd820d7 (a44f1e54-c69f-4e7c-ab32-670ebcd820d7): created successfully Sep 18 21:47:00 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d15a1e39-fdb5-456e-bfc7-777acd0110c7 tempest-CreateVolumesFromSnapshotTest-382606126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0052425-5d7b-4dc5-87d9-b4d66a3a457e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:47:00 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d15a1e39-fdb5-456e-bfc7-777acd0110c7 tempest-CreateVolumesFromSnapshotTest-382606126 None] Flow 'volume_create_manager' (ad47e327-3891-4f85-9229-7ceec10d0f0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:47:00 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-d15a1e39-fdb5-456e-bfc7-777acd0110c7 tempest-CreateVolumesFromSnapshotTest-382606126 None] Created volume successfully. Sep 18 21:47:01 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-210754ce-cc47-45b9-9de2-263d781fdadf tempest-CreateVolumesFromSnapshotTest-382606126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:47:01 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-210754ce-cc47-45b9-9de2-263d781fdadf tempest-CreateVolumesFromSnapshotTest-382606126 None] Flow 'volume_create_manager' (6feb7d7a-7a8f-4ef6-bf49-fe29ed18a0f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:47:01 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-210754ce-cc47-45b9-9de2-263d781fdadf tempest-CreateVolumesFromSnapshotTest-382606126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90fdb614-f8e7-4dd3-873e-983079659a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:47:01 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-210754ce-cc47-45b9-9de2-263d781fdadf tempest-CreateVolumesFromSnapshotTest-382606126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90fdb614-f8e7-4dd3-873e-983079659a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:47:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-527946019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f34aec0-7319-42e5-bdd9-6bffbd2911b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='158d2d360c5648458441386f95f0a070',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:47:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:47:01Z,use_quota=True,user_id='894671b2d79d4f63ba2ddb35ba7c4c10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:47:01 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-210754ce-cc47-45b9-9de2-263d781fdadf tempest-CreateVolumesFromSnapshotTest-382606126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a95846d-5c0f-4665-82c3-eb03f9468cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:47:01 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-210754ce-cc47-45b9-9de2-263d781fdadf tempest-CreateVolumesFromSnapshotTest-382606126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a95846d-5c0f-4665-82c3-eb03f9468cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:47:01 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-210754ce-cc47-45b9-9de2-263d781fdadf tempest-CreateVolumesFromSnapshotTest-382606126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45622946-ba6d-4406-8389-fc556e06cf5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:47:01 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-210754ce-cc47-45b9-9de2-263d781fdadf tempest-CreateVolumesFromSnapshotTest-382606126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45622946-ba6d-4406-8389-fc556e06cf5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f34aec0-7319-42e5-bdd9-6bffbd2911b5', 'volume_name': 'volume-0f34aec0-7319-42e5-bdd9-6bffbd2911b5', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:47:01 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-210754ce-cc47-45b9-9de2-263d781fdadf tempest-CreateVolumesFromSnapshotTest-382606126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c1b9fb8-f827-4b88-a22b-cf30a21690b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:47:01 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-210754ce-cc47-45b9-9de2-263d781fdadf tempest-CreateVolumesFromSnapshotTest-382606126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c1b9fb8-f827-4b88-a22b-cf30a21690b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:47:01 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-210754ce-cc47-45b9-9de2-263d781fdadf tempest-CreateVolumesFromSnapshotTest-382606126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7adad04-10d5-4ba1-b61a-c7a1a8cad724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:47:01 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-210754ce-cc47-45b9-9de2-263d781fdadf tempest-CreateVolumesFromSnapshotTest-382606126 None] Volume 0f34aec0-7319-42e5-bdd9-6bffbd2911b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f34aec0-7319-42e5-bdd9-6bffbd2911b5', 'volume_size': 1} Sep 18 21:47:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-210754ce-cc47-45b9-9de2-263d781fdadf tempest-CreateVolumesFromSnapshotTest-382606126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:47:01 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fb09525-c497-4927-a6bc-430696c7a121 tempest-VolumesListAdminTestJSON-1184658396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:47:01 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6fb09525-c497-4927-a6bc-430696c7a121 tempest-VolumesListAdminTestJSON-1184658396 None] Flow 'volume_create_manager' (ccca5fe3-cb5c-4d7c-a721-81238ecb7edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:47:01 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6fb09525-c497-4927-a6bc-430696c7a121 tempest-VolumesListAdminTestJSON-1184658396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbecbc34-05dc-4bf2-8486-37004ec13e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:47:01 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6fb09525-c497-4927-a6bc-430696c7a121 tempest-VolumesListAdminTestJSON-1184658396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbecbc34-05dc-4bf2-8486-37004ec13e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:47:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-989611714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c29ba25b-07c7-4b15-9347-fc25b62ab8b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e93921b539f4c1f82194fe06c10ea94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:47:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:47:01Z,use_quota=True,user_id='7d57d36b405949869f1c0904ef5798ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:47:01 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6fb09525-c497-4927-a6bc-430696c7a121 tempest-VolumesListAdminTestJSON-1184658396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee174b60-c241-4ef9-b1cc-c4f32458fca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:47:01 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6fb09525-c497-4927-a6bc-430696c7a121 tempest-VolumesListAdminTestJSON-1184658396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee174b60-c241-4ef9-b1cc-c4f32458fca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:47:01 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6fb09525-c497-4927-a6bc-430696c7a121 tempest-VolumesListAdminTestJSON-1184658396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7c5cc88-20be-4381-b498-83ef320d91b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:47:01 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6fb09525-c497-4927-a6bc-430696c7a121 tempest-VolumesListAdminTestJSON-1184658396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7c5cc88-20be-4381-b498-83ef320d91b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c29ba25b-07c7-4b15-9347-fc25b62ab8b1', 'volume_name': 'volume-c29ba25b-07c7-4b15-9347-fc25b62ab8b1', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:47:01 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6fb09525-c497-4927-a6bc-430696c7a121 tempest-VolumesListAdminTestJSON-1184658396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68c8733c-b827-445d-8938-b71a08c18d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:47:01 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6fb09525-c497-4927-a6bc-430696c7a121 tempest-VolumesListAdminTestJSON-1184658396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68c8733c-b827-445d-8938-b71a08c18d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:47:01 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6fb09525-c497-4927-a6bc-430696c7a121 tempest-VolumesListAdminTestJSON-1184658396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (312dae56-0fa1-4534-8def-6832ceb57fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:47:01 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-6fb09525-c497-4927-a6bc-430696c7a121 tempest-VolumesListAdminTestJSON-1184658396 None] Volume c29ba25b-07c7-4b15-9347-fc25b62ab8b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c29ba25b-07c7-4b15-9347-fc25b62ab8b1', 'volume_size': 1} Sep 18 21:47:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6fb09525-c497-4927-a6bc-430696c7a121 tempest-VolumesListAdminTestJSON-1184658396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:47:01 devstack sudo[101370]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-fc0feccf-a2f6-4c51-8b0d-0654b82ea2dc tempest-CreateVolumesFromSnapshotTest-382606126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a88be75b-a92b-45f2-9943-275fa2a3af1c 1073741824" returned: 0 in 0.638s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-fc0feccf-a2f6-4c51-8b0d-0654b82ea2dc tempest-CreateVolumesFromSnapshotTest-382606126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a88be75b-a92b-45f2-9943-275fa2a3af1c {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:01 devstack sudo[101379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a88be75b-a92b-45f2-9943-275fa2a3af1c Sep 18 21:47:01 devstack sudo[101379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:01 devstack sudo[101379]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-fc0feccf-a2f6-4c51-8b0d-0654b82ea2dc tempest-CreateVolumesFromSnapshotTest-382606126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a88be75b-a92b-45f2-9943-275fa2a3af1c" returned: 0 in 0.260s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:01 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-fc0feccf-a2f6-4c51-8b0d-0654b82ea2dc tempest-CreateVolumesFromSnapshotTest-382606126 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:47:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-fc0feccf-a2f6-4c51-8b0d-0654b82ea2dc tempest-CreateVolumesFromSnapshotTest-382606126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:47:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-a79265a7-c7cc-4ba8-82fc-a20f01170922 tempest-CreateVolumesFromSnapshotTest-382606126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.929s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:47:01 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-a79265a7-c7cc-4ba8-82fc-a20f01170922 tempest-CreateVolumesFromSnapshotTest-382606126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:46:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1244223397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c790b51a-fabb-4a0a-a471-54e9c186adef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='158d2d360c5648458441386f95f0a070',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:46:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:46:59Z,use_quota=True,user_id='894671b2d79d4f63ba2ddb35ba7c4c10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:47:01 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-a79265a7-c7cc-4ba8-82fc-a20f01170922 tempest-CreateVolumesFromSnapshotTest-382606126 None] Creating volume c790b51a-fabb-4a0a-a471-54e9c186adef {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:47:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-a79265a7-c7cc-4ba8-82fc-a20f01170922 tempest-CreateVolumesFromSnapshotTest-382606126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:47:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-a79265a7-c7cc-4ba8-82fc-a20f01170922 tempest-CreateVolumesFromSnapshotTest-382606126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:47:01 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-a79265a7-c7cc-4ba8-82fc-a20f01170922 tempest-CreateVolumesFromSnapshotTest-382606126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:47:01 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-a79265a7-c7cc-4ba8-82fc-a20f01170922 tempest-CreateVolumesFromSnapshotTest-382606126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:47:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-a79265a7-c7cc-4ba8-82fc-a20f01170922 tempest-CreateVolumesFromSnapshotTest-382606126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:47:01 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-a79265a7-c7cc-4ba8-82fc-a20f01170922 tempest-CreateVolumesFromSnapshotTest-382606126 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:47:01 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-a79265a7-c7cc-4ba8-82fc-a20f01170922 tempest-CreateVolumesFromSnapshotTest-382606126 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:47:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-a79265a7-c7cc-4ba8-82fc-a20f01170922 tempest-CreateVolumesFromSnapshotTest-382606126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c790b51a-fabb-4a0a-a471-54e9c186adef 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:01 devstack sudo[101382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c790b51a-fabb-4a0a-a471-54e9c186adef 1073741824 Sep 18 21:47:01 devstack sudo[101382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:01 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-fc0feccf-a2f6-4c51-8b0d-0654b82ea2dc tempest-CreateVolumesFromSnapshotTest-382606126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fa42fd1-b26f-43dc-a1d6-e84725e39eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a88be75b-a92b-45f2-9943-275fa2a3af1c', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:47:01 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-fc0feccf-a2f6-4c51-8b0d-0654b82ea2dc tempest-CreateVolumesFromSnapshotTest-382606126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3c46710-1e89-4fe8-983f-42b6200b674d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:47:01 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-fc0feccf-a2f6-4c51-8b0d-0654b82ea2dc tempest-CreateVolumesFromSnapshotTest-382606126 None] Volume volume-a88be75b-a92b-45f2-9943-275fa2a3af1c (a88be75b-a92b-45f2-9943-275fa2a3af1c): created successfully Sep 18 21:47:01 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-fc0feccf-a2f6-4c51-8b0d-0654b82ea2dc tempest-CreateVolumesFromSnapshotTest-382606126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3c46710-1e89-4fe8-983f-42b6200b674d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:47:01 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-fc0feccf-a2f6-4c51-8b0d-0654b82ea2dc tempest-CreateVolumesFromSnapshotTest-382606126 None] Flow 'volume_create_manager' (5bcc2505-7b2c-42ab-be59-a6075ec2e0eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:47:01 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-fc0feccf-a2f6-4c51-8b0d-0654b82ea2dc tempest-CreateVolumesFromSnapshotTest-382606126 None] Created volume successfully. Sep 18 21:47:02 devstack sudo[101382]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:02 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-a79265a7-c7cc-4ba8-82fc-a20f01170922 tempest-CreateVolumesFromSnapshotTest-382606126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c790b51a-fabb-4a0a-a471-54e9c186adef 1073741824" returned: 0 in 0.563s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:02 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-a79265a7-c7cc-4ba8-82fc-a20f01170922 tempest-CreateVolumesFromSnapshotTest-382606126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c790b51a-fabb-4a0a-a471-54e9c186adef {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:02 devstack sudo[101392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c790b51a-fabb-4a0a-a471-54e9c186adef Sep 18 21:47:02 devstack sudo[101392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:02 devstack sudo[101392]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:02 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-a79265a7-c7cc-4ba8-82fc-a20f01170922 tempest-CreateVolumesFromSnapshotTest-382606126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c790b51a-fabb-4a0a-a471-54e9c186adef" returned: 0 in 0.272s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:02 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-a79265a7-c7cc-4ba8-82fc-a20f01170922 tempest-CreateVolumesFromSnapshotTest-382606126 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:47:02 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-a79265a7-c7cc-4ba8-82fc-a20f01170922 tempest-CreateVolumesFromSnapshotTest-382606126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:47:02 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6f2e5811-6788-4307-8e0e-dd166a33d2a8 tempest-CreateVolumesFromSnapshotTest-382606126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.124s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:47:02 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-6f2e5811-6788-4307-8e0e-dd166a33d2a8 tempest-CreateVolumesFromSnapshotTest-382606126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:46:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2041401097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d68e512-e012-4860-9319-e675791f6a6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='158d2d360c5648458441386f95f0a070',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:47:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:47:00Z,use_quota=True,user_id='894671b2d79d4f63ba2ddb35ba7c4c10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:47:02 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-6f2e5811-6788-4307-8e0e-dd166a33d2a8 tempest-CreateVolumesFromSnapshotTest-382606126 None] Creating volume 0d68e512-e012-4860-9319-e675791f6a6e {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:47:02 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6f2e5811-6788-4307-8e0e-dd166a33d2a8 tempest-CreateVolumesFromSnapshotTest-382606126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:47:02 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6f2e5811-6788-4307-8e0e-dd166a33d2a8 tempest-CreateVolumesFromSnapshotTest-382606126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:47:02 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-6f2e5811-6788-4307-8e0e-dd166a33d2a8 tempest-CreateVolumesFromSnapshotTest-382606126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:47:02 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-6f2e5811-6788-4307-8e0e-dd166a33d2a8 tempest-CreateVolumesFromSnapshotTest-382606126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:47:02 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6f2e5811-6788-4307-8e0e-dd166a33d2a8 tempest-CreateVolumesFromSnapshotTest-382606126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:47:02 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-6f2e5811-6788-4307-8e0e-dd166a33d2a8 tempest-CreateVolumesFromSnapshotTest-382606126 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:47:02 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-6f2e5811-6788-4307-8e0e-dd166a33d2a8 tempest-CreateVolumesFromSnapshotTest-382606126 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:47:02 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6f2e5811-6788-4307-8e0e-dd166a33d2a8 tempest-CreateVolumesFromSnapshotTest-382606126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-0d68e512-e012-4860-9319-e675791f6a6e 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:02 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-a79265a7-c7cc-4ba8-82fc-a20f01170922 tempest-CreateVolumesFromSnapshotTest-382606126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eae9a43e-0e8a-4b37-be7d-ce10cf97f3a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c790b51a-fabb-4a0a-a471-54e9c186adef', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:47:02 devstack sudo[101400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-0d68e512-e012-4860-9319-e675791f6a6e 1073741824 Sep 18 21:47:02 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-a79265a7-c7cc-4ba8-82fc-a20f01170922 tempest-CreateVolumesFromSnapshotTest-382606126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07067418-ccd8-4441-aa29-e578f28c44f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:47:02 devstack sudo[101400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:02 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-a79265a7-c7cc-4ba8-82fc-a20f01170922 tempest-CreateVolumesFromSnapshotTest-382606126 None] Volume volume-c790b51a-fabb-4a0a-a471-54e9c186adef (c790b51a-fabb-4a0a-a471-54e9c186adef): created successfully Sep 18 21:47:02 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-a79265a7-c7cc-4ba8-82fc-a20f01170922 tempest-CreateVolumesFromSnapshotTest-382606126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07067418-ccd8-4441-aa29-e578f28c44f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:47:02 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-a79265a7-c7cc-4ba8-82fc-a20f01170922 tempest-CreateVolumesFromSnapshotTest-382606126 None] Flow 'volume_create_manager' (8d646f79-b7fc-47b8-8fb1-1378cf514fd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:47:02 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-a79265a7-c7cc-4ba8-82fc-a20f01170922 tempest-CreateVolumesFromSnapshotTest-382606126 None] Created volume successfully. Sep 18 21:47:03 devstack sudo[101400]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6f2e5811-6788-4307-8e0e-dd166a33d2a8 tempest-CreateVolumesFromSnapshotTest-382606126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-0d68e512-e012-4860-9319-e675791f6a6e 1073741824" returned: 0 in 0.615s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6f2e5811-6788-4307-8e0e-dd166a33d2a8 tempest-CreateVolumesFromSnapshotTest-382606126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-0d68e512-e012-4860-9319-e675791f6a6e {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:03 devstack sudo[101408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-0d68e512-e012-4860-9319-e675791f6a6e Sep 18 21:47:03 devstack sudo[101408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:03 devstack sudo[101408]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6f2e5811-6788-4307-8e0e-dd166a33d2a8 tempest-CreateVolumesFromSnapshotTest-382606126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-0d68e512-e012-4860-9319-e675791f6a6e" returned: 0 in 0.303s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:03 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-6f2e5811-6788-4307-8e0e-dd166a33d2a8 tempest-CreateVolumesFromSnapshotTest-382606126 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:47:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6f2e5811-6788-4307-8e0e-dd166a33d2a8 tempest-CreateVolumesFromSnapshotTest-382606126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:47:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-210754ce-cc47-45b9-9de2-263d781fdadf tempest-CreateVolumesFromSnapshotTest-382606126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.311s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:47:03 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-210754ce-cc47-45b9-9de2-263d781fdadf tempest-CreateVolumesFromSnapshotTest-382606126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:47:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-527946019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f34aec0-7319-42e5-bdd9-6bffbd2911b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='158d2d360c5648458441386f95f0a070',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:47:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:47:01Z,use_quota=True,user_id='894671b2d79d4f63ba2ddb35ba7c4c10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:47:03 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-210754ce-cc47-45b9-9de2-263d781fdadf tempest-CreateVolumesFromSnapshotTest-382606126 None] Creating volume 0f34aec0-7319-42e5-bdd9-6bffbd2911b5 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:47:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-210754ce-cc47-45b9-9de2-263d781fdadf tempest-CreateVolumesFromSnapshotTest-382606126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:47:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-210754ce-cc47-45b9-9de2-263d781fdadf tempest-CreateVolumesFromSnapshotTest-382606126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:47:03 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-210754ce-cc47-45b9-9de2-263d781fdadf tempest-CreateVolumesFromSnapshotTest-382606126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:47:03 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-210754ce-cc47-45b9-9de2-263d781fdadf tempest-CreateVolumesFromSnapshotTest-382606126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:47:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-210754ce-cc47-45b9-9de2-263d781fdadf tempest-CreateVolumesFromSnapshotTest-382606126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:47:03 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-210754ce-cc47-45b9-9de2-263d781fdadf tempest-CreateVolumesFromSnapshotTest-382606126 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:47:03 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-210754ce-cc47-45b9-9de2-263d781fdadf tempest-CreateVolumesFromSnapshotTest-382606126 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:47:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-210754ce-cc47-45b9-9de2-263d781fdadf tempest-CreateVolumesFromSnapshotTest-382606126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-0f34aec0-7319-42e5-bdd9-6bffbd2911b5 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:03 devstack cinder-volume[86136]: INFO cinder.volume.manager [req-c875027e-191f-414e-b156-cf403dfc2b16 req-984331e1-320a-4270-8619-74d5bb5d1d15 tempest-TestStampPattern-580697789 None] Terminate volume connection completed successfully. Sep 18 21:47:03 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [req-c875027e-191f-414e-b156-cf403dfc2b16 req-984331e1-320a-4270-8619-74d5bb5d1d15 tempest-TestStampPattern-580697789 None] Deleting attachment f0a4e3b5-3f69-4b6b-8212-f3a672c6491b. {{(pid=86136) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 18 21:47:03 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6f2e5811-6788-4307-8e0e-dd166a33d2a8 tempest-CreateVolumesFromSnapshotTest-382606126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59bd90ec-e9b9-43d7-a3c3-63ebbe4a28d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d68e512-e012-4860-9319-e675791f6a6e', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:47:03 devstack sudo[101413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-0f34aec0-7319-42e5-bdd9-6bffbd2911b5 1073741824 Sep 18 21:47:03 devstack sudo[101413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:03 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6f2e5811-6788-4307-8e0e-dd166a33d2a8 tempest-CreateVolumesFromSnapshotTest-382606126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf243b9f-f55d-4d92-92e9-ff93480e7c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:47:03 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-6f2e5811-6788-4307-8e0e-dd166a33d2a8 tempest-CreateVolumesFromSnapshotTest-382606126 None] Volume volume-0d68e512-e012-4860-9319-e675791f6a6e (0d68e512-e012-4860-9319-e675791f6a6e): created successfully Sep 18 21:47:03 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6f2e5811-6788-4307-8e0e-dd166a33d2a8 tempest-CreateVolumesFromSnapshotTest-382606126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf243b9f-f55d-4d92-92e9-ff93480e7c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:47:03 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6f2e5811-6788-4307-8e0e-dd166a33d2a8 tempest-CreateVolumesFromSnapshotTest-382606126 None] Flow 'volume_create_manager' (04c516eb-1548-4fc1-a67a-4c5efeb37278) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:47:03 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-6f2e5811-6788-4307-8e0e-dd166a33d2a8 tempest-CreateVolumesFromSnapshotTest-382606126 None] Created volume successfully. Sep 18 21:47:03 devstack sudo[101413]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-210754ce-cc47-45b9-9de2-263d781fdadf tempest-CreateVolumesFromSnapshotTest-382606126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-0f34aec0-7319-42e5-bdd9-6bffbd2911b5 1073741824" returned: 0 in 0.567s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-210754ce-cc47-45b9-9de2-263d781fdadf tempest-CreateVolumesFromSnapshotTest-382606126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-0f34aec0-7319-42e5-bdd9-6bffbd2911b5 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:04 devstack sudo[101419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-0f34aec0-7319-42e5-bdd9-6bffbd2911b5 Sep 18 21:47:04 devstack sudo[101419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:04 devstack sudo[101419]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-210754ce-cc47-45b9-9de2-263d781fdadf tempest-CreateVolumesFromSnapshotTest-382606126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-0f34aec0-7319-42e5-bdd9-6bffbd2911b5" returned: 0 in 0.306s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:04 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-210754ce-cc47-45b9-9de2-263d781fdadf tempest-CreateVolumesFromSnapshotTest-382606126 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:47:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-210754ce-cc47-45b9-9de2-263d781fdadf tempest-CreateVolumesFromSnapshotTest-382606126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:47:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6fb09525-c497-4927-a6bc-430696c7a121 tempest-VolumesListAdminTestJSON-1184658396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.148s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:47:04 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-6fb09525-c497-4927-a6bc-430696c7a121 tempest-VolumesListAdminTestJSON-1184658396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:47:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-989611714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c29ba25b-07c7-4b15-9347-fc25b62ab8b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e93921b539f4c1f82194fe06c10ea94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:47:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:47:01Z,use_quota=True,user_id='7d57d36b405949869f1c0904ef5798ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:47:04 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-6fb09525-c497-4927-a6bc-430696c7a121 tempest-VolumesListAdminTestJSON-1184658396 None] Creating volume c29ba25b-07c7-4b15-9347-fc25b62ab8b1 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:47:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6fb09525-c497-4927-a6bc-430696c7a121 tempest-VolumesListAdminTestJSON-1184658396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:47:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6fb09525-c497-4927-a6bc-430696c7a121 tempest-VolumesListAdminTestJSON-1184658396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:47:04 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-6fb09525-c497-4927-a6bc-430696c7a121 tempest-VolumesListAdminTestJSON-1184658396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:47:04 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-6fb09525-c497-4927-a6bc-430696c7a121 tempest-VolumesListAdminTestJSON-1184658396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:47:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6fb09525-c497-4927-a6bc-430696c7a121 tempest-VolumesListAdminTestJSON-1184658396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:47:04 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-6fb09525-c497-4927-a6bc-430696c7a121 tempest-VolumesListAdminTestJSON-1184658396 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:47:04 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-6fb09525-c497-4927-a6bc-430696c7a121 tempest-VolumesListAdminTestJSON-1184658396 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:47:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6fb09525-c497-4927-a6bc-430696c7a121 tempest-VolumesListAdminTestJSON-1184658396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c29ba25b-07c7-4b15-9347-fc25b62ab8b1 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:04 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-210754ce-cc47-45b9-9de2-263d781fdadf tempest-CreateVolumesFromSnapshotTest-382606126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7adad04-10d5-4ba1-b61a-c7a1a8cad724) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f34aec0-7319-42e5-bdd9-6bffbd2911b5', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:47:04 devstack sudo[101423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c29ba25b-07c7-4b15-9347-fc25b62ab8b1 1073741824 Sep 18 21:47:04 devstack sudo[101423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:04 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-210754ce-cc47-45b9-9de2-263d781fdadf tempest-CreateVolumesFromSnapshotTest-382606126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98026992-a981-4a41-aba7-b28a4d818a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:47:04 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-210754ce-cc47-45b9-9de2-263d781fdadf tempest-CreateVolumesFromSnapshotTest-382606126 None] Volume volume-0f34aec0-7319-42e5-bdd9-6bffbd2911b5 (0f34aec0-7319-42e5-bdd9-6bffbd2911b5): created successfully Sep 18 21:47:04 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-210754ce-cc47-45b9-9de2-263d781fdadf tempest-CreateVolumesFromSnapshotTest-382606126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98026992-a981-4a41-aba7-b28a4d818a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:47:04 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-210754ce-cc47-45b9-9de2-263d781fdadf tempest-CreateVolumesFromSnapshotTest-382606126 None] Flow 'volume_create_manager' (6feb7d7a-7a8f-4ef6-bf49-fe29ed18a0f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:47:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-78f7ee12-eaa8-48d5-bf7d-f8c9fde6ac30 tempest-TestStampPattern-580697789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:47:04 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-210754ce-cc47-45b9-9de2-263d781fdadf tempest-CreateVolumesFromSnapshotTest-382606126 None] Created volume successfully. Sep 18 21:47:04 devstack sudo[101423]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6fb09525-c497-4927-a6bc-430696c7a121 tempest-VolumesListAdminTestJSON-1184658396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c29ba25b-07c7-4b15-9347-fc25b62ab8b1 1073741824" returned: 0 in 0.546s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6fb09525-c497-4927-a6bc-430696c7a121 tempest-VolumesListAdminTestJSON-1184658396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c29ba25b-07c7-4b15-9347-fc25b62ab8b1 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:04 devstack sudo[101435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c29ba25b-07c7-4b15-9347-fc25b62ab8b1 Sep 18 21:47:04 devstack sudo[101435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:05 devstack cinder-volume[86136]: DEBUG oslo_service.periodic_task [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86136) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 21:47:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:47:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:47:05 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:47:05 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:47:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:47:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:05 devstack sudo[101437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:47:05 devstack sudo[101437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:05 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-9efc4258-c7aa-4aea-9d8f-8c9cad01a9fb tempest-CreateVolumesFromSnapshotTest-382606126 None] Acquiring lock "cinder-0f34aec0-7319-42e5-bdd9-6bffbd2911b5-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:47:05 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-9efc4258-c7aa-4aea-9d8f-8c9cad01a9fb tempest-CreateVolumesFromSnapshotTest-382606126 None] Lock "cinder-0f34aec0-7319-42e5-bdd9-6bffbd2911b5-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:47:05 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-9efc4258-c7aa-4aea-9d8f-8c9cad01a9fb tempest-CreateVolumesFromSnapshotTest-382606126 None] Acquiring lock "cinder-quobyte-0f34aec0-7319-42e5-bdd9-6bffbd2911b5" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:47:05 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-9efc4258-c7aa-4aea-9d8f-8c9cad01a9fb tempest-CreateVolumesFromSnapshotTest-382606126 None] Lock "cinder-quobyte-0f34aec0-7319-42e5-bdd9-6bffbd2911b5" acquired by "delete_volume" :: waited 0.017s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:47:05 devstack sudo[101435]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6fb09525-c497-4927-a6bc-430696c7a121 tempest-VolumesListAdminTestJSON-1184658396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c29ba25b-07c7-4b15-9347-fc25b62ab8b1" returned: 0 in 0.441s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:05 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-6fb09525-c497-4927-a6bc-430696c7a121 tempest-VolumesListAdminTestJSON-1184658396 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:47:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6fb09525-c497-4927-a6bc-430696c7a121 tempest-VolumesListAdminTestJSON-1184658396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:47:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-78f7ee12-eaa8-48d5-bf7d-f8c9fde6ac30 tempest-TestStampPattern-580697789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.957s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:47:05 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[71842808-fac0-4597-aaaf-06587d614106]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:47:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9efc4258-c7aa-4aea-9d8f-8c9cad01a9fb tempest-CreateVolumesFromSnapshotTest-382606126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-0f34aec0-7319-42e5-bdd9-6bffbd2911b5 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:05 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6fb09525-c497-4927-a6bc-430696c7a121 tempest-VolumesListAdminTestJSON-1184658396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (312dae56-0fa1-4534-8def-6832ceb57fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c29ba25b-07c7-4b15-9347-fc25b62ab8b1', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:47:05 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6fb09525-c497-4927-a6bc-430696c7a121 tempest-VolumesListAdminTestJSON-1184658396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3ff8604-2d4d-44f9-832a-0bd59e59676f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:47:05 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-78f7ee12-eaa8-48d5-bf7d-f8c9fde6ac30 tempest-TestStampPattern-580697789 None] Creating offline snapshot 8781d896-20dd-4f26-a8c4-7feb8d88d94e of volume a6eaf836-5be5-4ea9-a3b4-497ffeaa19df {{(pid=86136) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 21:47:05 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ebea425-0f36-41a5-adab-c2a5d9c159a7]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:47:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-78f7ee12-eaa8-48d5-bf7d-f8c9fde6ac30 tempest-TestStampPattern-580697789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a6eaf836-5be5-4ea9-a3b4-497ffeaa19df {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:05 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-6fb09525-c497-4927-a6bc-430696c7a121 tempest-VolumesListAdminTestJSON-1184658396 None] Volume volume-c29ba25b-07c7-4b15-9347-fc25b62ab8b1 (c29ba25b-07c7-4b15-9347-fc25b62ab8b1): created successfully Sep 18 21:47:05 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6fb09525-c497-4927-a6bc-430696c7a121 tempest-VolumesListAdminTestJSON-1184658396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3ff8604-2d4d-44f9-832a-0bd59e59676f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:47:05 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6fb09525-c497-4927-a6bc-430696c7a121 tempest-VolumesListAdminTestJSON-1184658396 None] Flow 'volume_create_manager' (ccca5fe3-cb5c-4d7c-a721-81238ecb7edb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:47:05 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-6fb09525-c497-4927-a6bc-430696c7a121 tempest-VolumesListAdminTestJSON-1184658396 None] Created volume successfully. Sep 18 21:47:05 devstack sudo[101437]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.416s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:05 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:47:05 devstack cinder-volume[86136]: DEBUG oslo_service.periodic_task [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Running periodic task VolumeManager._thread_info {{(pid=86136) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 21:47:05 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] thread count: 28 {{(pid=86136) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 18 21:47:05 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] thread info: [<_MainThread(MainThread, started 138548347871360)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86136) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 18 21:47:05 devstack sudo[101440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-0f34aec0-7319-42e5-bdd9-6bffbd2911b5 Sep 18 21:47:05 devstack sudo[101440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:05 devstack sudo[101442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a6eaf836-5be5-4ea9-a3b4-497ffeaa19df Sep 18 21:47:05 devstack sudo[101442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:05 devstack sudo[101440]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9efc4258-c7aa-4aea-9d8f-8c9cad01a9fb tempest-CreateVolumesFromSnapshotTest-382606126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-0f34aec0-7319-42e5-bdd9-6bffbd2911b5" returned: 0 in 0.548s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9efc4258-c7aa-4aea-9d8f-8c9cad01a9fb tempest-CreateVolumesFromSnapshotTest-382606126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-0f34aec0-7319-42e5-bdd9-6bffbd2911b5 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:06 devstack sudo[101451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-0f34aec0-7319-42e5-bdd9-6bffbd2911b5 Sep 18 21:47:06 devstack sudo[101451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:06 devstack sudo[101442]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:06 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-78f7ee12-eaa8-48d5-bf7d-f8c9fde6ac30 tempest-TestStampPattern-580697789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a6eaf836-5be5-4ea9-a3b4-497ffeaa19df" returned: 0 in 0.587s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:06 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-78f7ee12-eaa8-48d5-bf7d-f8c9fde6ac30 tempest-TestStampPattern-580697789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a6eaf836-5be5-4ea9-a3b4-497ffeaa19df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a6eaf836-5be5-4ea9-a3b4-497ffeaa19df.8781d896-20dd-4f26-a8c4-7feb8d88d94e 1G {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:06 devstack sudo[101454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a6eaf836-5be5-4ea9-a3b4-497ffeaa19df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a6eaf836-5be5-4ea9-a3b4-497ffeaa19df.8781d896-20dd-4f26-a8c4-7feb8d88d94e 1G Sep 18 21:47:06 devstack sudo[101454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:06 devstack sudo[101451]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:06 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9efc4258-c7aa-4aea-9d8f-8c9cad01a9fb tempest-CreateVolumesFromSnapshotTest-382606126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-0f34aec0-7319-42e5-bdd9-6bffbd2911b5" returned: 0 in 0.333s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:06 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-9efc4258-c7aa-4aea-9d8f-8c9cad01a9fb tempest-CreateVolumesFromSnapshotTest-382606126 None] Lock "cinder-quobyte-0f34aec0-7319-42e5-bdd9-6bffbd2911b5" released by "delete_volume" :: held 1.008s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:47:06 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-9efc4258-c7aa-4aea-9d8f-8c9cad01a9fb tempest-CreateVolumesFromSnapshotTest-382606126 None] Created reservations ['d4946b69-c238-41e3-9fe7-32d6e488bb5b', '89af298c-9cd4-449c-a394-c479f85f1c2e', 'e2d1dd18-4b7f-4696-9448-030308d2a422', '0559125e-8af0-409c-8492-1c95601d30f5'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:47:06 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-9efc4258-c7aa-4aea-9d8f-8c9cad01a9fb tempest-CreateVolumesFromSnapshotTest-382606126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:47:06 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-9efc4258-c7aa-4aea-9d8f-8c9cad01a9fb tempest-CreateVolumesFromSnapshotTest-382606126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:47:06 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-9efc4258-c7aa-4aea-9d8f-8c9cad01a9fb tempest-CreateVolumesFromSnapshotTest-382606126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:47:06 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-9efc4258-c7aa-4aea-9d8f-8c9cad01a9fb tempest-CreateVolumesFromSnapshotTest-382606126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:47:06 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-9efc4258-c7aa-4aea-9d8f-8c9cad01a9fb tempest-CreateVolumesFromSnapshotTest-382606126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:47:06 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9efc4258-c7aa-4aea-9d8f-8c9cad01a9fb tempest-CreateVolumesFromSnapshotTest-382606126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:06 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-f934879e-2c76-44d1-95c8-77d34e3aaf64 tempest-VolumesListAdminTestJSON-1184658396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:47:06 devstack sudo[101460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:47:06 devstack sudo[101460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:06 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f934879e-2c76-44d1-95c8-77d34e3aaf64 tempest-VolumesListAdminTestJSON-1184658396 None] Flow 'volume_create_manager' (4a6ec0f0-143c-4afb-a399-d7176ddf2188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:47:06 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f934879e-2c76-44d1-95c8-77d34e3aaf64 tempest-VolumesListAdminTestJSON-1184658396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3e4fe13-b670-4278-a964-34de3727acad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:47:06 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f934879e-2c76-44d1-95c8-77d34e3aaf64 tempest-VolumesListAdminTestJSON-1184658396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3e4fe13-b670-4278-a964-34de3727acad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:47:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-568289708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f68e0a8-9cb2-4708-bb8d-8da6c9492863,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e93921b539f4c1f82194fe06c10ea94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:47:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:47:07Z,use_quota=True,user_id='7d57d36b405949869f1c0904ef5798ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:47:06 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f934879e-2c76-44d1-95c8-77d34e3aaf64 tempest-VolumesListAdminTestJSON-1184658396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa59f490-39c3-422c-bdf2-6d5d8f787ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:47:06 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f934879e-2c76-44d1-95c8-77d34e3aaf64 tempest-VolumesListAdminTestJSON-1184658396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa59f490-39c3-422c-bdf2-6d5d8f787ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:47:06 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f934879e-2c76-44d1-95c8-77d34e3aaf64 tempest-VolumesListAdminTestJSON-1184658396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be8dd4af-6ffe-438e-bafe-0e63ff6747c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:47:06 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f934879e-2c76-44d1-95c8-77d34e3aaf64 tempest-VolumesListAdminTestJSON-1184658396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be8dd4af-6ffe-438e-bafe-0e63ff6747c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f68e0a8-9cb2-4708-bb8d-8da6c9492863', 'volume_name': 'volume-5f68e0a8-9cb2-4708-bb8d-8da6c9492863', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:47:06 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f934879e-2c76-44d1-95c8-77d34e3aaf64 tempest-VolumesListAdminTestJSON-1184658396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a21d681-909f-41ef-8acc-3abc14771ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:47:06 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f934879e-2c76-44d1-95c8-77d34e3aaf64 tempest-VolumesListAdminTestJSON-1184658396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a21d681-909f-41ef-8acc-3abc14771ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:47:06 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f934879e-2c76-44d1-95c8-77d34e3aaf64 tempest-VolumesListAdminTestJSON-1184658396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f637cd3a-5fc8-4433-ab0e-7943e8dfc072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:47:06 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-f934879e-2c76-44d1-95c8-77d34e3aaf64 tempest-VolumesListAdminTestJSON-1184658396 None] Volume 5f68e0a8-9cb2-4708-bb8d-8da6c9492863: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f68e0a8-9cb2-4708-bb8d-8da6c9492863', 'volume_size': 1} Sep 18 21:47:06 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-f934879e-2c76-44d1-95c8-77d34e3aaf64 tempest-VolumesListAdminTestJSON-1184658396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:47:06 devstack sudo[101454]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:06 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-78f7ee12-eaa8-48d5-bf7d-f8c9fde6ac30 tempest-TestStampPattern-580697789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a6eaf836-5be5-4ea9-a3b4-497ffeaa19df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a6eaf836-5be5-4ea9-a3b4-497ffeaa19df.8781d896-20dd-4f26-a8c4-7feb8d88d94e 1G" returned: 0 in 0.683s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:06 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-78f7ee12-eaa8-48d5-bf7d-f8c9fde6ac30 tempest-TestStampPattern-580697789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6eaf836-5be5-4ea9-a3b4-497ffeaa19df -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a6eaf836-5be5-4ea9-a3b4-497ffeaa19df.8781d896-20dd-4f26-a8c4-7feb8d88d94e {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:06 devstack sudo[101463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6eaf836-5be5-4ea9-a3b4-497ffeaa19df -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a6eaf836-5be5-4ea9-a3b4-497ffeaa19df.8781d896-20dd-4f26-a8c4-7feb8d88d94e Sep 18 21:47:06 devstack sudo[101463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:06 devstack sudo[101460]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:06 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9efc4258-c7aa-4aea-9d8f-8c9cad01a9fb tempest-CreateVolumesFromSnapshotTest-382606126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.282s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:06 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-9efc4258-c7aa-4aea-9d8f-8c9cad01a9fb tempest-CreateVolumesFromSnapshotTest-382606126 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:47:06 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-9efc4258-c7aa-4aea-9d8f-8c9cad01a9fb tempest-CreateVolumesFromSnapshotTest-382606126 None] Deleted volume successfully. Sep 18 21:47:06 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-9efc4258-c7aa-4aea-9d8f-8c9cad01a9fb tempest-CreateVolumesFromSnapshotTest-382606126 None] Lock "cinder-0f34aec0-7319-42e5-bdd9-6bffbd2911b5-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:47:07 devstack sudo[101463]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:07 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-78f7ee12-eaa8-48d5-bf7d-f8c9fde6ac30 tempest-TestStampPattern-580697789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6eaf836-5be5-4ea9-a3b4-497ffeaa19df -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a6eaf836-5be5-4ea9-a3b4-497ffeaa19df.8781d896-20dd-4f26-a8c4-7feb8d88d94e" returned: 0 in 0.327s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:07 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-78f7ee12-eaa8-48d5-bf7d-f8c9fde6ac30 tempest-TestStampPattern-580697789 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a6eaf836-5be5-4ea9-a3b4-497ffeaa19df.8781d896-20dd-4f26-a8c4-7feb8d88d94e is being set with open permissions: ugo+rw Sep 18 21:47:07 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-78f7ee12-eaa8-48d5-bf7d-f8c9fde6ac30 tempest-TestStampPattern-580697789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a6eaf836-5be5-4ea9-a3b4-497ffeaa19df.8781d896-20dd-4f26-a8c4-7feb8d88d94e {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:07 devstack sudo[101469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a6eaf836-5be5-4ea9-a3b4-497ffeaa19df.8781d896-20dd-4f26-a8c4-7feb8d88d94e Sep 18 21:47:07 devstack sudo[101469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:07 devstack sudo[101469]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:07 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-78f7ee12-eaa8-48d5-bf7d-f8c9fde6ac30 tempest-TestStampPattern-580697789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a6eaf836-5be5-4ea9-a3b4-497ffeaa19df.8781d896-20dd-4f26-a8c4-7feb8d88d94e" returned: 0 in 0.261s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:07 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-78f7ee12-eaa8-48d5-bf7d-f8c9fde6ac30 tempest-TestStampPattern-580697789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a6eaf836-5be5-4ea9-a3b4-497ffeaa19df.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:07 devstack sudo[101472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a6eaf836-5be5-4ea9-a3b4-497ffeaa19df.info Sep 18 21:47:07 devstack sudo[101472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:07 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-31054ec1-9b85-47aa-b2de-729bcd495795 tempest-CreateVolumesFromSnapshotTest-382606126 None] Acquiring lock "cinder-0d68e512-e012-4860-9319-e675791f6a6e-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:47:07 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-31054ec1-9b85-47aa-b2de-729bcd495795 tempest-CreateVolumesFromSnapshotTest-382606126 None] Lock "cinder-0d68e512-e012-4860-9319-e675791f6a6e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:47:07 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-31054ec1-9b85-47aa-b2de-729bcd495795 tempest-CreateVolumesFromSnapshotTest-382606126 None] Acquiring lock "cinder-quobyte-0d68e512-e012-4860-9319-e675791f6a6e" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:47:07 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-31054ec1-9b85-47aa-b2de-729bcd495795 tempest-CreateVolumesFromSnapshotTest-382606126 None] Lock "cinder-quobyte-0d68e512-e012-4860-9319-e675791f6a6e" acquired by "delete_volume" :: waited 0.015s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:47:07 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[224e58dd-6bb8-45a4-82d7-b9b3c06a9e8d]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:47:07 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-31054ec1-9b85-47aa-b2de-729bcd495795 tempest-CreateVolumesFromSnapshotTest-382606126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-0d68e512-e012-4860-9319-e675791f6a6e {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:07 devstack sudo[101472]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:07 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-78f7ee12-eaa8-48d5-bf7d-f8c9fde6ac30 tempest-TestStampPattern-580697789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a6eaf836-5be5-4ea9-a3b4-497ffeaa19df.info" returned: 0 in 0.322s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:07 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-78f7ee12-eaa8-48d5-bf7d-f8c9fde6ac30 tempest-TestStampPattern-580697789 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a6eaf836-5be5-4ea9-a3b4-497ffeaa19df.info is being set with open permissions: ugo+rw Sep 18 21:47:07 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-78f7ee12-eaa8-48d5-bf7d-f8c9fde6ac30 tempest-TestStampPattern-580697789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a6eaf836-5be5-4ea9-a3b4-497ffeaa19df.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:07 devstack sudo[101476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a6eaf836-5be5-4ea9-a3b4-497ffeaa19df.info Sep 18 21:47:07 devstack sudo[101476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:07 devstack sudo[101474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-0d68e512-e012-4860-9319-e675791f6a6e Sep 18 21:47:07 devstack sudo[101474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:08 devstack sudo[101476]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-78f7ee12-eaa8-48d5-bf7d-f8c9fde6ac30 tempest-TestStampPattern-580697789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a6eaf836-5be5-4ea9-a3b4-497ffeaa19df.info" returned: 0 in 0.292s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-78f7ee12-eaa8-48d5-bf7d-f8c9fde6ac30 tempest-TestStampPattern-580697789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.642s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:47:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-f934879e-2c76-44d1-95c8-77d34e3aaf64 tempest-VolumesListAdminTestJSON-1184658396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.319s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:47:08 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-f934879e-2c76-44d1-95c8-77d34e3aaf64 tempest-VolumesListAdminTestJSON-1184658396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:47:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-568289708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f68e0a8-9cb2-4708-bb8d-8da6c9492863,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e93921b539f4c1f82194fe06c10ea94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:47:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:47:07Z,use_quota=True,user_id='7d57d36b405949869f1c0904ef5798ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:47:08 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-f934879e-2c76-44d1-95c8-77d34e3aaf64 tempest-VolumesListAdminTestJSON-1184658396 None] Creating volume 5f68e0a8-9cb2-4708-bb8d-8da6c9492863 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:47:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-f934879e-2c76-44d1-95c8-77d34e3aaf64 tempest-VolumesListAdminTestJSON-1184658396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:47:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-f934879e-2c76-44d1-95c8-77d34e3aaf64 tempest-VolumesListAdminTestJSON-1184658396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:47:08 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-f934879e-2c76-44d1-95c8-77d34e3aaf64 tempest-VolumesListAdminTestJSON-1184658396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:47:08 devstack sudo[101474]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:08 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-f934879e-2c76-44d1-95c8-77d34e3aaf64 tempest-VolumesListAdminTestJSON-1184658396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:47:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-f934879e-2c76-44d1-95c8-77d34e3aaf64 tempest-VolumesListAdminTestJSON-1184658396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:47:08 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-f934879e-2c76-44d1-95c8-77d34e3aaf64 tempest-VolumesListAdminTestJSON-1184658396 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:47:08 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-f934879e-2c76-44d1-95c8-77d34e3aaf64 tempest-VolumesListAdminTestJSON-1184658396 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:47:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f934879e-2c76-44d1-95c8-77d34e3aaf64 tempest-VolumesListAdminTestJSON-1184658396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-5f68e0a8-9cb2-4708-bb8d-8da6c9492863 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-31054ec1-9b85-47aa-b2de-729bcd495795 tempest-CreateVolumesFromSnapshotTest-382606126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-0d68e512-e012-4860-9319-e675791f6a6e" returned: 0 in 0.446s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-31054ec1-9b85-47aa-b2de-729bcd495795 tempest-CreateVolumesFromSnapshotTest-382606126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-0d68e512-e012-4860-9319-e675791f6a6e {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:08 devstack sudo[101486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-5f68e0a8-9cb2-4708-bb8d-8da6c9492863 1073741824 Sep 18 21:47:08 devstack sudo[101486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:08 devstack sudo[101487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-0d68e512-e012-4860-9319-e675791f6a6e Sep 18 21:47:08 devstack sudo[101487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:08 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-78f7ee12-eaa8-48d5-bf7d-f8c9fde6ac30 tempest-TestStampPattern-580697789 None] Create snapshot completed successfully Sep 18 21:47:08 devstack sudo[101487]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-31054ec1-9b85-47aa-b2de-729bcd495795 tempest-CreateVolumesFromSnapshotTest-382606126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-0d68e512-e012-4860-9319-e675791f6a6e" returned: 0 in 0.303s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:08 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-31054ec1-9b85-47aa-b2de-729bcd495795 tempest-CreateVolumesFromSnapshotTest-382606126 None] Lock "cinder-quobyte-0d68e512-e012-4860-9319-e675791f6a6e" released by "delete_volume" :: held 0.801s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:47:08 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-31054ec1-9b85-47aa-b2de-729bcd495795 tempest-CreateVolumesFromSnapshotTest-382606126 None] Created reservations ['676fcd18-f8b7-4128-bca8-b1395fc3b941', 'd24d5ef4-7a43-4cbd-acb7-f95892bab95c', 'd3efd67e-12a2-4bb3-934b-569803309391', '9aed9797-eff1-4fb2-8e2a-5ff12f2c26ce'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:47:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-31054ec1-9b85-47aa-b2de-729bcd495795 tempest-CreateVolumesFromSnapshotTest-382606126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:47:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-31054ec1-9b85-47aa-b2de-729bcd495795 tempest-CreateVolumesFromSnapshotTest-382606126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:47:08 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-31054ec1-9b85-47aa-b2de-729bcd495795 tempest-CreateVolumesFromSnapshotTest-382606126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:47:08 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-31054ec1-9b85-47aa-b2de-729bcd495795 tempest-CreateVolumesFromSnapshotTest-382606126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:47:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-31054ec1-9b85-47aa-b2de-729bcd495795 tempest-CreateVolumesFromSnapshotTest-382606126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:47:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-31054ec1-9b85-47aa-b2de-729bcd495795 tempest-CreateVolumesFromSnapshotTest-382606126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:08 devstack sudo[101486]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f934879e-2c76-44d1-95c8-77d34e3aaf64 tempest-VolumesListAdminTestJSON-1184658396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-5f68e0a8-9cb2-4708-bb8d-8da6c9492863 1073741824" returned: 0 in 0.561s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:08 devstack sudo[101495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:47:08 devstack sudo[101495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f934879e-2c76-44d1-95c8-77d34e3aaf64 tempest-VolumesListAdminTestJSON-1184658396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-5f68e0a8-9cb2-4708-bb8d-8da6c9492863 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:08 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-f3f77475-6195-4d4e-9067-203cb78025a3 tempest-CreateVolumesFromSnapshotTest-382606126 None] Acquiring lock "cinder-c790b51a-fabb-4a0a-a471-54e9c186adef-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:47:08 devstack sudo[101497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-5f68e0a8-9cb2-4708-bb8d-8da6c9492863 Sep 18 21:47:08 devstack sudo[101497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:08 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-f3f77475-6195-4d4e-9067-203cb78025a3 tempest-CreateVolumesFromSnapshotTest-382606126 None] Lock "cinder-c790b51a-fabb-4a0a-a471-54e9c186adef-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:47:08 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-f3f77475-6195-4d4e-9067-203cb78025a3 tempest-CreateVolumesFromSnapshotTest-382606126 None] Acquiring lock "cinder-quobyte-c790b51a-fabb-4a0a-a471-54e9c186adef" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:47:08 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-f3f77475-6195-4d4e-9067-203cb78025a3 tempest-CreateVolumesFromSnapshotTest-382606126 None] Lock "cinder-quobyte-c790b51a-fabb-4a0a-a471-54e9c186adef" acquired by "delete_volume" :: waited 0.039s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:47:08 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc55aec-ced1-4f87-a75b-61833aa3666b]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:47:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f3f77475-6195-4d4e-9067-203cb78025a3 tempest-CreateVolumesFromSnapshotTest-382606126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c790b51a-fabb-4a0a-a471-54e9c186adef {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:08 devstack sudo[101497]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f934879e-2c76-44d1-95c8-77d34e3aaf64 tempest-VolumesListAdminTestJSON-1184658396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-5f68e0a8-9cb2-4708-bb8d-8da6c9492863" returned: 0 in 0.292s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:08 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-f934879e-2c76-44d1-95c8-77d34e3aaf64 tempest-VolumesListAdminTestJSON-1184658396 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:47:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-f934879e-2c76-44d1-95c8-77d34e3aaf64 tempest-VolumesListAdminTestJSON-1184658396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:47:08 devstack sudo[101495]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-31054ec1-9b85-47aa-b2de-729bcd495795 tempest-CreateVolumesFromSnapshotTest-382606126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.382s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:09 devstack sudo[101499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c790b51a-fabb-4a0a-a471-54e9c186adef Sep 18 21:47:09 devstack sudo[101499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:09 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-31054ec1-9b85-47aa-b2de-729bcd495795 tempest-CreateVolumesFromSnapshotTest-382606126 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:47:09 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f934879e-2c76-44d1-95c8-77d34e3aaf64 tempest-VolumesListAdminTestJSON-1184658396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f637cd3a-5fc8-4433-ab0e-7943e8dfc072) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f68e0a8-9cb2-4708-bb8d-8da6c9492863', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:47:09 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f934879e-2c76-44d1-95c8-77d34e3aaf64 tempest-VolumesListAdminTestJSON-1184658396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bb4ad30-3fa9-41d9-8e67-94df5a419fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:47:09 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-31054ec1-9b85-47aa-b2de-729bcd495795 tempest-CreateVolumesFromSnapshotTest-382606126 None] Deleted volume successfully. Sep 18 21:47:09 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-f934879e-2c76-44d1-95c8-77d34e3aaf64 tempest-VolumesListAdminTestJSON-1184658396 None] Volume volume-5f68e0a8-9cb2-4708-bb8d-8da6c9492863 (5f68e0a8-9cb2-4708-bb8d-8da6c9492863): created successfully Sep 18 21:47:09 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f934879e-2c76-44d1-95c8-77d34e3aaf64 tempest-VolumesListAdminTestJSON-1184658396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bb4ad30-3fa9-41d9-8e67-94df5a419fb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:47:09 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f934879e-2c76-44d1-95c8-77d34e3aaf64 tempest-VolumesListAdminTestJSON-1184658396 None] Flow 'volume_create_manager' (4a6ec0f0-143c-4afb-a399-d7176ddf2188) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:47:09 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-31054ec1-9b85-47aa-b2de-729bcd495795 tempest-CreateVolumesFromSnapshotTest-382606126 None] Lock "cinder-0d68e512-e012-4860-9319-e675791f6a6e-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:47:09 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-f934879e-2c76-44d1-95c8-77d34e3aaf64 tempest-VolumesListAdminTestJSON-1184658396 None] Created volume successfully. Sep 18 21:47:09 devstack sudo[101499]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f3f77475-6195-4d4e-9067-203cb78025a3 tempest-CreateVolumesFromSnapshotTest-382606126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c790b51a-fabb-4a0a-a471-54e9c186adef" returned: 0 in 0.400s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f3f77475-6195-4d4e-9067-203cb78025a3 tempest-CreateVolumesFromSnapshotTest-382606126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c790b51a-fabb-4a0a-a471-54e9c186adef {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:09 devstack sudo[101506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c790b51a-fabb-4a0a-a471-54e9c186adef Sep 18 21:47:09 devstack sudo[101506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:09 devstack sudo[101506]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f3f77475-6195-4d4e-9067-203cb78025a3 tempest-CreateVolumesFromSnapshotTest-382606126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c790b51a-fabb-4a0a-a471-54e9c186adef" returned: 0 in 0.260s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:09 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-f3f77475-6195-4d4e-9067-203cb78025a3 tempest-CreateVolumesFromSnapshotTest-382606126 None] Lock "cinder-quobyte-c790b51a-fabb-4a0a-a471-54e9c186adef" released by "delete_volume" :: held 0.723s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:47:09 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-f3f77475-6195-4d4e-9067-203cb78025a3 tempest-CreateVolumesFromSnapshotTest-382606126 None] Created reservations ['8bafb06f-772b-4dca-a142-cf8ef817907a', 'f9e3c0d2-ac65-4b70-bb83-7e56ee493ddf', '5192ebcd-fc8a-41f8-88c5-c185d914d9c3', 'ae1dafbe-2d73-415a-91f7-6ebaf7831ca5'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:47:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-f3f77475-6195-4d4e-9067-203cb78025a3 tempest-CreateVolumesFromSnapshotTest-382606126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:47:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-f3f77475-6195-4d4e-9067-203cb78025a3 tempest-CreateVolumesFromSnapshotTest-382606126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:47:09 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-f3f77475-6195-4d4e-9067-203cb78025a3 tempest-CreateVolumesFromSnapshotTest-382606126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:47:09 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-f3f77475-6195-4d4e-9067-203cb78025a3 tempest-CreateVolumesFromSnapshotTest-382606126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:47:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-f3f77475-6195-4d4e-9067-203cb78025a3 tempest-CreateVolumesFromSnapshotTest-382606126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:47:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f3f77475-6195-4d4e-9067-203cb78025a3 tempest-CreateVolumesFromSnapshotTest-382606126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:09 devstack sudo[101509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:47:09 devstack sudo[101509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:09 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d0eb85b5-6e84-4523-bb57-f691b523ca6e tempest-CreateVolumesFromSnapshotTest-382606126 None] Acquiring lock "cinder-a88be75b-a92b-45f2-9943-275fa2a3af1c-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:47:09 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d0eb85b5-6e84-4523-bb57-f691b523ca6e tempest-CreateVolumesFromSnapshotTest-382606126 None] Lock "cinder-a88be75b-a92b-45f2-9943-275fa2a3af1c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:47:10 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d0eb85b5-6e84-4523-bb57-f691b523ca6e tempest-CreateVolumesFromSnapshotTest-382606126 None] Acquiring lock "cinder-quobyte-a88be75b-a92b-45f2-9943-275fa2a3af1c" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:47:10 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d0eb85b5-6e84-4523-bb57-f691b523ca6e tempest-CreateVolumesFromSnapshotTest-382606126 None] Lock "cinder-quobyte-a88be75b-a92b-45f2-9943-275fa2a3af1c" acquired by "delete_volume" :: waited 0.026s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:47:10 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d58a7f-accd-4302-943b-35823285314d]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:47:10 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d0eb85b5-6e84-4523-bb57-f691b523ca6e tempest-CreateVolumesFromSnapshotTest-382606126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a88be75b-a92b-45f2-9943-275fa2a3af1c {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:10 devstack sudo[101509]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:10 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f3f77475-6195-4d4e-9067-203cb78025a3 tempest-CreateVolumesFromSnapshotTest-382606126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.394s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:10 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-f3f77475-6195-4d4e-9067-203cb78025a3 tempest-CreateVolumesFromSnapshotTest-382606126 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:47:10 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-f3f77475-6195-4d4e-9067-203cb78025a3 tempest-CreateVolumesFromSnapshotTest-382606126 None] Deleted volume successfully. Sep 18 21:47:10 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-f3f77475-6195-4d4e-9067-203cb78025a3 tempest-CreateVolumesFromSnapshotTest-382606126 None] Lock "cinder-c790b51a-fabb-4a0a-a471-54e9c186adef-delete_volume" released by "delete_volume" :: held 1.403s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:47:10 devstack sudo[101536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a88be75b-a92b-45f2-9943-275fa2a3af1c Sep 18 21:47:10 devstack sudo[101536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:10 devstack sudo[101536]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:10 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d0eb85b5-6e84-4523-bb57-f691b523ca6e tempest-CreateVolumesFromSnapshotTest-382606126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a88be75b-a92b-45f2-9943-275fa2a3af1c" returned: 0 in 0.465s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:10 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d0eb85b5-6e84-4523-bb57-f691b523ca6e tempest-CreateVolumesFromSnapshotTest-382606126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a88be75b-a92b-45f2-9943-275fa2a3af1c {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:10 devstack sudo[101546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a88be75b-a92b-45f2-9943-275fa2a3af1c Sep 18 21:47:10 devstack sudo[101546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:10 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-649f559d-059c-413f-94f5-c024890ac187 tempest-VolumesListAdminTestJSON-1474094717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:47:10 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-649f559d-059c-413f-94f5-c024890ac187 tempest-VolumesListAdminTestJSON-1474094717 None] Flow 'volume_create_manager' (a0a7a6f6-3e7c-4a45-b1f9-f843f606939a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:47:10 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-649f559d-059c-413f-94f5-c024890ac187 tempest-VolumesListAdminTestJSON-1474094717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d22bd64-b1b8-4ec1-9fc7-98252671d87d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:47:10 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-649f559d-059c-413f-94f5-c024890ac187 tempest-VolumesListAdminTestJSON-1474094717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d22bd64-b1b8-4ec1-9fc7-98252671d87d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:47:10Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b67da9c8-30d6-4d55-a75a-6d8d2f13e42a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7b9ede10d5542b3bbfe78888802967c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:47:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:47:11Z,use_quota=True,user_id='4b40e8234b9b483cbbfda28073454d29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:47:10 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-649f559d-059c-413f-94f5-c024890ac187 tempest-VolumesListAdminTestJSON-1474094717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34092869-cdc0-43cd-bca9-ea1af7dc6041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:47:10 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-649f559d-059c-413f-94f5-c024890ac187 tempest-VolumesListAdminTestJSON-1474094717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34092869-cdc0-43cd-bca9-ea1af7dc6041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:47:10 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-649f559d-059c-413f-94f5-c024890ac187 tempest-VolumesListAdminTestJSON-1474094717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8406b8c-74af-4509-9511-ab93f2e83d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:47:10 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-649f559d-059c-413f-94f5-c024890ac187 tempest-VolumesListAdminTestJSON-1474094717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8406b8c-74af-4509-9511-ab93f2e83d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b67da9c8-30d6-4d55-a75a-6d8d2f13e42a', 'volume_name': 'volume-b67da9c8-30d6-4d55-a75a-6d8d2f13e42a', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:47:10 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-649f559d-059c-413f-94f5-c024890ac187 tempest-VolumesListAdminTestJSON-1474094717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eee468d-4fdf-49f3-ac66-aad86cc2d1e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:47:10 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-649f559d-059c-413f-94f5-c024890ac187 tempest-VolumesListAdminTestJSON-1474094717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eee468d-4fdf-49f3-ac66-aad86cc2d1e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:47:10 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-649f559d-059c-413f-94f5-c024890ac187 tempest-VolumesListAdminTestJSON-1474094717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd90096f-48bb-4360-bd44-113126dfe7eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:47:10 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-649f559d-059c-413f-94f5-c024890ac187 tempest-VolumesListAdminTestJSON-1474094717 None] Volume b67da9c8-30d6-4d55-a75a-6d8d2f13e42a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b67da9c8-30d6-4d55-a75a-6d8d2f13e42a', 'volume_size': 1} Sep 18 21:47:10 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-649f559d-059c-413f-94f5-c024890ac187 tempest-VolumesListAdminTestJSON-1474094717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:47:10 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-649f559d-059c-413f-94f5-c024890ac187 tempest-VolumesListAdminTestJSON-1474094717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:47:10 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-649f559d-059c-413f-94f5-c024890ac187 tempest-VolumesListAdminTestJSON-1474094717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:47:10Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b67da9c8-30d6-4d55-a75a-6d8d2f13e42a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7b9ede10d5542b3bbfe78888802967c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:47:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:47:11Z,use_quota=True,user_id='4b40e8234b9b483cbbfda28073454d29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:47:10 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-649f559d-059c-413f-94f5-c024890ac187 tempest-VolumesListAdminTestJSON-1474094717 None] Creating volume b67da9c8-30d6-4d55-a75a-6d8d2f13e42a {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:47:10 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-649f559d-059c-413f-94f5-c024890ac187 tempest-VolumesListAdminTestJSON-1474094717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:47:10 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-649f559d-059c-413f-94f5-c024890ac187 tempest-VolumesListAdminTestJSON-1474094717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:47:10 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-649f559d-059c-413f-94f5-c024890ac187 tempest-VolumesListAdminTestJSON-1474094717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:47:10 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-649f559d-059c-413f-94f5-c024890ac187 tempest-VolumesListAdminTestJSON-1474094717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:47:10 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-649f559d-059c-413f-94f5-c024890ac187 tempest-VolumesListAdminTestJSON-1474094717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:47:10 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-649f559d-059c-413f-94f5-c024890ac187 tempest-VolumesListAdminTestJSON-1474094717 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:47:10 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-649f559d-059c-413f-94f5-c024890ac187 tempest-VolumesListAdminTestJSON-1474094717 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:47:10 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-649f559d-059c-413f-94f5-c024890ac187 tempest-VolumesListAdminTestJSON-1474094717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b67da9c8-30d6-4d55-a75a-6d8d2f13e42a 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:10 devstack sudo[101546]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:10 devstack sudo[101552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b67da9c8-30d6-4d55-a75a-6d8d2f13e42a 1073741824 Sep 18 21:47:10 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d0eb85b5-6e84-4523-bb57-f691b523ca6e tempest-CreateVolumesFromSnapshotTest-382606126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a88be75b-a92b-45f2-9943-275fa2a3af1c" returned: 0 in 0.295s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:10 devstack sudo[101552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:10 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d0eb85b5-6e84-4523-bb57-f691b523ca6e tempest-CreateVolumesFromSnapshotTest-382606126 None] Lock "cinder-quobyte-a88be75b-a92b-45f2-9943-275fa2a3af1c" released by "delete_volume" :: held 0.832s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:47:10 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-d0eb85b5-6e84-4523-bb57-f691b523ca6e tempest-CreateVolumesFromSnapshotTest-382606126 None] Created reservations ['c4529e42-487b-4bda-8a46-381eec8e9dcc', 'c8c453fb-a75c-4c96-ad10-66c1065212c4', '12eeb009-193b-4fa1-a665-65978233aee4', '0b27df7e-9544-4ed5-861e-eb1cc685e7ba'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:47:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-d0eb85b5-6e84-4523-bb57-f691b523ca6e tempest-CreateVolumesFromSnapshotTest-382606126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:47:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-d0eb85b5-6e84-4523-bb57-f691b523ca6e tempest-CreateVolumesFromSnapshotTest-382606126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:47:11 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-d0eb85b5-6e84-4523-bb57-f691b523ca6e tempest-CreateVolumesFromSnapshotTest-382606126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:47:11 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-d0eb85b5-6e84-4523-bb57-f691b523ca6e tempest-CreateVolumesFromSnapshotTest-382606126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:47:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-d0eb85b5-6e84-4523-bb57-f691b523ca6e tempest-CreateVolumesFromSnapshotTest-382606126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:47:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d0eb85b5-6e84-4523-bb57-f691b523ca6e tempest-CreateVolumesFromSnapshotTest-382606126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:11 devstack sudo[101563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:47:11 devstack sudo[101563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:11 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-5f7564c5-3563-4bc0-b4c1-a42694458d4b tempest-CreateVolumesFromSnapshotTest-382606126 None] Acquiring lock "cinder-a44f1e54-c69f-4e7c-ab32-670ebcd820d7-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:47:11 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-5f7564c5-3563-4bc0-b4c1-a42694458d4b tempest-CreateVolumesFromSnapshotTest-382606126 None] Lock "cinder-a44f1e54-c69f-4e7c-ab32-670ebcd820d7-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:47:11 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-5f7564c5-3563-4bc0-b4c1-a42694458d4b tempest-CreateVolumesFromSnapshotTest-382606126 None] Acquiring lock "cinder-quobyte-a44f1e54-c69f-4e7c-ab32-670ebcd820d7" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:47:11 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-5f7564c5-3563-4bc0-b4c1-a42694458d4b tempest-CreateVolumesFromSnapshotTest-382606126 None] Lock "cinder-quobyte-a44f1e54-c69f-4e7c-ab32-670ebcd820d7" acquired by "delete_volume" :: waited 0.029s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:47:11 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[145dcab1-58c9-45b8-a7ae-1c204daff191]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:47:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5f7564c5-3563-4bc0-b4c1-a42694458d4b tempest-CreateVolumesFromSnapshotTest-382606126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a44f1e54-c69f-4e7c-ab32-670ebcd820d7 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:11 devstack sudo[101563]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d0eb85b5-6e84-4523-bb57-f691b523ca6e tempest-CreateVolumesFromSnapshotTest-382606126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.333s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:11 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-d0eb85b5-6e84-4523-bb57-f691b523ca6e tempest-CreateVolumesFromSnapshotTest-382606126 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:47:11 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-d0eb85b5-6e84-4523-bb57-f691b523ca6e tempest-CreateVolumesFromSnapshotTest-382606126 None] Deleted volume successfully. Sep 18 21:47:11 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d0eb85b5-6e84-4523-bb57-f691b523ca6e tempest-CreateVolumesFromSnapshotTest-382606126 None] Lock "cinder-a88be75b-a92b-45f2-9943-275fa2a3af1c-delete_volume" released by "delete_volume" :: held 1.436s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:47:11 devstack sudo[101552]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-649f559d-059c-413f-94f5-c024890ac187 tempest-VolumesListAdminTestJSON-1474094717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b67da9c8-30d6-4d55-a75a-6d8d2f13e42a 1073741824" returned: 0 in 0.596s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-649f559d-059c-413f-94f5-c024890ac187 tempest-VolumesListAdminTestJSON-1474094717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b67da9c8-30d6-4d55-a75a-6d8d2f13e42a {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:11 devstack sudo[101570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a44f1e54-c69f-4e7c-ab32-670ebcd820d7 Sep 18 21:47:11 devstack sudo[101570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:11 devstack sudo[101572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b67da9c8-30d6-4d55-a75a-6d8d2f13e42a Sep 18 21:47:11 devstack sudo[101572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:11 devstack sudo[101572]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-649f559d-059c-413f-94f5-c024890ac187 tempest-VolumesListAdminTestJSON-1474094717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b67da9c8-30d6-4d55-a75a-6d8d2f13e42a" returned: 0 in 0.292s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:11 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-649f559d-059c-413f-94f5-c024890ac187 tempest-VolumesListAdminTestJSON-1474094717 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:47:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-649f559d-059c-413f-94f5-c024890ac187 tempest-VolumesListAdminTestJSON-1474094717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:47:11 devstack sudo[101570]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5f7564c5-3563-4bc0-b4c1-a42694458d4b tempest-CreateVolumesFromSnapshotTest-382606126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a44f1e54-c69f-4e7c-ab32-670ebcd820d7" returned: 0 in 0.443s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5f7564c5-3563-4bc0-b4c1-a42694458d4b tempest-CreateVolumesFromSnapshotTest-382606126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a44f1e54-c69f-4e7c-ab32-670ebcd820d7 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:11 devstack sudo[101585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a44f1e54-c69f-4e7c-ab32-670ebcd820d7 Sep 18 21:47:11 devstack sudo[101585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-649f559d-059c-413f-94f5-c024890ac187 tempest-VolumesListAdminTestJSON-1474094717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd90096f-48bb-4360-bd44-113126dfe7eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b67da9c8-30d6-4d55-a75a-6d8d2f13e42a', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:47:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-649f559d-059c-413f-94f5-c024890ac187 tempest-VolumesListAdminTestJSON-1474094717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f13c030-60a8-4953-b379-d544a2a3be76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:47:11 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-649f559d-059c-413f-94f5-c024890ac187 tempest-VolumesListAdminTestJSON-1474094717 None] Volume volume-b67da9c8-30d6-4d55-a75a-6d8d2f13e42a (b67da9c8-30d6-4d55-a75a-6d8d2f13e42a): created successfully Sep 18 21:47:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-649f559d-059c-413f-94f5-c024890ac187 tempest-VolumesListAdminTestJSON-1474094717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f13c030-60a8-4953-b379-d544a2a3be76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:47:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-649f559d-059c-413f-94f5-c024890ac187 tempest-VolumesListAdminTestJSON-1474094717 None] Flow 'volume_create_manager' (a0a7a6f6-3e7c-4a45-b1f9-f843f606939a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:47:11 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-649f559d-059c-413f-94f5-c024890ac187 tempest-VolumesListAdminTestJSON-1474094717 None] Created volume successfully. Sep 18 21:47:12 devstack sudo[101585]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5f7564c5-3563-4bc0-b4c1-a42694458d4b tempest-CreateVolumesFromSnapshotTest-382606126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a44f1e54-c69f-4e7c-ab32-670ebcd820d7" returned: 0 in 0.263s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:12 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-5f7564c5-3563-4bc0-b4c1-a42694458d4b tempest-CreateVolumesFromSnapshotTest-382606126 None] Lock "cinder-quobyte-a44f1e54-c69f-4e7c-ab32-670ebcd820d7" released by "delete_volume" :: held 0.752s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:47:12 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-5f7564c5-3563-4bc0-b4c1-a42694458d4b tempest-CreateVolumesFromSnapshotTest-382606126 None] Created reservations ['b2b572f3-f50d-4c2a-a025-9b3b2ba4dd9d', '65ab0b90-b704-41d2-afa1-dc6fa6dbd6d0', 'd9a6df0f-9ae1-413a-b1fd-f242d49ac9be', '3e5e7dad-e801-47d6-b95e-782ed78db823'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:47:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-5f7564c5-3563-4bc0-b4c1-a42694458d4b tempest-CreateVolumesFromSnapshotTest-382606126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:47:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-5f7564c5-3563-4bc0-b4c1-a42694458d4b tempest-CreateVolumesFromSnapshotTest-382606126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:47:12 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-5f7564c5-3563-4bc0-b4c1-a42694458d4b tempest-CreateVolumesFromSnapshotTest-382606126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:47:12 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-5f7564c5-3563-4bc0-b4c1-a42694458d4b tempest-CreateVolumesFromSnapshotTest-382606126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:47:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-5f7564c5-3563-4bc0-b4c1-a42694458d4b tempest-CreateVolumesFromSnapshotTest-382606126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:47:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5f7564c5-3563-4bc0-b4c1-a42694458d4b tempest-CreateVolumesFromSnapshotTest-382606126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:12 devstack sudo[101588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:47:12 devstack sudo[101588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:12 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-04aa8725-467d-41a5-bbae-4f8114fb33ee tempest-CreateVolumesFromSnapshotTest-382606126 None] Acquiring lock "cinder-c585f3a7-416e-4d86-8e1d-c89606382dd0-delete_snapshot" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:47:12 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-04aa8725-467d-41a5-bbae-4f8114fb33ee tempest-CreateVolumesFromSnapshotTest-382606126 None] Lock "cinder-c585f3a7-416e-4d86-8e1d-c89606382dd0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:47:12 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-04aa8725-467d-41a5-bbae-4f8114fb33ee tempest-CreateVolumesFromSnapshotTest-382606126 None] Acquiring lock "cinder-quobyte-d78f91c6-812b-4466-943c-2dac24f72c11" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:47:12 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-04aa8725-467d-41a5-bbae-4f8114fb33ee tempest-CreateVolumesFromSnapshotTest-382606126 None] Lock "cinder-quobyte-d78f91c6-812b-4466-943c-2dac24f72c11" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:47:12 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-04aa8725-467d-41a5-bbae-4f8114fb33ee tempest-CreateVolumesFromSnapshotTest-382606126 None] Acquiring lock "cinder-quobyte-c585f3a7-416e-4d86-8e1d-c89606382dd0" by "_delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:47:12 devstack sudo[101588]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5f7564c5-3563-4bc0-b4c1-a42694458d4b tempest-CreateVolumesFromSnapshotTest-382606126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.302s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:12 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-5f7564c5-3563-4bc0-b4c1-a42694458d4b tempest-CreateVolumesFromSnapshotTest-382606126 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:47:12 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-04aa8725-467d-41a5-bbae-4f8114fb33ee tempest-CreateVolumesFromSnapshotTest-382606126 None] Lock "cinder-quobyte-c585f3a7-416e-4d86-8e1d-c89606382dd0" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:47:12 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-04aa8725-467d-41a5-bbae-4f8114fb33ee tempest-CreateVolumesFromSnapshotTest-382606126 None] Deleting offline snapshot c585f3a7-416e-4d86-8e1d-c89606382dd0 of volume d78f91c6-812b-4466-943c-2dac24f72c11 {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 21:47:12 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-04aa8725-467d-41a5-bbae-4f8114fb33ee tempest-CreateVolumesFromSnapshotTest-382606126 None] snapshot_file for this snap is: volume-d78f91c6-812b-4466-943c-2dac24f72c11.c585f3a7-416e-4d86-8e1d-c89606382dd0 {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 21:47:12 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-5f7564c5-3563-4bc0-b4c1-a42694458d4b tempest-CreateVolumesFromSnapshotTest-382606126 None] Deleted volume successfully. Sep 18 21:47:12 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc6034b-c2f0-4db7-b235-8ef0ece44141]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:47:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-04aa8725-467d-41a5-bbae-4f8114fb33ee tempest-CreateVolumesFromSnapshotTest-382606126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-d78f91c6-812b-4466-943c-2dac24f72c11.c585f3a7-416e-4d86-8e1d-c89606382dd0 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:12 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-5f7564c5-3563-4bc0-b4c1-a42694458d4b tempest-CreateVolumesFromSnapshotTest-382606126 None] Lock "cinder-a44f1e54-c69f-4e7c-ab32-670ebcd820d7-delete_volume" released by "delete_volume" :: held 1.314s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:47:12 devstack sudo[101591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-d78f91c6-812b-4466-943c-2dac24f72c11.c585f3a7-416e-4d86-8e1d-c89606382dd0 Sep 18 21:47:12 devstack sudo[101591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:12 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-5cc52d61-4a34-4efa-9bae-8e2f09d7db30 tempest-VolumesListAdminTestJSON-1474094717 None] Acquiring lock "cinder-b67da9c8-30d6-4d55-a75a-6d8d2f13e42a-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:47:12 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-5cc52d61-4a34-4efa-9bae-8e2f09d7db30 tempest-VolumesListAdminTestJSON-1474094717 None] Lock "cinder-b67da9c8-30d6-4d55-a75a-6d8d2f13e42a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:47:12 devstack sudo[101591]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-04aa8725-467d-41a5-bbae-4f8114fb33ee tempest-CreateVolumesFromSnapshotTest-382606126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-d78f91c6-812b-4466-943c-2dac24f72c11.c585f3a7-416e-4d86-8e1d-c89606382dd0" returned: 0 in 0.424s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:12 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-04aa8725-467d-41a5-bbae-4f8114fb33ee tempest-CreateVolumesFromSnapshotTest-382606126 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d78f91c6-812b-4466-943c-2dac24f72c11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86136) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 21:47:12 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe76f35-7ee3-4d25-8d94-bd8a58940baf]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:47:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-04aa8725-467d-41a5-bbae-4f8114fb33ee tempest-CreateVolumesFromSnapshotTest-382606126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-d78f91c6-812b-4466-943c-2dac24f72c11 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:13 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-5cc52d61-4a34-4efa-9bae-8e2f09d7db30 tempest-VolumesListAdminTestJSON-1474094717 None] Acquiring lock "cinder-quobyte-b67da9c8-30d6-4d55-a75a-6d8d2f13e42a" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:47:13 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-5cc52d61-4a34-4efa-9bae-8e2f09d7db30 tempest-VolumesListAdminTestJSON-1474094717 None] Lock "cinder-quobyte-b67da9c8-30d6-4d55-a75a-6d8d2f13e42a" acquired by "delete_volume" :: waited 0.018s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:47:13 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-eeb16bc6-1e8c-42d1-a439-d27260ebc68f tempest-VolumesListAdminTestJSON-1184658396 None] Acquiring lock "cinder-5f68e0a8-9cb2-4708-bb8d-8da6c9492863-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:47:13 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-eeb16bc6-1e8c-42d1-a439-d27260ebc68f tempest-VolumesListAdminTestJSON-1184658396 None] Lock "cinder-5f68e0a8-9cb2-4708-bb8d-8da6c9492863-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:47:13 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7421208-0fa9-4382-8b06-3063a11d8994]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:47:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5cc52d61-4a34-4efa-9bae-8e2f09d7db30 tempest-VolumesListAdminTestJSON-1474094717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b67da9c8-30d6-4d55-a75a-6d8d2f13e42a {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:13 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-eeb16bc6-1e8c-42d1-a439-d27260ebc68f tempest-VolumesListAdminTestJSON-1184658396 None] Acquiring lock "cinder-quobyte-5f68e0a8-9cb2-4708-bb8d-8da6c9492863" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:47:13 devstack sudo[101597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-d78f91c6-812b-4466-943c-2dac24f72c11 Sep 18 21:47:13 devstack sudo[101597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:13 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-eeb16bc6-1e8c-42d1-a439-d27260ebc68f tempest-VolumesListAdminTestJSON-1184658396 None] Lock "cinder-quobyte-5f68e0a8-9cb2-4708-bb8d-8da6c9492863" acquired by "delete_volume" :: waited 0.018s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:47:13 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[82bc27ed-7316-48b7-bf9a-6ab52fed5c9d]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:47:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-eeb16bc6-1e8c-42d1-a439-d27260ebc68f tempest-VolumesListAdminTestJSON-1184658396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-5f68e0a8-9cb2-4708-bb8d-8da6c9492863 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:13 devstack sudo[101598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b67da9c8-30d6-4d55-a75a-6d8d2f13e42a Sep 18 21:47:13 devstack sudo[101598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:13 devstack sudo[101600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-5f68e0a8-9cb2-4708-bb8d-8da6c9492863 Sep 18 21:47:13 devstack sudo[101600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:13 devstack sudo[101597]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-04aa8725-467d-41a5-bbae-4f8114fb33ee tempest-CreateVolumesFromSnapshotTest-382606126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-d78f91c6-812b-4466-943c-2dac24f72c11" returned: 0 in 0.457s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-04aa8725-467d-41a5-bbae-4f8114fb33ee tempest-CreateVolumesFromSnapshotTest-382606126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-d78f91c6-812b-4466-943c-2dac24f72c11.c585f3a7-416e-4d86-8e1d-c89606382dd0 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:13 devstack sudo[101609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-d78f91c6-812b-4466-943c-2dac24f72c11.c585f3a7-416e-4d86-8e1d-c89606382dd0 Sep 18 21:47:13 devstack sudo[101609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:13 devstack sudo[101598]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5cc52d61-4a34-4efa-9bae-8e2f09d7db30 tempest-VolumesListAdminTestJSON-1474094717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b67da9c8-30d6-4d55-a75a-6d8d2f13e42a" returned: 0 in 0.454s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5cc52d61-4a34-4efa-9bae-8e2f09d7db30 tempest-VolumesListAdminTestJSON-1474094717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b67da9c8-30d6-4d55-a75a-6d8d2f13e42a {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:13 devstack sudo[101613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b67da9c8-30d6-4d55-a75a-6d8d2f13e42a Sep 18 21:47:13 devstack sudo[101613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:13 devstack sudo[101600]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-eeb16bc6-1e8c-42d1-a439-d27260ebc68f tempest-VolumesListAdminTestJSON-1184658396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-5f68e0a8-9cb2-4708-bb8d-8da6c9492863" returned: 0 in 0.480s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-eeb16bc6-1e8c-42d1-a439-d27260ebc68f tempest-VolumesListAdminTestJSON-1184658396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-5f68e0a8-9cb2-4708-bb8d-8da6c9492863 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:13 devstack sudo[101618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-5f68e0a8-9cb2-4708-bb8d-8da6c9492863 Sep 18 21:47:13 devstack sudo[101618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:13 devstack sudo[101609]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-04aa8725-467d-41a5-bbae-4f8114fb33ee tempest-CreateVolumesFromSnapshotTest-382606126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-d78f91c6-812b-4466-943c-2dac24f72c11.c585f3a7-416e-4d86-8e1d-c89606382dd0" returned: 0 in 0.419s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-04aa8725-467d-41a5-bbae-4f8114fb33ee tempest-CreateVolumesFromSnapshotTest-382606126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-d78f91c6-812b-4466-943c-2dac24f72c11.c585f3a7-416e-4d86-8e1d-c89606382dd0 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:13 devstack sudo[101613]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:13 devstack sudo[101625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-d78f91c6-812b-4466-943c-2dac24f72c11.c585f3a7-416e-4d86-8e1d-c89606382dd0 Sep 18 21:47:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5cc52d61-4a34-4efa-9bae-8e2f09d7db30 tempest-VolumesListAdminTestJSON-1474094717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b67da9c8-30d6-4d55-a75a-6d8d2f13e42a" returned: 0 in 0.345s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:13 devstack sudo[101625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:13 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-5cc52d61-4a34-4efa-9bae-8e2f09d7db30 tempest-VolumesListAdminTestJSON-1474094717 None] Lock "cinder-quobyte-b67da9c8-30d6-4d55-a75a-6d8d2f13e42a" released by "delete_volume" :: held 0.874s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:47:13 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-5cc52d61-4a34-4efa-9bae-8e2f09d7db30 tempest-VolumesListAdminTestJSON-1474094717 None] Created reservations ['c386d933-8f74-4e9b-a2bc-66fb71d7c836', 'b528d722-5855-40a2-9942-8c2518b03ecb', 'c6d95cae-4bda-4919-953e-c539fc81de25', 'ef1e0238-8585-4153-8051-b84bbb06d608'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:47:13 devstack sudo[101618]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-eeb16bc6-1e8c-42d1-a439-d27260ebc68f tempest-VolumesListAdminTestJSON-1184658396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-5f68e0a8-9cb2-4708-bb8d-8da6c9492863" returned: 0 in 0.321s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:14 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-eeb16bc6-1e8c-42d1-a439-d27260ebc68f tempest-VolumesListAdminTestJSON-1184658396 None] Lock "cinder-quobyte-5f68e0a8-9cb2-4708-bb8d-8da6c9492863" released by "delete_volume" :: held 0.874s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:47:14 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-eeb16bc6-1e8c-42d1-a439-d27260ebc68f tempest-VolumesListAdminTestJSON-1184658396 None] Created reservations ['8bfaee4c-d94a-4b9c-8fb9-cc7200b234f0', '2bb7ee8c-5c79-452c-842d-8f73743a736b', 'a81dedc2-5072-4cce-926f-4d4adf9a9bdf', 'da5f23b9-1b7c-420b-8ebe-303b95bbecc2'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:47:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-5cc52d61-4a34-4efa-9bae-8e2f09d7db30 tempest-VolumesListAdminTestJSON-1474094717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:47:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-5cc52d61-4a34-4efa-9bae-8e2f09d7db30 tempest-VolumesListAdminTestJSON-1474094717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:47:14 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-5cc52d61-4a34-4efa-9bae-8e2f09d7db30 tempest-VolumesListAdminTestJSON-1474094717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:47:14 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-5cc52d61-4a34-4efa-9bae-8e2f09d7db30 tempest-VolumesListAdminTestJSON-1474094717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:47:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-5cc52d61-4a34-4efa-9bae-8e2f09d7db30 tempest-VolumesListAdminTestJSON-1474094717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:47:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5cc52d61-4a34-4efa-9bae-8e2f09d7db30 tempest-VolumesListAdminTestJSON-1474094717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:14 devstack sudo[101629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:47:14 devstack sudo[101629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-eeb16bc6-1e8c-42d1-a439-d27260ebc68f tempest-VolumesListAdminTestJSON-1184658396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:47:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-eeb16bc6-1e8c-42d1-a439-d27260ebc68f tempest-VolumesListAdminTestJSON-1184658396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:47:14 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-eeb16bc6-1e8c-42d1-a439-d27260ebc68f tempest-VolumesListAdminTestJSON-1184658396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:47:14 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-eeb16bc6-1e8c-42d1-a439-d27260ebc68f tempest-VolumesListAdminTestJSON-1184658396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:47:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-eeb16bc6-1e8c-42d1-a439-d27260ebc68f tempest-VolumesListAdminTestJSON-1184658396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:47:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-eeb16bc6-1e8c-42d1-a439-d27260ebc68f tempest-VolumesListAdminTestJSON-1184658396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:14 devstack sudo[101625]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-04aa8725-467d-41a5-bbae-4f8114fb33ee tempest-CreateVolumesFromSnapshotTest-382606126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-d78f91c6-812b-4466-943c-2dac24f72c11.c585f3a7-416e-4d86-8e1d-c89606382dd0" returned: 0 in 0.407s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:14 devstack sudo[101631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:47:14 devstack sudo[101631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:14 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-04aa8725-467d-41a5-bbae-4f8114fb33ee tempest-CreateVolumesFromSnapshotTest-382606126 None] Lock "cinder-quobyte-c585f3a7-416e-4d86-8e1d-c89606382dd0" released by "_delete_snapshot" :: held 1.855s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:47:14 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-04aa8725-467d-41a5-bbae-4f8114fb33ee tempest-CreateVolumesFromSnapshotTest-382606126 None] Lock "cinder-quobyte-d78f91c6-812b-4466-943c-2dac24f72c11" released by "delete_snapshot" :: held 1.885s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:47:14 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-04aa8725-467d-41a5-bbae-4f8114fb33ee tempest-CreateVolumesFromSnapshotTest-382606126 None] Created reservations ['b1aaceea-937a-4c76-831b-c23654eebed5', '0d323ba3-e415-4189-8942-a782335f5dcf', '2bcc66cd-e88b-403b-89c4-0e0ef585da7d', '1427e7d6-b449-4c09-b364-c930973ebc91'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:47:14 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-449ef8e5-cf76-4a69-80be-761a0ff97cdc tempest-VolumesListAdminTestJSON-1184658396 None] Acquiring lock "cinder-c29ba25b-07c7-4b15-9347-fc25b62ab8b1-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:47:14 devstack sudo[101629]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5cc52d61-4a34-4efa-9bae-8e2f09d7db30 tempest-VolumesListAdminTestJSON-1474094717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.362s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:14 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-5cc52d61-4a34-4efa-9bae-8e2f09d7db30 tempest-VolumesListAdminTestJSON-1474094717 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:47:14 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-5cc52d61-4a34-4efa-9bae-8e2f09d7db30 tempest-VolumesListAdminTestJSON-1474094717 None] Deleted volume successfully. Sep 18 21:47:14 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-449ef8e5-cf76-4a69-80be-761a0ff97cdc tempest-VolumesListAdminTestJSON-1184658396 None] Lock "cinder-c29ba25b-07c7-4b15-9347-fc25b62ab8b1-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:47:14 devstack sudo[101631]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:14 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-04aa8725-467d-41a5-bbae-4f8114fb33ee tempest-CreateVolumesFromSnapshotTest-382606126 None] Delete snapshot completed successfully. Sep 18 21:47:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-eeb16bc6-1e8c-42d1-a439-d27260ebc68f tempest-VolumesListAdminTestJSON-1184658396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.411s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:14 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-eeb16bc6-1e8c-42d1-a439-d27260ebc68f tempest-VolumesListAdminTestJSON-1184658396 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:47:14 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-b840b72b-2e4c-47d0-b34b-bbb2a2bb670d tempest-CreateVolumesFromSnapshotTest-382606126 None] Acquiring lock "cinder-d78f91c6-812b-4466-943c-2dac24f72c11-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:47:14 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-04aa8725-467d-41a5-bbae-4f8114fb33ee tempest-CreateVolumesFromSnapshotTest-382606126 None] Lock "cinder-c585f3a7-416e-4d86-8e1d-c89606382dd0-delete_snapshot" released by "delete_snapshot" :: held 2.269s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:47:14 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-5cc52d61-4a34-4efa-9bae-8e2f09d7db30 tempest-VolumesListAdminTestJSON-1474094717 None] Lock "cinder-b67da9c8-30d6-4d55-a75a-6d8d2f13e42a-delete_volume" released by "delete_volume" :: held 1.771s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:47:14 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-eeb16bc6-1e8c-42d1-a439-d27260ebc68f tempest-VolumesListAdminTestJSON-1184658396 None] Deleted volume successfully. Sep 18 21:47:14 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-b840b72b-2e4c-47d0-b34b-bbb2a2bb670d tempest-CreateVolumesFromSnapshotTest-382606126 None] Lock "cinder-d78f91c6-812b-4466-943c-2dac24f72c11-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:47:14 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-eeb16bc6-1e8c-42d1-a439-d27260ebc68f tempest-VolumesListAdminTestJSON-1184658396 None] Lock "cinder-5f68e0a8-9cb2-4708-bb8d-8da6c9492863-delete_volume" released by "delete_volume" :: held 1.685s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:47:14 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-449ef8e5-cf76-4a69-80be-761a0ff97cdc tempest-VolumesListAdminTestJSON-1184658396 None] Acquiring lock "cinder-quobyte-c29ba25b-07c7-4b15-9347-fc25b62ab8b1" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:47:14 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-449ef8e5-cf76-4a69-80be-761a0ff97cdc tempest-VolumesListAdminTestJSON-1184658396 None] Lock "cinder-quobyte-c29ba25b-07c7-4b15-9347-fc25b62ab8b1" acquired by "delete_volume" :: waited 0.021s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:47:14 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-b840b72b-2e4c-47d0-b34b-bbb2a2bb670d tempest-CreateVolumesFromSnapshotTest-382606126 None] Acquiring lock "cinder-quobyte-d78f91c6-812b-4466-943c-2dac24f72c11" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:47:14 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40f45fa-4684-4872-9081-e1ca6affca81]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:47:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-449ef8e5-cf76-4a69-80be-761a0ff97cdc tempest-VolumesListAdminTestJSON-1184658396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c29ba25b-07c7-4b15-9347-fc25b62ab8b1 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:14 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-b840b72b-2e4c-47d0-b34b-bbb2a2bb670d tempest-CreateVolumesFromSnapshotTest-382606126 None] Lock "cinder-quobyte-d78f91c6-812b-4466-943c-2dac24f72c11" acquired by "delete_volume" :: waited 0.043s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:47:14 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[56eba8ab-32dd-4198-b62a-035f42ea2f57]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:47:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-b840b72b-2e4c-47d0-b34b-bbb2a2bb670d tempest-CreateVolumesFromSnapshotTest-382606126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-d78f91c6-812b-4466-943c-2dac24f72c11 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:15 devstack sudo[101635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c29ba25b-07c7-4b15-9347-fc25b62ab8b1 Sep 18 21:47:15 devstack sudo[101635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:15 devstack sudo[101636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-d78f91c6-812b-4466-943c-2dac24f72c11 Sep 18 21:47:15 devstack sudo[101636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:15 devstack sudo[101635]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-449ef8e5-cf76-4a69-80be-761a0ff97cdc tempest-VolumesListAdminTestJSON-1184658396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c29ba25b-07c7-4b15-9347-fc25b62ab8b1" returned: 0 in 0.543s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-449ef8e5-cf76-4a69-80be-761a0ff97cdc tempest-VolumesListAdminTestJSON-1184658396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c29ba25b-07c7-4b15-9347-fc25b62ab8b1 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:15 devstack sudo[101636]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-b840b72b-2e4c-47d0-b34b-bbb2a2bb670d tempest-CreateVolumesFromSnapshotTest-382606126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-d78f91c6-812b-4466-943c-2dac24f72c11" returned: 0 in 0.459s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-b840b72b-2e4c-47d0-b34b-bbb2a2bb670d tempest-CreateVolumesFromSnapshotTest-382606126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-d78f91c6-812b-4466-943c-2dac24f72c11 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:15 devstack sudo[101645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c29ba25b-07c7-4b15-9347-fc25b62ab8b1 Sep 18 21:47:15 devstack sudo[101645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:15 devstack sudo[101646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-d78f91c6-812b-4466-943c-2dac24f72c11 Sep 18 21:47:15 devstack sudo[101646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:15 devstack sudo[101645]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-449ef8e5-cf76-4a69-80be-761a0ff97cdc tempest-VolumesListAdminTestJSON-1184658396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c29ba25b-07c7-4b15-9347-fc25b62ab8b1" returned: 0 in 0.343s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:15 devstack sudo[101646]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-b840b72b-2e4c-47d0-b34b-bbb2a2bb670d tempest-CreateVolumesFromSnapshotTest-382606126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-d78f91c6-812b-4466-943c-2dac24f72c11" returned: 0 in 0.346s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:15 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-449ef8e5-cf76-4a69-80be-761a0ff97cdc tempest-VolumesListAdminTestJSON-1184658396 None] Lock "cinder-quobyte-c29ba25b-07c7-4b15-9347-fc25b62ab8b1" released by "delete_volume" :: held 0.962s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:47:15 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-b840b72b-2e4c-47d0-b34b-bbb2a2bb670d tempest-CreateVolumesFromSnapshotTest-382606126 None] Lock "cinder-quobyte-d78f91c6-812b-4466-943c-2dac24f72c11" released by "delete_volume" :: held 0.899s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:47:15 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-449ef8e5-cf76-4a69-80be-761a0ff97cdc tempest-VolumesListAdminTestJSON-1184658396 None] Created reservations ['d824912e-9437-4754-957e-8d6fbfb142ac', '460b223b-158b-4ce5-b87e-4fc5fa9726f3', '6256c52d-59d4-4c05-becc-803f6601af97', 'a6f775fe-26d0-41d8-9522-5415003f4a3d'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:47:15 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-b840b72b-2e4c-47d0-b34b-bbb2a2bb670d tempest-CreateVolumesFromSnapshotTest-382606126 None] Created reservations ['3c7436f0-def7-40ba-96bd-06e51a8e65da', '8ae39ca3-17cf-4f2e-ad74-595e98ee9a0d', 'c0be874f-417a-4445-8f16-f81b52034a94', '23c38db7-5127-4ca1-9183-521f38d583b2'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:47:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-449ef8e5-cf76-4a69-80be-761a0ff97cdc tempest-VolumesListAdminTestJSON-1184658396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:47:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-449ef8e5-cf76-4a69-80be-761a0ff97cdc tempest-VolumesListAdminTestJSON-1184658396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:47:15 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-449ef8e5-cf76-4a69-80be-761a0ff97cdc tempest-VolumesListAdminTestJSON-1184658396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:47:15 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-449ef8e5-cf76-4a69-80be-761a0ff97cdc tempest-VolumesListAdminTestJSON-1184658396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:47:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-449ef8e5-cf76-4a69-80be-761a0ff97cdc tempest-VolumesListAdminTestJSON-1184658396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:47:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-449ef8e5-cf76-4a69-80be-761a0ff97cdc tempest-VolumesListAdminTestJSON-1184658396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:15 devstack sudo[101652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:47:15 devstack sudo[101652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-b840b72b-2e4c-47d0-b34b-bbb2a2bb670d tempest-CreateVolumesFromSnapshotTest-382606126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:47:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-b840b72b-2e4c-47d0-b34b-bbb2a2bb670d tempest-CreateVolumesFromSnapshotTest-382606126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:47:15 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-b840b72b-2e4c-47d0-b34b-bbb2a2bb670d tempest-CreateVolumesFromSnapshotTest-382606126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:47:15 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-b840b72b-2e4c-47d0-b34b-bbb2a2bb670d tempest-CreateVolumesFromSnapshotTest-382606126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:47:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-b840b72b-2e4c-47d0-b34b-bbb2a2bb670d tempest-CreateVolumesFromSnapshotTest-382606126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:47:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-b840b72b-2e4c-47d0-b34b-bbb2a2bb670d tempest-CreateVolumesFromSnapshotTest-382606126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:16 devstack sudo[101654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:47:16 devstack sudo[101654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:16 devstack sudo[101652]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-449ef8e5-cf76-4a69-80be-761a0ff97cdc tempest-VolumesListAdminTestJSON-1184658396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.341s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:16 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-449ef8e5-cf76-4a69-80be-761a0ff97cdc tempest-VolumesListAdminTestJSON-1184658396 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:47:16 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-449ef8e5-cf76-4a69-80be-761a0ff97cdc tempest-VolumesListAdminTestJSON-1184658396 None] Deleted volume successfully. Sep 18 21:47:16 devstack sudo[101654]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-b840b72b-2e4c-47d0-b34b-bbb2a2bb670d tempest-CreateVolumesFromSnapshotTest-382606126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.330s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:16 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-b840b72b-2e4c-47d0-b34b-bbb2a2bb670d tempest-CreateVolumesFromSnapshotTest-382606126 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:47:16 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-449ef8e5-cf76-4a69-80be-761a0ff97cdc tempest-VolumesListAdminTestJSON-1184658396 None] Lock "cinder-c29ba25b-07c7-4b15-9347-fc25b62ab8b1-delete_volume" released by "delete_volume" :: held 1.784s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:47:16 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-b840b72b-2e4c-47d0-b34b-bbb2a2bb670d tempest-CreateVolumesFromSnapshotTest-382606126 None] Deleted volume successfully. Sep 18 21:47:16 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-b840b72b-2e4c-47d0-b34b-bbb2a2bb670d tempest-CreateVolumesFromSnapshotTest-382606126 None] Lock "cinder-d78f91c6-812b-4466-943c-2dac24f72c11-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:47:16 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8a6400f-8e19-4137-a8a3-f796d9c41c86 tempest-TestStampPattern-580697789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:47:16 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d8a6400f-8e19-4137-a8a3-f796d9c41c86 tempest-TestStampPattern-580697789 None] Flow 'volume_create_manager' (55477ec8-8fb4-428f-a1bf-777edbd023a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:47:16 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d8a6400f-8e19-4137-a8a3-f796d9c41c86 tempest-TestStampPattern-580697789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32d0c590-c249-40f7-bf26-5837b03b21e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:47:16 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d8a6400f-8e19-4137-a8a3-f796d9c41c86 tempest-TestStampPattern-580697789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32d0c590-c249-40f7-bf26-5837b03b21e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:47:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-567516052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d58229e-d2f2-4c10-a3c7-5eab09caeaa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b245feedd48146d1b794023eb000c839',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:47:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8781d896-20dd-4f26-a8c4-7feb8d88d94e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:47:17Z,use_quota=True,user_id='96da43a2f59c470db810c162533a0558',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:47:16 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d8a6400f-8e19-4137-a8a3-f796d9c41c86 tempest-TestStampPattern-580697789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a07fc6b-c940-47b9-a8b9-66738ca257e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:47:16 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d8a6400f-8e19-4137-a8a3-f796d9c41c86 tempest-TestStampPattern-580697789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a07fc6b-c940-47b9-a8b9-66738ca257e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:47:16 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d8a6400f-8e19-4137-a8a3-f796d9c41c86 tempest-TestStampPattern-580697789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bc25adc-d2cf-4430-b9ba-59d000853056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:47:16 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d8a6400f-8e19-4137-a8a3-f796d9c41c86 tempest-TestStampPattern-580697789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bc25adc-d2cf-4430-b9ba-59d000853056) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9d58229e-d2f2-4c10-a3c7-5eab09caeaa3', 'volume_name': 'volume-9d58229e-d2f2-4c10-a3c7-5eab09caeaa3', 'volume_size': 1, 'snapshot_id': '8781d896-20dd-4f26-a8c4-7feb8d88d94e'}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:47:16 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d8a6400f-8e19-4137-a8a3-f796d9c41c86 tempest-TestStampPattern-580697789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c7876c9-96e7-4f4d-a7b8-0d975fcf065a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:47:16 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d8a6400f-8e19-4137-a8a3-f796d9c41c86 tempest-TestStampPattern-580697789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c7876c9-96e7-4f4d-a7b8-0d975fcf065a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:47:16 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d8a6400f-8e19-4137-a8a3-f796d9c41c86 tempest-TestStampPattern-580697789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4b33c85-b9c9-41fc-a20a-a55dc673dd0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:47:16 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-d8a6400f-8e19-4137-a8a3-f796d9c41c86 tempest-TestStampPattern-580697789 None] Volume 9d58229e-d2f2-4c10-a3c7-5eab09caeaa3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9d58229e-d2f2-4c10-a3c7-5eab09caeaa3', 'volume_size': 1, 'snapshot_id': '8781d896-20dd-4f26-a8c4-7feb8d88d94e'} Sep 18 21:47:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-d8a6400f-8e19-4137-a8a3-f796d9c41c86 tempest-TestStampPattern-580697789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:47:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-d8a6400f-8e19-4137-a8a3-f796d9c41c86 tempest-TestStampPattern-580697789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:47:16 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d8a6400f-8e19-4137-a8a3-f796d9c41c86 tempest-TestStampPattern-580697789 None] Acquiring lock "cinder-quobyte-8781d896-20dd-4f26-a8c4-7feb8d88d94e-9d58229e-d2f2-4c10-a3c7-5eab09caeaa3" by "_create_volume_from_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:47:16 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d8a6400f-8e19-4137-a8a3-f796d9c41c86 tempest-TestStampPattern-580697789 None] Lock "cinder-quobyte-8781d896-20dd-4f26-a8c4-7feb8d88d94e-9d58229e-d2f2-4c10-a3c7-5eab09caeaa3" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:47:16 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-d8a6400f-8e19-4137-a8a3-f796d9c41c86 tempest-TestStampPattern-580697789 None] Creating volume 9d58229e-d2f2-4c10-a3c7-5eab09caeaa3 from snapshot 8781d896-20dd-4f26-a8c4-7feb8d88d94e {{(pid=86136) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 18 21:47:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-d8a6400f-8e19-4137-a8a3-f796d9c41c86 tempest-TestStampPattern-580697789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:47:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-d8a6400f-8e19-4137-a8a3-f796d9c41c86 tempest-TestStampPattern-580697789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:47:16 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-d8a6400f-8e19-4137-a8a3-f796d9c41c86 tempest-TestStampPattern-580697789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:47:16 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-d8a6400f-8e19-4137-a8a3-f796d9c41c86 tempest-TestStampPattern-580697789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:47:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-d8a6400f-8e19-4137-a8a3-f796d9c41c86 tempest-TestStampPattern-580697789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:47:16 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-d8a6400f-8e19-4137-a8a3-f796d9c41c86 tempest-TestStampPattern-580697789 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:47:16 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d8a6400f-8e19-4137-a8a3-f796d9c41c86 tempest-TestStampPattern-580697789 None] Acquiring lock "cinder-quobyte-9d58229e-d2f2-4c10-a3c7-5eab09caeaa3" by "_copy_volume_from_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:47:16 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-90da3886-1815-4371-bfe1-f0f3b76fe400 tempest-VolumesListAdminTestJSON-1184658396 None] Acquiring lock "cinder-35984821-2cd8-4184-84a7-dacda62bb9c8-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:47:16 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d8a6400f-8e19-4137-a8a3-f796d9c41c86 tempest-TestStampPattern-580697789 None] Lock "cinder-quobyte-9d58229e-d2f2-4c10-a3c7-5eab09caeaa3" acquired by "_copy_volume_from_snapshot" :: waited 0.041s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:47:16 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-d8a6400f-8e19-4137-a8a3-f796d9c41c86 tempest-TestStampPattern-580697789 None] snapshot: 8781d896-20dd-4f26-a8c4-7feb8d88d94e, volume: 9d58229e-d2f2-4c10-a3c7-5eab09caeaa3, {{(pid=86136) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 18 21:47:16 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-90da3886-1815-4371-bfe1-f0f3b76fe400 tempest-VolumesListAdminTestJSON-1184658396 None] Lock "cinder-35984821-2cd8-4184-84a7-dacda62bb9c8-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:47:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-d8a6400f-8e19-4137-a8a3-f796d9c41c86 tempest-TestStampPattern-580697789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:47:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-d8a6400f-8e19-4137-a8a3-f796d9c41c86 tempest-TestStampPattern-580697789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:47:17 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-d8a6400f-8e19-4137-a8a3-f796d9c41c86 tempest-TestStampPattern-580697789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:47:17 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-d8a6400f-8e19-4137-a8a3-f796d9c41c86 tempest-TestStampPattern-580697789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:47:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-d8a6400f-8e19-4137-a8a3-f796d9c41c86 tempest-TestStampPattern-580697789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:47:17 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[63259121-a492-468e-affd-9e8c1ce627ff]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:47:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d8a6400f-8e19-4137-a8a3-f796d9c41c86 tempest-TestStampPattern-580697789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a6eaf836-5be5-4ea9-a3b4-497ffeaa19df.8781d896-20dd-4f26-a8c4-7feb8d88d94e {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:17 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-90da3886-1815-4371-bfe1-f0f3b76fe400 tempest-VolumesListAdminTestJSON-1184658396 None] Acquiring lock "cinder-quobyte-35984821-2cd8-4184-84a7-dacda62bb9c8" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:47:17 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-90da3886-1815-4371-bfe1-f0f3b76fe400 tempest-VolumesListAdminTestJSON-1184658396 None] Lock "cinder-quobyte-35984821-2cd8-4184-84a7-dacda62bb9c8" acquired by "delete_volume" :: waited 0.021s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:47:17 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[28145ae1-1d4f-42fa-ba1a-a68abda86410]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:47:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-90da3886-1815-4371-bfe1-f0f3b76fe400 tempest-VolumesListAdminTestJSON-1184658396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-35984821-2cd8-4184-84a7-dacda62bb9c8 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:17 devstack sudo[101658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a6eaf836-5be5-4ea9-a3b4-497ffeaa19df.8781d896-20dd-4f26-a8c4-7feb8d88d94e Sep 18 21:47:17 devstack sudo[101658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:17 devstack sudo[101659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-35984821-2cd8-4184-84a7-dacda62bb9c8 Sep 18 21:47:17 devstack sudo[101659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:17 devstack sudo[101658]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d8a6400f-8e19-4137-a8a3-f796d9c41c86 tempest-TestStampPattern-580697789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a6eaf836-5be5-4ea9-a3b4-497ffeaa19df.8781d896-20dd-4f26-a8c4-7feb8d88d94e" returned: 0 in 0.449s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:17 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-d8a6400f-8e19-4137-a8a3-f796d9c41c86 tempest-TestStampPattern-580697789 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a6eaf836-5be5-4ea9-a3b4-497ffeaa19df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86136) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 21:47:17 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd3d57b7-5df0-4025-84eb-19a01a7ee970]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:47:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d8a6400f-8e19-4137-a8a3-f796d9c41c86 tempest-TestStampPattern-580697789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a6eaf836-5be5-4ea9-a3b4-497ffeaa19df {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:17 devstack sudo[101659]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-90da3886-1815-4371-bfe1-f0f3b76fe400 tempest-VolumesListAdminTestJSON-1184658396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-35984821-2cd8-4184-84a7-dacda62bb9c8" returned: 0 in 0.494s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-90da3886-1815-4371-bfe1-f0f3b76fe400 tempest-VolumesListAdminTestJSON-1184658396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-35984821-2cd8-4184-84a7-dacda62bb9c8 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:17 devstack sudo[101670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-35984821-2cd8-4184-84a7-dacda62bb9c8 Sep 18 21:47:17 devstack sudo[101670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:17 devstack sudo[101665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a6eaf836-5be5-4ea9-a3b4-497ffeaa19df Sep 18 21:47:17 devstack sudo[101665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:17 devstack sudo[101670]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-90da3886-1815-4371-bfe1-f0f3b76fe400 tempest-VolumesListAdminTestJSON-1184658396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-35984821-2cd8-4184-84a7-dacda62bb9c8" returned: 0 in 0.381s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:18 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-90da3886-1815-4371-bfe1-f0f3b76fe400 tempest-VolumesListAdminTestJSON-1184658396 None] Lock "cinder-quobyte-35984821-2cd8-4184-84a7-dacda62bb9c8" released by "delete_volume" :: held 0.947s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:47:18 devstack sudo[101665]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d8a6400f-8e19-4137-a8a3-f796d9c41c86 tempest-TestStampPattern-580697789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a6eaf836-5be5-4ea9-a3b4-497ffeaa19df" returned: 0 in 0.554s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:18 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-d8a6400f-8e19-4137-a8a3-f796d9c41c86 tempest-TestStampPattern-580697789 None] will copy from snapshot at /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a6eaf836-5be5-4ea9-a3b4-497ffeaa19df {{(pid=86136) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 18 21:47:18 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-d8a6400f-8e19-4137-a8a3-f796d9c41c86 tempest-TestStampPattern-580697789 None] Creating direct copy from snapshot {{(pid=86136) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 18 21:47:18 devstack cinder-volume[86136]: DEBUG cinder.utils [None req-d8a6400f-8e19-4137-a8a3-f796d9c41c86 tempest-TestStampPattern-580697789 None] Path /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9d58229e-d2f2-4c10-a3c7-5eab09caeaa3 not found in is_blk_device check {{(pid=86136) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 18 21:47:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d8a6400f-8e19-4137-a8a3-f796d9c41c86 tempest-TestStampPattern-580697789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a6eaf836-5be5-4ea9-a3b4-497ffeaa19df /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9d58229e-d2f2-4c10-a3c7-5eab09caeaa3 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:18 devstack sudo[101680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a6eaf836-5be5-4ea9-a3b4-497ffeaa19df /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9d58229e-d2f2-4c10-a3c7-5eab09caeaa3 Sep 18 21:47:18 devstack sudo[101680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:18 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-90da3886-1815-4371-bfe1-f0f3b76fe400 tempest-VolumesListAdminTestJSON-1184658396 None] Created reservations ['472b0304-1663-4b62-89a3-b78664532c80', '93e8ab7e-ddcc-4595-87c5-5445424c4f77', '400cc847-0907-479a-9b1a-fa9c5869374f', '22b2801e-45bf-4293-ab98-a45776a17615'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:47:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-90da3886-1815-4371-bfe1-f0f3b76fe400 tempest-VolumesListAdminTestJSON-1184658396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:47:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-90da3886-1815-4371-bfe1-f0f3b76fe400 tempest-VolumesListAdminTestJSON-1184658396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:47:18 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-90da3886-1815-4371-bfe1-f0f3b76fe400 tempest-VolumesListAdminTestJSON-1184658396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:47:18 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-90da3886-1815-4371-bfe1-f0f3b76fe400 tempest-VolumesListAdminTestJSON-1184658396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:47:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-90da3886-1815-4371-bfe1-f0f3b76fe400 tempest-VolumesListAdminTestJSON-1184658396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:47:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-90da3886-1815-4371-bfe1-f0f3b76fe400 tempest-VolumesListAdminTestJSON-1184658396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:18 devstack sudo[101682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:47:18 devstack sudo[101682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:18 devstack sudo[101682]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-90da3886-1815-4371-bfe1-f0f3b76fe400 tempest-VolumesListAdminTestJSON-1184658396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.339s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:18 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-90da3886-1815-4371-bfe1-f0f3b76fe400 tempest-VolumesListAdminTestJSON-1184658396 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:47:18 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-90da3886-1815-4371-bfe1-f0f3b76fe400 tempest-VolumesListAdminTestJSON-1184658396 None] Deleted volume successfully. Sep 18 21:47:18 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-90da3886-1815-4371-bfe1-f0f3b76fe400 tempest-VolumesListAdminTestJSON-1184658396 None] Lock "cinder-35984821-2cd8-4184-84a7-dacda62bb9c8-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:47:28 devstack cinder-volume[86136]: DEBUG dbcounter [-] [86136] Writing DB stats cinder:SELECT=106,cinder:INSERT=33,cinder:UPDATE=123,cinder:DELETE=15 {{(pid=86136) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 21:47:28 devstack cinder-volume[86136]: DEBUG dbcounter [-] [86136] Writing DB stats cinder:SELECT=107,cinder:UPDATE=143,cinder:INSERT=28,cinder:DELETE=9 {{(pid=86136) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 21:47:28 devstack sudo[101680]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d8a6400f-8e19-4137-a8a3-f796d9c41c86 tempest-TestStampPattern-580697789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a6eaf836-5be5-4ea9-a3b4-497ffeaa19df /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9d58229e-d2f2-4c10-a3c7-5eab09caeaa3" returned: 0 in 10.564s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:28 devstack cinder-volume[86136]: DEBUG cinder.image.image_utils [None req-d8a6400f-8e19-4137-a8a3-f796d9c41c86 tempest-TestStampPattern-580697789 None] Image conversion details: src /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a6eaf836-5be5-4ea9-a3b4-497ffeaa19df, size 1024.00 MB, duration 10.57 sec, destination /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9d58229e-d2f2-4c10-a3c7-5eab09caeaa3 {{(pid=86136) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 18 21:47:28 devstack cinder-volume[86136]: INFO cinder.image.image_utils [None req-d8a6400f-8e19-4137-a8a3-f796d9c41c86 tempest-TestStampPattern-580697789 None] Converted 1024.00 MB image at 96.92 MB/s Sep 18 21:47:28 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-d8a6400f-8e19-4137-a8a3-f796d9c41c86 tempest-TestStampPattern-580697789 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9d58229e-d2f2-4c10-a3c7-5eab09caeaa3 is being set with open permissions: ugo+rw Sep 18 21:47:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d8a6400f-8e19-4137-a8a3-f796d9c41c86 tempest-TestStampPattern-580697789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9d58229e-d2f2-4c10-a3c7-5eab09caeaa3 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:28 devstack sudo[101769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9d58229e-d2f2-4c10-a3c7-5eab09caeaa3 Sep 18 21:47:28 devstack sudo[101769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:29 devstack sudo[101769]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d8a6400f-8e19-4137-a8a3-f796d9c41c86 tempest-TestStampPattern-580697789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9d58229e-d2f2-4c10-a3c7-5eab09caeaa3" returned: 0 in 0.496s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:29 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d8a6400f-8e19-4137-a8a3-f796d9c41c86 tempest-TestStampPattern-580697789 None] Lock "cinder-quobyte-9d58229e-d2f2-4c10-a3c7-5eab09caeaa3" released by "_copy_volume_from_snapshot" :: held 12.195s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:47:29 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d8a6400f-8e19-4137-a8a3-f796d9c41c86 tempest-TestStampPattern-580697789 None] Lock "cinder-quobyte-8781d896-20dd-4f26-a8c4-7feb8d88d94e-9d58229e-d2f2-4c10-a3c7-5eab09caeaa3" released by "_create_volume_from_snapshot" :: held 12.380s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:47:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-d8a6400f-8e19-4137-a8a3-f796d9c41c86 tempest-TestStampPattern-580697789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.402s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:47:29 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d8a6400f-8e19-4137-a8a3-f796d9c41c86 tempest-TestStampPattern-580697789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4b33c85-b9c9-41fc-a20a-a55dc673dd0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d58229e-d2f2-4c10-a3c7-5eab09caeaa3', 'volume_size': 1, 'snapshot_id': '8781d896-20dd-4f26-a8c4-7feb8d88d94e'}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:47:29 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d8a6400f-8e19-4137-a8a3-f796d9c41c86 tempest-TestStampPattern-580697789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (585f4734-7794-4920-a1f3-c58651b360c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:47:29 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-d8a6400f-8e19-4137-a8a3-f796d9c41c86 tempest-TestStampPattern-580697789 None] Volume volume-9d58229e-d2f2-4c10-a3c7-5eab09caeaa3 (9d58229e-d2f2-4c10-a3c7-5eab09caeaa3): created successfully Sep 18 21:47:29 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d8a6400f-8e19-4137-a8a3-f796d9c41c86 tempest-TestStampPattern-580697789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (585f4734-7794-4920-a1f3-c58651b360c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:47:29 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d8a6400f-8e19-4137-a8a3-f796d9c41c86 tempest-TestStampPattern-580697789 None] Flow 'volume_create_manager' (55477ec8-8fb4-428f-a1bf-777edbd023a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:47:29 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-d8a6400f-8e19-4137-a8a3-f796d9c41c86 tempest-TestStampPattern-580697789 None] Created volume successfully. Sep 18 21:47:30 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-53c4b81c-acce-47cc-8b6c-61db98caf770 tempest-VolumeImageDependencyTests-1780472749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:47:30 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-53c4b81c-acce-47cc-8b6c-61db98caf770 tempest-VolumeImageDependencyTests-1780472749 None] Flow 'volume_create_manager' (13ba11b3-3572-415f-af25-ce6986e4c9b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:47:30 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-53c4b81c-acce-47cc-8b6c-61db98caf770 tempest-VolumeImageDependencyTests-1780472749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3253801-6616-4a0c-b75f-c5b1be119ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:47:30 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-53c4b81c-acce-47cc-8b6c-61db98caf770 tempest-VolumeImageDependencyTests-1780472749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3253801-6616-4a0c-b75f-c5b1be119ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:47:30Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=274094ff-417c-4ce4-af42-be7f70e67ef2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2748a43f67f24b34afc17280f00ca39a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:47:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:47:30Z,use_quota=True,user_id='d34a77dc73354823978680b2e9a01ef5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:47:30 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-53c4b81c-acce-47cc-8b6c-61db98caf770 tempest-VolumeImageDependencyTests-1780472749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (851b74dd-79b8-4711-9290-fcd8d0b97876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:47:30 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-53c4b81c-acce-47cc-8b6c-61db98caf770 tempest-VolumeImageDependencyTests-1780472749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (851b74dd-79b8-4711-9290-fcd8d0b97876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:47:30 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-53c4b81c-acce-47cc-8b6c-61db98caf770 tempest-VolumeImageDependencyTests-1780472749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (060f6bd0-5911-4472-85d8-3e64a982f51c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:47:30 devstack cinder-volume[86136]: DEBUG cinder.image.glance [None req-53c4b81c-acce-47cc-8b6c-61db98caf770 tempest-VolumeImageDependencyTests-1780472749 None] Creating Keystone auth plugin from conf {{(pid=86136) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 18 21:47:30 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-53c4b81c-acce-47cc-8b6c-61db98caf770 tempest-VolumeImageDependencyTests-1780472749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (060f6bd0-5911-4472-85d8-3e64a982f51c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '274094ff-417c-4ce4-af42-be7f70e67ef2', 'volume_name': 'volume-274094ff-417c-4ce4-af42-be7f70e67ef2', 'volume_size': 1, 'image_id': '315d7ccc-0f49-4b5d-9a19-12b0099948b5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/315d7ccc-0f49-4b5d-9a19-12b0099948b5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f5653219f98b6c777481771c89344d7c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2748a43f67f24b34afc17280f00ca39a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fbb7ec2b0b6cf96572f5ef256dce072c2adbc56a2a1989be2a81d93d137ed4818b628a51eeeedad3ac839412a18aec394916854f73eac0b4cb9e04b85a03ff14', 'id': '315d7ccc-0f49-4b5d-9a19-12b0099948b5', 'created_at': datetime.datetime(2026, 9, 18, 19, 47, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 18, 19, 47, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/315d7ccc-0f49-4b5d-9a19-12b0099948b5/file', 'properties': {}}, 'image_service': }' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:47:30 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-53c4b81c-acce-47cc-8b6c-61db98caf770 tempest-VolumeImageDependencyTests-1780472749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f7fd9ac-ce38-4f0b-a1fa-f09233ebdd1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:47:30 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-53c4b81c-acce-47cc-8b6c-61db98caf770 tempest-VolumeImageDependencyTests-1780472749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f7fd9ac-ce38-4f0b-a1fa-f09233ebdd1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:47:30 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-53c4b81c-acce-47cc-8b6c-61db98caf770 tempest-VolumeImageDependencyTests-1780472749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (281778d5-fca8-4261-9fb7-23667930d18d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:47:30 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-53c4b81c-acce-47cc-8b6c-61db98caf770 tempest-VolumeImageDependencyTests-1780472749 None] Volume 274094ff-417c-4ce4-af42-be7f70e67ef2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-274094ff-417c-4ce4-af42-be7f70e67ef2', 'volume_size': 1, 'image_id': '315d7ccc-0f49-4b5d-9a19-12b0099948b5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/315d7ccc-0f49-4b5d-9a19-12b0099948b5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f5653219f98b6c777481771c89344d7c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2748a43f67f24b34afc17280f00ca39a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fbb7ec2b0b6cf96572f5ef256dce072c2adbc56a2a1989be2a81d93d137ed4818b628a51eeeedad3ac839412a18aec394916854f73eac0b4cb9e04b85a03ff14', 'id': '315d7ccc-0f49-4b5d-9a19-12b0099948b5', 'created_at': datetime.datetime(2026, 9, 18, 19, 47, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 18, 19, 47, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/315d7ccc-0f49-4b5d-9a19-12b0099948b5/file', 'properties': {}}, 'image_service': } Sep 18 21:47:30 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-53c4b81c-acce-47cc-8b6c-61db98caf770 tempest-VolumeImageDependencyTests-1780472749 None] Trying to clone 274094ff-417c-4ce4-af42-be7f70e67ef2 from image 315d7ccc-0f49-4b5d-9a19-12b0099948b5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/315d7ccc-0f49-4b5d-9a19-12b0099948b5', 'metadata': {}}]). {{(pid=86136) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 18 21:47:30 devstack cinder-volume[86136]: DEBUG cinder.image.image_utils [None req-53c4b81c-acce-47cc-8b6c-61db98caf770 tempest-VolumeImageDependencyTests-1780472749 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_315d7ccc-0f49-4b5d-9a19-12b0099948b5_c8s6u50pdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86136) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 18 21:47:30 devstack cinder-volume[86136]: INFO cinder.image.image_utils [None req-53c4b81c-acce-47cc-8b6c-61db98caf770 tempest-VolumeImageDependencyTests-1780472749 None] Image download 0.00 MB at 0.00 MB/s Sep 18 21:47:31 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d02a3ae-81a5-40ef-99b6-c87cc04315ee]: (4, 'raw') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:47:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-53c4b81c-acce-47cc-8b6c-61db98caf770 tempest-VolumeImageDependencyTests-1780472749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_315d7ccc-0f49-4b5d-9a19-12b0099948b5_c8s6u50pdevstack@QuobyteHD {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:31 devstack sudo[101819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_315d7ccc-0f49-4b5d-9a19-12b0099948b5_c8s6u50pdevstack@QuobyteHD Sep 18 21:47:31 devstack sudo[101819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:31 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e26bf2b-82b3-447d-8c66-1fa611df20e3 tempest-VolumesMetadataTest-758873271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:47:31 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-4e26bf2b-82b3-447d-8c66-1fa611df20e3 tempest-VolumesMetadataTest-758873271 None] Flow 'volume_create_manager' (d6513ac3-565c-4638-8169-ae9479fa6f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:47:31 devstack sudo[101819]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:31 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-4e26bf2b-82b3-447d-8c66-1fa611df20e3 tempest-VolumesMetadataTest-758873271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9497a21f-e0f1-428e-9aed-f07ed4c98d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:47:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-53c4b81c-acce-47cc-8b6c-61db98caf770 tempest-VolumeImageDependencyTests-1780472749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_315d7ccc-0f49-4b5d-9a19-12b0099948b5_c8s6u50pdevstack@QuobyteHD" returned: 0 in 0.571s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-53c4b81c-acce-47cc-8b6c-61db98caf770 tempest-VolumeImageDependencyTests-1780472749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_315d7ccc-0f49-4b5d-9a19-12b0099948b5_c8s6u50pdevstack@QuobyteHD {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:31 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-4e26bf2b-82b3-447d-8c66-1fa611df20e3 tempest-VolumesMetadataTest-758873271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9497a21f-e0f1-428e-9aed-f07ed4c98d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:47:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-75361921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48385b22-ec6a-41d1-a1f5-1176537514ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9504da4c3564abea4af56d316cc4945',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:47:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:47:31Z,use_quota=True,user_id='04bbe897e93041839939b1b5f1c0cc68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:47:31 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-4e26bf2b-82b3-447d-8c66-1fa611df20e3 tempest-VolumesMetadataTest-758873271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07ec9841-9573-4091-8924-0893671a6469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:47:31 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-4e26bf2b-82b3-447d-8c66-1fa611df20e3 tempest-VolumesMetadataTest-758873271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07ec9841-9573-4091-8924-0893671a6469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:47:31 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-4e26bf2b-82b3-447d-8c66-1fa611df20e3 tempest-VolumesMetadataTest-758873271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (607758d4-06d7-42a6-9d32-fe33cc40b78d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:47:31 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-4e26bf2b-82b3-447d-8c66-1fa611df20e3 tempest-VolumesMetadataTest-758873271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (607758d4-06d7-42a6-9d32-fe33cc40b78d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48385b22-ec6a-41d1-a1f5-1176537514ab', 'volume_name': 'volume-48385b22-ec6a-41d1-a1f5-1176537514ab', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:47:31 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-4e26bf2b-82b3-447d-8c66-1fa611df20e3 tempest-VolumesMetadataTest-758873271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34cb95ed-7ac3-42dd-9326-72a21b0eb887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:47:31 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-4e26bf2b-82b3-447d-8c66-1fa611df20e3 tempest-VolumesMetadataTest-758873271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34cb95ed-7ac3-42dd-9326-72a21b0eb887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:47:31 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-4e26bf2b-82b3-447d-8c66-1fa611df20e3 tempest-VolumesMetadataTest-758873271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e941c537-cb4a-473a-8273-0e686c3738aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:47:31 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-4e26bf2b-82b3-447d-8c66-1fa611df20e3 tempest-VolumesMetadataTest-758873271 None] Volume 48385b22-ec6a-41d1-a1f5-1176537514ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48385b22-ec6a-41d1-a1f5-1176537514ab', 'volume_size': 1} Sep 18 21:47:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-4e26bf2b-82b3-447d-8c66-1fa611df20e3 tempest-VolumesMetadataTest-758873271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:47:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-4e26bf2b-82b3-447d-8c66-1fa611df20e3 tempest-VolumesMetadataTest-758873271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:47:31 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-4e26bf2b-82b3-447d-8c66-1fa611df20e3 tempest-VolumesMetadataTest-758873271 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:47:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-75361921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48385b22-ec6a-41d1-a1f5-1176537514ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9504da4c3564abea4af56d316cc4945',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:47:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:47:31Z,use_quota=True,user_id='04bbe897e93041839939b1b5f1c0cc68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:47:31 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-4e26bf2b-82b3-447d-8c66-1fa611df20e3 tempest-VolumesMetadataTest-758873271 None] Creating volume 48385b22-ec6a-41d1-a1f5-1176537514ab {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:47:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-4e26bf2b-82b3-447d-8c66-1fa611df20e3 tempest-VolumesMetadataTest-758873271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:47:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-4e26bf2b-82b3-447d-8c66-1fa611df20e3 tempest-VolumesMetadataTest-758873271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:47:31 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-4e26bf2b-82b3-447d-8c66-1fa611df20e3 tempest-VolumesMetadataTest-758873271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:47:31 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-4e26bf2b-82b3-447d-8c66-1fa611df20e3 tempest-VolumesMetadataTest-758873271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:47:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-4e26bf2b-82b3-447d-8c66-1fa611df20e3 tempest-VolumesMetadataTest-758873271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:47:31 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-4e26bf2b-82b3-447d-8c66-1fa611df20e3 tempest-VolumesMetadataTest-758873271 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:47:31 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-4e26bf2b-82b3-447d-8c66-1fa611df20e3 tempest-VolumesMetadataTest-758873271 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:47:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-4e26bf2b-82b3-447d-8c66-1fa611df20e3 tempest-VolumesMetadataTest-758873271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-48385b22-ec6a-41d1-a1f5-1176537514ab 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:31 devstack sudo[101826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-48385b22-ec6a-41d1-a1f5-1176537514ab 1073741824 Sep 18 21:47:31 devstack sudo[101826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:31 devstack sudo[101825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_315d7ccc-0f49-4b5d-9a19-12b0099948b5_c8s6u50pdevstack@QuobyteHD Sep 18 21:47:31 devstack sudo[101825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:32 devstack sudo[101825]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-53c4b81c-acce-47cc-8b6c-61db98caf770 tempest-VolumeImageDependencyTests-1780472749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_315d7ccc-0f49-4b5d-9a19-12b0099948b5_c8s6u50pdevstack@QuobyteHD" returned: 1 in 0.920s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-53c4b81c-acce-47cc-8b6c-61db98caf770 tempest-VolumeImageDependencyTests-1780472749 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_315d7ccc-0f49-4b5d-9a19-12b0099948b5_c8s6u50pdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 18 21:47:32 devstack cinder-volume[86136]: DEBUG cinder.image.image_utils [None req-53c4b81c-acce-47cc-8b6c-61db98caf770 tempest-VolumeImageDependencyTests-1780472749 None] Temporary image 315d7ccc-0f49-4b5d-9a19-12b0099948b5 is fetched for user d34a77dc73354823978680b2e9a01ef5. {{(pid=86136) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 18 21:47:32 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc39dfd-ee5a-47c9-9cf8-2ced3e50c3b6]: (4, 'raw') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:47:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-53c4b81c-acce-47cc-8b6c-61db98caf770 tempest-VolumeImageDependencyTests-1780472749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_315d7ccc-0f49-4b5d-9a19-12b0099948b5_c8s6u50pdevstack@QuobyteHD {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:32 devstack sudo[101826]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-4e26bf2b-82b3-447d-8c66-1fa611df20e3 tempest-VolumesMetadataTest-758873271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-48385b22-ec6a-41d1-a1f5-1176537514ab 1073741824" returned: 0 in 1.106s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-4e26bf2b-82b3-447d-8c66-1fa611df20e3 tempest-VolumesMetadataTest-758873271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-48385b22-ec6a-41d1-a1f5-1176537514ab {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:33 devstack sudo[101855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_315d7ccc-0f49-4b5d-9a19-12b0099948b5_c8s6u50pdevstack@QuobyteHD Sep 18 21:47:33 devstack sudo[101855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:33 devstack sudo[101856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-48385b22-ec6a-41d1-a1f5-1176537514ab Sep 18 21:47:33 devstack sudo[101856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:33 devstack sudo[101855]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:33 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-53c4b81c-acce-47cc-8b6c-61db98caf770 tempest-VolumeImageDependencyTests-1780472749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_315d7ccc-0f49-4b5d-9a19-12b0099948b5_c8s6u50pdevstack@QuobyteHD" returned: 0 in 0.693s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:33 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-53c4b81c-acce-47cc-8b6c-61db98caf770 tempest-VolumeImageDependencyTests-1780472749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_315d7ccc-0f49-4b5d-9a19-12b0099948b5_c8s6u50pdevstack@QuobyteHD {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:33 devstack sudo[101856]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:33 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-4e26bf2b-82b3-447d-8c66-1fa611df20e3 tempest-VolumesMetadataTest-758873271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-48385b22-ec6a-41d1-a1f5-1176537514ab" returned: 0 in 0.696s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:33 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-4e26bf2b-82b3-447d-8c66-1fa611df20e3 tempest-VolumesMetadataTest-758873271 None] <== create_volume: return (1926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:47:33 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-4e26bf2b-82b3-447d-8c66-1fa611df20e3 tempest-VolumesMetadataTest-758873271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.934s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:47:33 devstack sudo[101862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_315d7ccc-0f49-4b5d-9a19-12b0099948b5_c8s6u50pdevstack@QuobyteHD Sep 18 21:47:33 devstack sudo[101862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:33 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-4e26bf2b-82b3-447d-8c66-1fa611df20e3 tempest-VolumesMetadataTest-758873271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e941c537-cb4a-473a-8273-0e686c3738aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48385b22-ec6a-41d1-a1f5-1176537514ab', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:47:33 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-4e26bf2b-82b3-447d-8c66-1fa611df20e3 tempest-VolumesMetadataTest-758873271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d370468a-af32-4371-abbb-bec549f08b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:47:33 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-4e26bf2b-82b3-447d-8c66-1fa611df20e3 tempest-VolumesMetadataTest-758873271 None] Volume volume-48385b22-ec6a-41d1-a1f5-1176537514ab (48385b22-ec6a-41d1-a1f5-1176537514ab): created successfully Sep 18 21:47:33 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-4e26bf2b-82b3-447d-8c66-1fa611df20e3 tempest-VolumesMetadataTest-758873271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d370468a-af32-4371-abbb-bec549f08b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:47:33 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-4e26bf2b-82b3-447d-8c66-1fa611df20e3 tempest-VolumesMetadataTest-758873271 None] Flow 'volume_create_manager' (d6513ac3-565c-4638-8169-ae9479fa6f49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:47:33 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-4e26bf2b-82b3-447d-8c66-1fa611df20e3 tempest-VolumesMetadataTest-758873271 None] Created volume successfully. Sep 18 21:47:34 devstack sudo[101862]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:34 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-53c4b81c-acce-47cc-8b6c-61db98caf770 tempest-VolumeImageDependencyTests-1780472749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_315d7ccc-0f49-4b5d-9a19-12b0099948b5_c8s6u50pdevstack@QuobyteHD" returned: 1 in 0.512s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:34 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-53c4b81c-acce-47cc-8b6c-61db98caf770 tempest-VolumeImageDependencyTests-1780472749 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_315d7ccc-0f49-4b5d-9a19-12b0099948b5_c8s6u50pdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 18 21:47:34 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-53c4b81c-acce-47cc-8b6c-61db98caf770 tempest-VolumeImageDependencyTests-1780472749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:47:34 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-53c4b81c-acce-47cc-8b6c-61db98caf770 tempest-VolumeImageDependencyTests-1780472749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:47:34 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-53c4b81c-acce-47cc-8b6c-61db98caf770 tempest-VolumeImageDependencyTests-1780472749 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:47:30Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=274094ff-417c-4ce4-af42-be7f70e67ef2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2748a43f67f24b34afc17280f00ca39a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:47:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:47:30Z,use_quota=True,user_id='d34a77dc73354823978680b2e9a01ef5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:47:34 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-53c4b81c-acce-47cc-8b6c-61db98caf770 tempest-VolumeImageDependencyTests-1780472749 None] Creating volume 274094ff-417c-4ce4-af42-be7f70e67ef2 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:47:34 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-53c4b81c-acce-47cc-8b6c-61db98caf770 tempest-VolumeImageDependencyTests-1780472749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:47:34 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-53c4b81c-acce-47cc-8b6c-61db98caf770 tempest-VolumeImageDependencyTests-1780472749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:47:34 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-53c4b81c-acce-47cc-8b6c-61db98caf770 tempest-VolumeImageDependencyTests-1780472749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:47:34 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-53c4b81c-acce-47cc-8b6c-61db98caf770 tempest-VolumeImageDependencyTests-1780472749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:47:34 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-53c4b81c-acce-47cc-8b6c-61db98caf770 tempest-VolumeImageDependencyTests-1780472749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:47:34 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-53c4b81c-acce-47cc-8b6c-61db98caf770 tempest-VolumeImageDependencyTests-1780472749 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:47:34 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-53c4b81c-acce-47cc-8b6c-61db98caf770 tempest-VolumeImageDependencyTests-1780472749 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:47:34 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-53c4b81c-acce-47cc-8b6c-61db98caf770 tempest-VolumeImageDependencyTests-1780472749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-274094ff-417c-4ce4-af42-be7f70e67ef2 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:34 devstack sudo[101868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-274094ff-417c-4ce4-af42-be7f70e67ef2 1073741824 Sep 18 21:47:34 devstack sudo[101868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:34 devstack sudo[101868]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:34 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-53c4b81c-acce-47cc-8b6c-61db98caf770 tempest-VolumeImageDependencyTests-1780472749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-274094ff-417c-4ce4-af42-be7f70e67ef2 1073741824" returned: 0 in 0.589s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:34 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-53c4b81c-acce-47cc-8b6c-61db98caf770 tempest-VolumeImageDependencyTests-1780472749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-274094ff-417c-4ce4-af42-be7f70e67ef2 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:34 devstack sudo[101876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-274094ff-417c-4ce4-af42-be7f70e67ef2 Sep 18 21:47:34 devstack sudo[101876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:35 devstack cinder-volume[86136]: INFO cinder.volume.manager [req-057a809e-60e6-48b3-ade6-7e92eab044b5 req-bdf506ee-f07f-4a23-9763-21dbecad2850 tempest-TestShelveInstance-1002688398 None] Terminate volume connection completed successfully. Sep 18 21:47:35 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [req-057a809e-60e6-48b3-ade6-7e92eab044b5 req-bdf506ee-f07f-4a23-9763-21dbecad2850 tempest-TestShelveInstance-1002688398 None] Deleting attachment b7f0a0b7-6e1b-4794-a678-1569308c10c3. {{(pid=86136) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 18 21:47:35 devstack sudo[101876]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:35 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-53c4b81c-acce-47cc-8b6c-61db98caf770 tempest-VolumeImageDependencyTests-1780472749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-274094ff-417c-4ce4-af42-be7f70e67ef2" returned: 0 in 0.443s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:35 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-53c4b81c-acce-47cc-8b6c-61db98caf770 tempest-VolumeImageDependencyTests-1780472749 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:47:35 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-53c4b81c-acce-47cc-8b6c-61db98caf770 tempest-VolumeImageDependencyTests-1780472749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:47:35 devstack cinder-volume[86136]: DEBUG cinder.volume.volume_utils [None req-53c4b81c-acce-47cc-8b6c-61db98caf770 tempest-VolumeImageDependencyTests-1780472749 None] Attempting download of 315d7ccc-0f49-4b5d-9a19-12b0099948b5 ((None, [{'url': 'file:///opt/stack/data/glance/images/315d7ccc-0f49-4b5d-9a19-12b0099948b5', 'metadata': {}}])) to volume 274094ff-417c-4ce4-af42-be7f70e67ef2. {{(pid=86136) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 18 21:47:35 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b7ea9f0-34f9-4236-b961-2e9a055ffc8d]: (4, 'raw') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:47:35 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-53c4b81c-acce-47cc-8b6c-61db98caf770 tempest-VolumeImageDependencyTests-1780472749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_315d7ccc-0f49-4b5d-9a19-12b0099948b5_0rnydfw5 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:35 devstack sudo[101880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_315d7ccc-0f49-4b5d-9a19-12b0099948b5_0rnydfw5 Sep 18 21:47:35 devstack sudo[101880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:35 devstack cinder-volume[86136]: DEBUG cinder.coordination [req-057a809e-60e6-48b3-ade6-7e92eab044b5 req-9ce2dc64-d66c-4948-8d8d-00d01c7a3d4f tempest-TestShelveInstance-1002688398 None] Acquiring lock "cinder-45edcf0b-344c-40f8-bf50-766ce05c30ac-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:47:35 devstack cinder-volume[86136]: DEBUG cinder.coordination [req-057a809e-60e6-48b3-ade6-7e92eab044b5 req-9ce2dc64-d66c-4948-8d8d-00d01c7a3d4f tempest-TestShelveInstance-1002688398 None] Lock "cinder-45edcf0b-344c-40f8-bf50-766ce05c30ac-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:47:35 devstack sudo[101880]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:35 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-53c4b81c-acce-47cc-8b6c-61db98caf770 tempest-VolumeImageDependencyTests-1780472749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_315d7ccc-0f49-4b5d-9a19-12b0099948b5_0rnydfw5" returned: 0 in 0.629s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:35 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-53c4b81c-acce-47cc-8b6c-61db98caf770 tempest-VolumeImageDependencyTests-1780472749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_315d7ccc-0f49-4b5d-9a19-12b0099948b5_0rnydfw5 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:35 devstack cinder-volume[86136]: DEBUG cinder.coordination [req-057a809e-60e6-48b3-ade6-7e92eab044b5 req-9ce2dc64-d66c-4948-8d8d-00d01c7a3d4f tempest-TestShelveInstance-1002688398 None] Acquiring lock "cinder-quobyte-45edcf0b-344c-40f8-bf50-766ce05c30ac" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:47:35 devstack cinder-volume[86136]: DEBUG cinder.coordination [req-057a809e-60e6-48b3-ade6-7e92eab044b5 req-9ce2dc64-d66c-4948-8d8d-00d01c7a3d4f tempest-TestShelveInstance-1002688398 None] Lock "cinder-quobyte-45edcf0b-344c-40f8-bf50-766ce05c30ac" acquired by "delete_volume" :: waited 0.023s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:47:36 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[30eaedef-b5c2-46df-b550-ce4f042c178c]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:47:36 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [req-057a809e-60e6-48b3-ade6-7e92eab044b5 req-9ce2dc64-d66c-4948-8d8d-00d01c7a3d4f tempest-TestShelveInstance-1002688398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-45edcf0b-344c-40f8-bf50-766ce05c30ac {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:36 devstack sudo[101884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_315d7ccc-0f49-4b5d-9a19-12b0099948b5_0rnydfw5 Sep 18 21:47:36 devstack sudo[101884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:36 devstack sudo[101885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-45edcf0b-344c-40f8-bf50-766ce05c30ac Sep 18 21:47:36 devstack sudo[101885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:36 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-5717d63f-e41b-456e-b120-268e00312b9d tempest-VolumesMetadataTest-758873271 None] Acquiring lock "cinder-48385b22-ec6a-41d1-a1f5-1176537514ab-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:47:36 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-5717d63f-e41b-456e-b120-268e00312b9d tempest-VolumesMetadataTest-758873271 None] Lock "cinder-48385b22-ec6a-41d1-a1f5-1176537514ab-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:47:36 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-5717d63f-e41b-456e-b120-268e00312b9d tempest-VolumesMetadataTest-758873271 None] Acquiring lock "cinder-quobyte-48385b22-ec6a-41d1-a1f5-1176537514ab" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:47:36 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-5717d63f-e41b-456e-b120-268e00312b9d tempest-VolumesMetadataTest-758873271 None] Lock "cinder-quobyte-48385b22-ec6a-41d1-a1f5-1176537514ab" acquired by "delete_volume" :: waited 0.039s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:47:36 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[058f0378-8bdd-4c03-8a02-fc7f6d05faba]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:47:36 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5717d63f-e41b-456e-b120-268e00312b9d tempest-VolumesMetadataTest-758873271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-48385b22-ec6a-41d1-a1f5-1176537514ab {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:36 devstack sudo[101884]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:36 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-53c4b81c-acce-47cc-8b6c-61db98caf770 tempest-VolumeImageDependencyTests-1780472749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_315d7ccc-0f49-4b5d-9a19-12b0099948b5_0rnydfw5" returned: 1 in 0.984s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:36 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-53c4b81c-acce-47cc-8b6c-61db98caf770 tempest-VolumeImageDependencyTests-1780472749 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_315d7ccc-0f49-4b5d-9a19-12b0099948b5_0rnydfw5' failed. Not Retrying. {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 18 21:47:36 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f22a52-09e2-44ef-9923-6af609acd3e6]: (4, 'raw') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:47:36 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-53c4b81c-acce-47cc-8b6c-61db98caf770 tempest-VolumeImageDependencyTests-1780472749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_315d7ccc-0f49-4b5d-9a19-12b0099948b5_c8s6u50pdevstack@QuobyteHD {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:36 devstack sudo[101885]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:36 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [req-057a809e-60e6-48b3-ade6-7e92eab044b5 req-9ce2dc64-d66c-4948-8d8d-00d01c7a3d4f tempest-TestShelveInstance-1002688398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-45edcf0b-344c-40f8-bf50-766ce05c30ac" returned: 0 in 0.899s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:36 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [req-057a809e-60e6-48b3-ade6-7e92eab044b5 req-9ce2dc64-d66c-4948-8d8d-00d01c7a3d4f tempest-TestShelveInstance-1002688398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-45edcf0b-344c-40f8-bf50-766ce05c30ac {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:36 devstack sudo[101895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-45edcf0b-344c-40f8-bf50-766ce05c30ac Sep 18 21:47:36 devstack sudo[101895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:37 devstack sudo[101892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-48385b22-ec6a-41d1-a1f5-1176537514ab Sep 18 21:47:37 devstack sudo[101892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:37 devstack sudo[101894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_315d7ccc-0f49-4b5d-9a19-12b0099948b5_c8s6u50pdevstack@QuobyteHD Sep 18 21:47:37 devstack sudo[101894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:37 devstack sudo[101895]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:37 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [req-057a809e-60e6-48b3-ade6-7e92eab044b5 req-9ce2dc64-d66c-4948-8d8d-00d01c7a3d4f tempest-TestShelveInstance-1002688398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-45edcf0b-344c-40f8-bf50-766ce05c30ac" returned: 0 in 0.323s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:37 devstack cinder-volume[86136]: DEBUG cinder.coordination [req-057a809e-60e6-48b3-ade6-7e92eab044b5 req-9ce2dc64-d66c-4948-8d8d-00d01c7a3d4f tempest-TestShelveInstance-1002688398 None] Lock "cinder-quobyte-45edcf0b-344c-40f8-bf50-766ce05c30ac" released by "delete_volume" :: held 1.319s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:47:37 devstack cinder-volume[86136]: DEBUG cinder.quota [req-057a809e-60e6-48b3-ade6-7e92eab044b5 req-9ce2dc64-d66c-4948-8d8d-00d01c7a3d4f tempest-TestShelveInstance-1002688398 None] Created reservations ['a6218c5e-2857-4546-b163-d749f8214acb', 'd3918911-13b8-4367-a8c2-cfcd05f0ed60', '2a8e2d73-ef99-4662-bbc0-1bbfa6eea4d6', 'd9dccfbc-ec41-4e9c-98d9-f186b6a7c7e4'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:47:37 devstack sudo[101894]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:37 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-53c4b81c-acce-47cc-8b6c-61db98caf770 tempest-VolumeImageDependencyTests-1780472749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_315d7ccc-0f49-4b5d-9a19-12b0099948b5_c8s6u50pdevstack@QuobyteHD" returned: 0 in 0.588s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:37 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-53c4b81c-acce-47cc-8b6c-61db98caf770 tempest-VolumeImageDependencyTests-1780472749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_315d7ccc-0f49-4b5d-9a19-12b0099948b5_c8s6u50pdevstack@QuobyteHD {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:37 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-057a809e-60e6-48b3-ade6-7e92eab044b5 req-9ce2dc64-d66c-4948-8d8d-00d01c7a3d4f tempest-TestShelveInstance-1002688398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:47:37 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-057a809e-60e6-48b3-ade6-7e92eab044b5 req-9ce2dc64-d66c-4948-8d8d-00d01c7a3d4f tempest-TestShelveInstance-1002688398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:47:37 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [req-057a809e-60e6-48b3-ade6-7e92eab044b5 req-9ce2dc64-d66c-4948-8d8d-00d01c7a3d4f tempest-TestShelveInstance-1002688398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:47:37 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [req-057a809e-60e6-48b3-ade6-7e92eab044b5 req-9ce2dc64-d66c-4948-8d8d-00d01c7a3d4f tempest-TestShelveInstance-1002688398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:47:37 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-057a809e-60e6-48b3-ade6-7e92eab044b5 req-9ce2dc64-d66c-4948-8d8d-00d01c7a3d4f tempest-TestShelveInstance-1002688398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:47:37 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [req-057a809e-60e6-48b3-ade6-7e92eab044b5 req-9ce2dc64-d66c-4948-8d8d-00d01c7a3d4f tempest-TestShelveInstance-1002688398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:37 devstack sudo[101892]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:37 devstack sudo[101906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:47:37 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5717d63f-e41b-456e-b120-268e00312b9d tempest-VolumesMetadataTest-758873271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-48385b22-ec6a-41d1-a1f5-1176537514ab" returned: 0 in 0.888s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:37 devstack sudo[101906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:37 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5717d63f-e41b-456e-b120-268e00312b9d tempest-VolumesMetadataTest-758873271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-48385b22-ec6a-41d1-a1f5-1176537514ab {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:37 devstack sudo[101902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_315d7ccc-0f49-4b5d-9a19-12b0099948b5_c8s6u50pdevstack@QuobyteHD Sep 18 21:47:37 devstack sudo[101902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:37 devstack sudo[101909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-48385b22-ec6a-41d1-a1f5-1176537514ab Sep 18 21:47:37 devstack sudo[101909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:38 devstack sudo[101902]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:38 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-53c4b81c-acce-47cc-8b6c-61db98caf770 tempest-VolumeImageDependencyTests-1780472749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_315d7ccc-0f49-4b5d-9a19-12b0099948b5_c8s6u50pdevstack@QuobyteHD" returned: 1 in 0.747s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:38 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-53c4b81c-acce-47cc-8b6c-61db98caf770 tempest-VolumeImageDependencyTests-1780472749 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_315d7ccc-0f49-4b5d-9a19-12b0099948b5_c8s6u50pdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 18 21:47:38 devstack cinder-volume[86136]: DEBUG cinder.image.image_utils [None req-53c4b81c-acce-47cc-8b6c-61db98caf770 tempest-VolumeImageDependencyTests-1780472749 None] 315d7ccc-0f49-4b5d-9a19-12b0099948b5 was raw, converting to qcow2 {{(pid=86136) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 18 21:47:38 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-53c4b81c-acce-47cc-8b6c-61db98caf770 tempest-VolumeImageDependencyTests-1780472749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_315d7ccc-0f49-4b5d-9a19-12b0099948b5_c8s6u50pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-274094ff-417c-4ce4-af42-be7f70e67ef2 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:38 devstack sudo[101916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_315d7ccc-0f49-4b5d-9a19-12b0099948b5_c8s6u50pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-274094ff-417c-4ce4-af42-be7f70e67ef2 Sep 18 21:47:38 devstack sudo[101916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:38 devstack sudo[101906]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:38 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [req-057a809e-60e6-48b3-ade6-7e92eab044b5 req-9ce2dc64-d66c-4948-8d8d-00d01c7a3d4f tempest-TestShelveInstance-1002688398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.720s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:38 devstack cinder-volume[86136]: DEBUG cinder.manager [req-057a809e-60e6-48b3-ade6-7e92eab044b5 req-9ce2dc64-d66c-4948-8d8d-00d01c7a3d4f tempest-TestShelveInstance-1002688398 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:47:38 devstack sudo[101909]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:38 devstack cinder-volume[86136]: INFO cinder.volume.manager [req-057a809e-60e6-48b3-ade6-7e92eab044b5 req-9ce2dc64-d66c-4948-8d8d-00d01c7a3d4f tempest-TestShelveInstance-1002688398 None] Deleted volume successfully. Sep 18 21:47:38 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5717d63f-e41b-456e-b120-268e00312b9d tempest-VolumesMetadataTest-758873271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-48385b22-ec6a-41d1-a1f5-1176537514ab" returned: 0 in 0.668s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:38 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-5717d63f-e41b-456e-b120-268e00312b9d tempest-VolumesMetadataTest-758873271 None] Lock "cinder-quobyte-48385b22-ec6a-41d1-a1f5-1176537514ab" released by "delete_volume" :: held 1.665s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:47:38 devstack cinder-volume[86136]: DEBUG cinder.coordination [req-057a809e-60e6-48b3-ade6-7e92eab044b5 req-9ce2dc64-d66c-4948-8d8d-00d01c7a3d4f tempest-TestShelveInstance-1002688398 None] Lock "cinder-45edcf0b-344c-40f8-bf50-766ce05c30ac-delete_volume" released by "delete_volume" :: held 2.665s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:47:38 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-5717d63f-e41b-456e-b120-268e00312b9d tempest-VolumesMetadataTest-758873271 None] Created reservations ['32120d88-5aae-423a-9660-4ce9d836bb42', '64d5841a-4d9a-4eb3-8bdf-6aaaa0490c5a', '99108e21-c4ff-4cf1-bb05-4a1851fe32c3', 'ddfcc2d2-d794-4655-b3bc-5b33f9bb7d02'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:47:38 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-5717d63f-e41b-456e-b120-268e00312b9d tempest-VolumesMetadataTest-758873271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:47:38 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-5717d63f-e41b-456e-b120-268e00312b9d tempest-VolumesMetadataTest-758873271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:47:38 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-5717d63f-e41b-456e-b120-268e00312b9d tempest-VolumesMetadataTest-758873271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:47:38 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-5717d63f-e41b-456e-b120-268e00312b9d tempest-VolumesMetadataTest-758873271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:47:38 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-5717d63f-e41b-456e-b120-268e00312b9d tempest-VolumesMetadataTest-758873271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:47:38 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5717d63f-e41b-456e-b120-268e00312b9d tempest-VolumesMetadataTest-758873271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:38 devstack sudo[101919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:47:38 devstack sudo[101919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:39 devstack sudo[101919]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:39 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5717d63f-e41b-456e-b120-268e00312b9d tempest-VolumesMetadataTest-758873271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.503s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:39 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-5717d63f-e41b-456e-b120-268e00312b9d tempest-VolumesMetadataTest-758873271 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:47:39 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-5717d63f-e41b-456e-b120-268e00312b9d tempest-VolumesMetadataTest-758873271 None] Deleted volume successfully. Sep 18 21:47:39 devstack sudo[101916]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:39 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-53c4b81c-acce-47cc-8b6c-61db98caf770 tempest-VolumeImageDependencyTests-1780472749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_315d7ccc-0f49-4b5d-9a19-12b0099948b5_c8s6u50pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-274094ff-417c-4ce4-af42-be7f70e67ef2" returned: 0 in 1.024s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:39 devstack cinder-volume[86136]: DEBUG cinder.image.image_utils [None req-53c4b81c-acce-47cc-8b6c-61db98caf770 tempest-VolumeImageDependencyTests-1780472749 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_315d7ccc-0f49-4b5d-9a19-12b0099948b5_c8s6u50pdevstack@QuobyteHD, size 0.00 MB, duration 1.03 sec, destination /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-274094ff-417c-4ce4-af42-be7f70e67ef2 {{(pid=86136) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 18 21:47:39 devstack cinder-volume[86136]: INFO cinder.image.image_utils [None req-53c4b81c-acce-47cc-8b6c-61db98caf770 tempest-VolumeImageDependencyTests-1780472749 None] Converted 0.00 MB image at 0.00 MB/s Sep 18 21:47:39 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-53c4b81c-acce-47cc-8b6c-61db98caf770 tempest-VolumeImageDependencyTests-1780472749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-274094ff-417c-4ce4-af42-be7f70e67ef2 1G {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:39 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-5717d63f-e41b-456e-b120-268e00312b9d tempest-VolumesMetadataTest-758873271 None] Lock "cinder-48385b22-ec6a-41d1-a1f5-1176537514ab-delete_volume" released by "delete_volume" :: held 2.691s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:47:39 devstack sudo[101927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-274094ff-417c-4ce4-af42-be7f70e67ef2 1G Sep 18 21:47:39 devstack sudo[101927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:39 devstack sudo[101927]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:39 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-53c4b81c-acce-47cc-8b6c-61db98caf770 tempest-VolumeImageDependencyTests-1780472749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-274094ff-417c-4ce4-af42-be7f70e67ef2 1G" returned: 0 in 0.573s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:39 devstack cinder-volume[86136]: DEBUG cinder.volume.volume_utils [None req-53c4b81c-acce-47cc-8b6c-61db98caf770 tempest-VolumeImageDependencyTests-1780472749 None] Downloaded image 315d7ccc-0f49-4b5d-9a19-12b0099948b5 ((None, [{'url': 'file:///opt/stack/data/glance/images/315d7ccc-0f49-4b5d-9a19-12b0099948b5', 'metadata': {}}])) to volume 274094ff-417c-4ce4-af42-be7f70e67ef2 successfully. {{(pid=86136) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 18 21:47:39 devstack cinder-volume[86136]: DEBUG cinder.image.image_utils [None req-53c4b81c-acce-47cc-8b6c-61db98caf770 tempest-VolumeImageDependencyTests-1780472749 None] Temporary image 315d7ccc-0f49-4b5d-9a19-12b0099948b5 for user d34a77dc73354823978680b2e9a01ef5 is deleted. {{(pid=86136) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 18 21:47:39 devstack cinder-volume[86136]: DEBUG cinder.volume.volume_utils [None req-53c4b81c-acce-47cc-8b6c-61db98caf770 tempest-VolumeImageDependencyTests-1780472749 None] Marking volume 274094ff-417c-4ce4-af42-be7f70e67ef2 as bootable. {{(pid=86136) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 18 21:47:39 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-53c4b81c-acce-47cc-8b6c-61db98caf770 tempest-VolumeImageDependencyTests-1780472749 None] Copying metadata from image 315d7ccc-0f49-4b5d-9a19-12b0099948b5 to 274094ff-417c-4ce4-af42-be7f70e67ef2. {{(pid=86136) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 18 21:47:39 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-53c4b81c-acce-47cc-8b6c-61db98caf770 tempest-VolumeImageDependencyTests-1780472749 None] Creating volume glance metadata for volume 274094ff-417c-4ce4-af42-be7f70e67ef2 backed by image 315d7ccc-0f49-4b5d-9a19-12b0099948b5 with: {'image_id': '315d7ccc-0f49-4b5d-9a19-12b0099948b5', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'f5653219f98b6c777481771c89344d7c', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86136) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 18 21:47:40 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-53c4b81c-acce-47cc-8b6c-61db98caf770 tempest-VolumeImageDependencyTests-1780472749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (281778d5-fca8-4261-9fb7-23667930d18d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-274094ff-417c-4ce4-af42-be7f70e67ef2', 'volume_size': 1, 'image_id': '315d7ccc-0f49-4b5d-9a19-12b0099948b5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/315d7ccc-0f49-4b5d-9a19-12b0099948b5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f5653219f98b6c777481771c89344d7c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2748a43f67f24b34afc17280f00ca39a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fbb7ec2b0b6cf96572f5ef256dce072c2adbc56a2a1989be2a81d93d137ed4818b628a51eeeedad3ac839412a18aec394916854f73eac0b4cb9e04b85a03ff14', 'id': '315d7ccc-0f49-4b5d-9a19-12b0099948b5', 'created_at': datetime.datetime(2026, 9, 18, 19, 47, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 18, 19, 47, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/315d7ccc-0f49-4b5d-9a19-12b0099948b5/file', 'properties': {}}, 'image_service': }' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:47:40 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-53c4b81c-acce-47cc-8b6c-61db98caf770 tempest-VolumeImageDependencyTests-1780472749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcccc258-f491-47d6-b41f-3da10d2fa0bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:47:40 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-53c4b81c-acce-47cc-8b6c-61db98caf770 tempest-VolumeImageDependencyTests-1780472749 None] Volume volume-274094ff-417c-4ce4-af42-be7f70e67ef2 (274094ff-417c-4ce4-af42-be7f70e67ef2): created successfully Sep 18 21:47:40 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-53c4b81c-acce-47cc-8b6c-61db98caf770 tempest-VolumeImageDependencyTests-1780472749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcccc258-f491-47d6-b41f-3da10d2fa0bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:47:40 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-53c4b81c-acce-47cc-8b6c-61db98caf770 tempest-VolumeImageDependencyTests-1780472749 None] Flow 'volume_create_manager' (13ba11b3-3572-415f-af25-ce6986e4c9b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:47:40 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-53c4b81c-acce-47cc-8b6c-61db98caf770 tempest-VolumeImageDependencyTests-1780472749 None] Created volume successfully. Sep 18 21:47:41 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-3b843e5a-0a73-4508-89f9-56750f9d2297 tempest-VolumeImageDependencyTests-1780472749 None] Acquiring lock "cinder-274094ff-417c-4ce4-af42-be7f70e67ef2-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:47:41 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-3b843e5a-0a73-4508-89f9-56750f9d2297 tempest-VolumeImageDependencyTests-1780472749 None] Lock "cinder-274094ff-417c-4ce4-af42-be7f70e67ef2-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:47:41 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-3b843e5a-0a73-4508-89f9-56750f9d2297 tempest-VolumeImageDependencyTests-1780472749 None] Acquiring lock "cinder-quobyte-274094ff-417c-4ce4-af42-be7f70e67ef2" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:47:41 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-3b843e5a-0a73-4508-89f9-56750f9d2297 tempest-VolumeImageDependencyTests-1780472749 None] Lock "cinder-quobyte-274094ff-417c-4ce4-af42-be7f70e67ef2" acquired by "delete_volume" :: waited 0.015s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:47:41 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c8f5db-ffa3-413b-8b35-163d19f6e793]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:47:41 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3b843e5a-0a73-4508-89f9-56750f9d2297 tempest-VolumeImageDependencyTests-1780472749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-274094ff-417c-4ce4-af42-be7f70e67ef2 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:41 devstack sudo[101934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-274094ff-417c-4ce4-af42-be7f70e67ef2 Sep 18 21:47:41 devstack sudo[101934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:42 devstack sudo[101934]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:42 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3b843e5a-0a73-4508-89f9-56750f9d2297 tempest-VolumeImageDependencyTests-1780472749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-274094ff-417c-4ce4-af42-be7f70e67ef2" returned: 0 in 0.501s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:42 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3b843e5a-0a73-4508-89f9-56750f9d2297 tempest-VolumeImageDependencyTests-1780472749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-274094ff-417c-4ce4-af42-be7f70e67ef2 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:42 devstack sudo[101939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-274094ff-417c-4ce4-af42-be7f70e67ef2 Sep 18 21:47:42 devstack sudo[101939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:42 devstack sudo[101939]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:42 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3b843e5a-0a73-4508-89f9-56750f9d2297 tempest-VolumeImageDependencyTests-1780472749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-274094ff-417c-4ce4-af42-be7f70e67ef2" returned: 0 in 0.338s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:42 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-3b843e5a-0a73-4508-89f9-56750f9d2297 tempest-VolumeImageDependencyTests-1780472749 None] Lock "cinder-quobyte-274094ff-417c-4ce4-af42-be7f70e67ef2" released by "delete_volume" :: held 0.900s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:47:42 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-3b843e5a-0a73-4508-89f9-56750f9d2297 tempest-VolumeImageDependencyTests-1780472749 None] Created reservations ['140cd792-9e12-43a3-bde0-940cf8544fd8', '6123b015-83ef-409b-9b87-fb8c452d7fbd', '4bd56c48-e795-44ae-877f-1718e5abcf4a', '38859673-6324-475c-86d2-24bfd88ca143'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:47:42 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-3b843e5a-0a73-4508-89f9-56750f9d2297 tempest-VolumeImageDependencyTests-1780472749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:47:42 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-3b843e5a-0a73-4508-89f9-56750f9d2297 tempest-VolumeImageDependencyTests-1780472749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:47:42 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-3b843e5a-0a73-4508-89f9-56750f9d2297 tempest-VolumeImageDependencyTests-1780472749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:47:42 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-3b843e5a-0a73-4508-89f9-56750f9d2297 tempest-VolumeImageDependencyTests-1780472749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:47:42 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-3b843e5a-0a73-4508-89f9-56750f9d2297 tempest-VolumeImageDependencyTests-1780472749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:47:42 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3b843e5a-0a73-4508-89f9-56750f9d2297 tempest-VolumeImageDependencyTests-1780472749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:42 devstack sudo[101942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:47:42 devstack sudo[101942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:42 devstack sudo[101942]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:42 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3b843e5a-0a73-4508-89f9-56750f9d2297 tempest-VolumeImageDependencyTests-1780472749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.357s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:42 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-3b843e5a-0a73-4508-89f9-56750f9d2297 tempest-VolumeImageDependencyTests-1780472749 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:47:42 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-3b843e5a-0a73-4508-89f9-56750f9d2297 tempest-VolumeImageDependencyTests-1780472749 None] Deleted volume successfully. Sep 18 21:47:43 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-3b843e5a-0a73-4508-89f9-56750f9d2297 tempest-VolumeImageDependencyTests-1780472749 None] Lock "cinder-274094ff-417c-4ce4-af42-be7f70e67ef2-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:47:45 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-83294b6e-58ad-41fb-a22c-9f81e77ede22 tempest-VolumesTransfersTest-79578969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:47:45 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-83294b6e-58ad-41fb-a22c-9f81e77ede22 tempest-VolumesTransfersTest-79578969 None] Flow 'volume_create_manager' (a3ba7900-5d8e-4c24-91af-394d63eda83c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:47:45 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-83294b6e-58ad-41fb-a22c-9f81e77ede22 tempest-VolumesTransfersTest-79578969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8c2df0d-6702-4236-8b18-8ff8b753e2e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:47:45 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-83294b6e-58ad-41fb-a22c-9f81e77ede22 tempest-VolumesTransfersTest-79578969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8c2df0d-6702-4236-8b18-8ff8b753e2e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:47:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1777671700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da8fa09a-680d-4d49-8901-63f7d83e1891,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='873b84477bef4ddc8920366c7a04d26d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:47:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:47:46Z,use_quota=True,user_id='d59aaa0129b848f3ba612aa30afd398e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:47:45 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-83294b6e-58ad-41fb-a22c-9f81e77ede22 tempest-VolumesTransfersTest-79578969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3afedfda-5a39-49f3-b4ad-18c1546f5b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:47:45 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-83294b6e-58ad-41fb-a22c-9f81e77ede22 tempest-VolumesTransfersTest-79578969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3afedfda-5a39-49f3-b4ad-18c1546f5b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:47:45 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-83294b6e-58ad-41fb-a22c-9f81e77ede22 tempest-VolumesTransfersTest-79578969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ba41550-c58a-43de-82e5-625589c1e31e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:47:45 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-83294b6e-58ad-41fb-a22c-9f81e77ede22 tempest-VolumesTransfersTest-79578969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ba41550-c58a-43de-82e5-625589c1e31e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da8fa09a-680d-4d49-8901-63f7d83e1891', 'volume_name': 'volume-da8fa09a-680d-4d49-8901-63f7d83e1891', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:47:45 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-83294b6e-58ad-41fb-a22c-9f81e77ede22 tempest-VolumesTransfersTest-79578969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a05e18fd-fe1d-45bd-b332-4cf8be4d0a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:47:45 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-83294b6e-58ad-41fb-a22c-9f81e77ede22 tempest-VolumesTransfersTest-79578969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a05e18fd-fe1d-45bd-b332-4cf8be4d0a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:47:46 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-83294b6e-58ad-41fb-a22c-9f81e77ede22 tempest-VolumesTransfersTest-79578969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c37bfd3f-25ab-489a-aebe-3d418029df1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:47:46 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-83294b6e-58ad-41fb-a22c-9f81e77ede22 tempest-VolumesTransfersTest-79578969 None] Volume da8fa09a-680d-4d49-8901-63f7d83e1891: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da8fa09a-680d-4d49-8901-63f7d83e1891', 'volume_size': 1} Sep 18 21:47:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-83294b6e-58ad-41fb-a22c-9f81e77ede22 tempest-VolumesTransfersTest-79578969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:47:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-83294b6e-58ad-41fb-a22c-9f81e77ede22 tempest-VolumesTransfersTest-79578969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:47:46 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-83294b6e-58ad-41fb-a22c-9f81e77ede22 tempest-VolumesTransfersTest-79578969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:47:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1777671700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da8fa09a-680d-4d49-8901-63f7d83e1891,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='873b84477bef4ddc8920366c7a04d26d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:47:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:47:46Z,use_quota=True,user_id='d59aaa0129b848f3ba612aa30afd398e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:47:46 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-83294b6e-58ad-41fb-a22c-9f81e77ede22 tempest-VolumesTransfersTest-79578969 None] Creating volume da8fa09a-680d-4d49-8901-63f7d83e1891 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:47:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-83294b6e-58ad-41fb-a22c-9f81e77ede22 tempest-VolumesTransfersTest-79578969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:47:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-83294b6e-58ad-41fb-a22c-9f81e77ede22 tempest-VolumesTransfersTest-79578969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:47:46 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-83294b6e-58ad-41fb-a22c-9f81e77ede22 tempest-VolumesTransfersTest-79578969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:47:46 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-83294b6e-58ad-41fb-a22c-9f81e77ede22 tempest-VolumesTransfersTest-79578969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:47:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-83294b6e-58ad-41fb-a22c-9f81e77ede22 tempest-VolumesTransfersTest-79578969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:47:46 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-83294b6e-58ad-41fb-a22c-9f81e77ede22 tempest-VolumesTransfersTest-79578969 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:47:46 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-83294b6e-58ad-41fb-a22c-9f81e77ede22 tempest-VolumesTransfersTest-79578969 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:47:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-83294b6e-58ad-41fb-a22c-9f81e77ede22 tempest-VolumesTransfersTest-79578969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-da8fa09a-680d-4d49-8901-63f7d83e1891 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:46 devstack sudo[101954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-da8fa09a-680d-4d49-8901-63f7d83e1891 1073741824 Sep 18 21:47:46 devstack sudo[101954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:46 devstack sudo[101954]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-83294b6e-58ad-41fb-a22c-9f81e77ede22 tempest-VolumesTransfersTest-79578969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-da8fa09a-680d-4d49-8901-63f7d83e1891 1073741824" returned: 0 in 0.465s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-83294b6e-58ad-41fb-a22c-9f81e77ede22 tempest-VolumesTransfersTest-79578969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-da8fa09a-680d-4d49-8901-63f7d83e1891 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:46 devstack sudo[101961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-da8fa09a-680d-4d49-8901-63f7d83e1891 Sep 18 21:47:46 devstack sudo[101961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:46 devstack sudo[101961]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-83294b6e-58ad-41fb-a22c-9f81e77ede22 tempest-VolumesTransfersTest-79578969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-da8fa09a-680d-4d49-8901-63f7d83e1891" returned: 0 in 0.246s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:46 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-83294b6e-58ad-41fb-a22c-9f81e77ede22 tempest-VolumesTransfersTest-79578969 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:47:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-83294b6e-58ad-41fb-a22c-9f81e77ede22 tempest-VolumesTransfersTest-79578969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:47:46 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-83294b6e-58ad-41fb-a22c-9f81e77ede22 tempest-VolumesTransfersTest-79578969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c37bfd3f-25ab-489a-aebe-3d418029df1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da8fa09a-680d-4d49-8901-63f7d83e1891', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:47:46 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-83294b6e-58ad-41fb-a22c-9f81e77ede22 tempest-VolumesTransfersTest-79578969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3bd763c-d9b7-4e03-b01d-a62f6608bdde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:47:46 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-83294b6e-58ad-41fb-a22c-9f81e77ede22 tempest-VolumesTransfersTest-79578969 None] Volume volume-da8fa09a-680d-4d49-8901-63f7d83e1891 (da8fa09a-680d-4d49-8901-63f7d83e1891): created successfully Sep 18 21:47:46 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-83294b6e-58ad-41fb-a22c-9f81e77ede22 tempest-VolumesTransfersTest-79578969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3bd763c-d9b7-4e03-b01d-a62f6608bdde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:47:46 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-83294b6e-58ad-41fb-a22c-9f81e77ede22 tempest-VolumesTransfersTest-79578969 None] Flow 'volume_create_manager' (a3ba7900-5d8e-4c24-91af-394d63eda83c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:47:46 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-83294b6e-58ad-41fb-a22c-9f81e77ede22 tempest-VolumesTransfersTest-79578969 None] Created volume successfully. Sep 18 21:47:47 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-e90b1c2d-6e57-4796-900d-f5809fe4d636 tempest-VolumesTransfersTest-1083076838 None] Transfer volume completed successfully. Sep 18 21:47:48 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-1fd8697c-9a62-46be-bf14-78212644c6e4 tempest-VolumesTransfersTest-1475270935 None] Acquiring lock "cinder-da8fa09a-680d-4d49-8901-63f7d83e1891-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:47:48 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-1fd8697c-9a62-46be-bf14-78212644c6e4 tempest-VolumesTransfersTest-1475270935 None] Lock "cinder-da8fa09a-680d-4d49-8901-63f7d83e1891-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:47:48 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-1fd8697c-9a62-46be-bf14-78212644c6e4 tempest-VolumesTransfersTest-1475270935 None] Acquiring lock "cinder-quobyte-da8fa09a-680d-4d49-8901-63f7d83e1891" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:47:48 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-1fd8697c-9a62-46be-bf14-78212644c6e4 tempest-VolumesTransfersTest-1475270935 None] Lock "cinder-quobyte-da8fa09a-680d-4d49-8901-63f7d83e1891" acquired by "delete_volume" :: waited 0.020s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:47:48 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8614fc8-7431-4d9a-bfb8-2176c0648c87]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:47:48 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1fd8697c-9a62-46be-bf14-78212644c6e4 tempest-VolumesTransfersTest-1475270935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-da8fa09a-680d-4d49-8901-63f7d83e1891 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:48 devstack sudo[101965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-da8fa09a-680d-4d49-8901-63f7d83e1891 Sep 18 21:47:48 devstack sudo[101965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:48 devstack sudo[101965]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:48 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1fd8697c-9a62-46be-bf14-78212644c6e4 tempest-VolumesTransfersTest-1475270935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-da8fa09a-680d-4d49-8901-63f7d83e1891" returned: 0 in 0.424s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:48 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1fd8697c-9a62-46be-bf14-78212644c6e4 tempest-VolumesTransfersTest-1475270935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-da8fa09a-680d-4d49-8901-63f7d83e1891 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:48 devstack sudo[101972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-da8fa09a-680d-4d49-8901-63f7d83e1891 Sep 18 21:47:48 devstack sudo[101972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:48 devstack sudo[101972]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:48 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1fd8697c-9a62-46be-bf14-78212644c6e4 tempest-VolumesTransfersTest-1475270935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-da8fa09a-680d-4d49-8901-63f7d83e1891" returned: 0 in 0.254s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:48 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-1fd8697c-9a62-46be-bf14-78212644c6e4 tempest-VolumesTransfersTest-1475270935 None] Lock "cinder-quobyte-da8fa09a-680d-4d49-8901-63f7d83e1891" released by "delete_volume" :: held 0.754s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:47:49 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-1fd8697c-9a62-46be-bf14-78212644c6e4 tempest-VolumesTransfersTest-1475270935 None] Created reservations ['6de490a3-36b9-4d4a-b389-eabd0a673a43', '0dbad06b-d2e2-47be-a1c5-c03b0b380dd8', '1ecdf548-3511-4acf-acbd-d1c31a5d15c3', '840aa117-5c90-4701-bfb7-580e619ad5ef'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:47:49 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-1fd8697c-9a62-46be-bf14-78212644c6e4 tempest-VolumesTransfersTest-1475270935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:47:49 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-1fd8697c-9a62-46be-bf14-78212644c6e4 tempest-VolumesTransfersTest-1475270935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:47:49 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-1fd8697c-9a62-46be-bf14-78212644c6e4 tempest-VolumesTransfersTest-1475270935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:47:49 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-1fd8697c-9a62-46be-bf14-78212644c6e4 tempest-VolumesTransfersTest-1475270935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:47:49 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-1fd8697c-9a62-46be-bf14-78212644c6e4 tempest-VolumesTransfersTest-1475270935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:47:49 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1fd8697c-9a62-46be-bf14-78212644c6e4 tempest-VolumesTransfersTest-1475270935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:49 devstack sudo[101976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:47:49 devstack sudo[101976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:49 devstack sudo[101976]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:49 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1fd8697c-9a62-46be-bf14-78212644c6e4 tempest-VolumesTransfersTest-1475270935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.300s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:49 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-1fd8697c-9a62-46be-bf14-78212644c6e4 tempest-VolumesTransfersTest-1475270935 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:47:49 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-1fd8697c-9a62-46be-bf14-78212644c6e4 tempest-VolumesTransfersTest-1475270935 None] Deleted volume successfully. Sep 18 21:47:49 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-1fd8697c-9a62-46be-bf14-78212644c6e4 tempest-VolumesTransfersTest-1475270935 None] Lock "cinder-da8fa09a-680d-4d49-8901-63f7d83e1891-delete_volume" released by "delete_volume" :: held 1.314s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:47:49 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-8902fd98-2b56-4299-812a-be883bc042e8 tempest-VolumesTransfersTest-79578969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:47:49 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-8902fd98-2b56-4299-812a-be883bc042e8 tempest-VolumesTransfersTest-79578969 None] Flow 'volume_create_manager' (720cd27f-8dfe-48fc-99c8-56e6ceaee8cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:47:49 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-8902fd98-2b56-4299-812a-be883bc042e8 tempest-VolumesTransfersTest-79578969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b7bf756-e6ae-4533-b59f-a196c2b94dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:47:49 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-8902fd98-2b56-4299-812a-be883bc042e8 tempest-VolumesTransfersTest-79578969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b7bf756-e6ae-4533-b59f-a196c2b94dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:47:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-957430323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40dbc096-8ab7-432c-9938-80f9bdc2a018,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='873b84477bef4ddc8920366c7a04d26d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:47:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:47:50Z,use_quota=True,user_id='d59aaa0129b848f3ba612aa30afd398e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:47:49 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-8902fd98-2b56-4299-812a-be883bc042e8 tempest-VolumesTransfersTest-79578969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebc3f1c0-eb4c-45c7-8ac3-2e50da9eedf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:47:49 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-8902fd98-2b56-4299-812a-be883bc042e8 tempest-VolumesTransfersTest-79578969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebc3f1c0-eb4c-45c7-8ac3-2e50da9eedf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:47:49 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-8902fd98-2b56-4299-812a-be883bc042e8 tempest-VolumesTransfersTest-79578969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01ef8643-e9e8-4d71-9c62-3b9df27d0e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:47:49 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-8902fd98-2b56-4299-812a-be883bc042e8 tempest-VolumesTransfersTest-79578969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01ef8643-e9e8-4d71-9c62-3b9df27d0e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40dbc096-8ab7-432c-9938-80f9bdc2a018', 'volume_name': 'volume-40dbc096-8ab7-432c-9938-80f9bdc2a018', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:47:49 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-8902fd98-2b56-4299-812a-be883bc042e8 tempest-VolumesTransfersTest-79578969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4c1cf5c-387d-4a87-9f1e-1a6bc8d10338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:47:49 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-8902fd98-2b56-4299-812a-be883bc042e8 tempest-VolumesTransfersTest-79578969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4c1cf5c-387d-4a87-9f1e-1a6bc8d10338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:47:49 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-8902fd98-2b56-4299-812a-be883bc042e8 tempest-VolumesTransfersTest-79578969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75aab402-950a-45e5-8e1c-9e7cf486ceb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:47:49 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-8902fd98-2b56-4299-812a-be883bc042e8 tempest-VolumesTransfersTest-79578969 None] Volume 40dbc096-8ab7-432c-9938-80f9bdc2a018: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40dbc096-8ab7-432c-9938-80f9bdc2a018', 'volume_size': 1} Sep 18 21:47:49 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-8902fd98-2b56-4299-812a-be883bc042e8 tempest-VolumesTransfersTest-79578969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:47:49 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-8902fd98-2b56-4299-812a-be883bc042e8 tempest-VolumesTransfersTest-79578969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:47:49 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-8902fd98-2b56-4299-812a-be883bc042e8 tempest-VolumesTransfersTest-79578969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:47:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-957430323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40dbc096-8ab7-432c-9938-80f9bdc2a018,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='873b84477bef4ddc8920366c7a04d26d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:47:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:47:50Z,use_quota=True,user_id='d59aaa0129b848f3ba612aa30afd398e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:47:49 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-8902fd98-2b56-4299-812a-be883bc042e8 tempest-VolumesTransfersTest-79578969 None] Creating volume 40dbc096-8ab7-432c-9938-80f9bdc2a018 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:47:49 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-8902fd98-2b56-4299-812a-be883bc042e8 tempest-VolumesTransfersTest-79578969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:47:49 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-8902fd98-2b56-4299-812a-be883bc042e8 tempest-VolumesTransfersTest-79578969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:47:49 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-8902fd98-2b56-4299-812a-be883bc042e8 tempest-VolumesTransfersTest-79578969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:47:49 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-8902fd98-2b56-4299-812a-be883bc042e8 tempest-VolumesTransfersTest-79578969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:47:49 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-8902fd98-2b56-4299-812a-be883bc042e8 tempest-VolumesTransfersTest-79578969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:47:49 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-8902fd98-2b56-4299-812a-be883bc042e8 tempest-VolumesTransfersTest-79578969 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:47:49 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-8902fd98-2b56-4299-812a-be883bc042e8 tempest-VolumesTransfersTest-79578969 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:47:49 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-8902fd98-2b56-4299-812a-be883bc042e8 tempest-VolumesTransfersTest-79578969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-40dbc096-8ab7-432c-9938-80f9bdc2a018 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:49 devstack sudo[101981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-40dbc096-8ab7-432c-9938-80f9bdc2a018 1073741824 Sep 18 21:47:49 devstack sudo[101981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:50 devstack sudo[101981]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:50 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-8902fd98-2b56-4299-812a-be883bc042e8 tempest-VolumesTransfersTest-79578969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-40dbc096-8ab7-432c-9938-80f9bdc2a018 1073741824" returned: 0 in 0.486s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:50 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-8902fd98-2b56-4299-812a-be883bc042e8 tempest-VolumesTransfersTest-79578969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-40dbc096-8ab7-432c-9938-80f9bdc2a018 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:50 devstack sudo[101987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-40dbc096-8ab7-432c-9938-80f9bdc2a018 Sep 18 21:47:50 devstack sudo[101987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:50 devstack sudo[101987]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:50 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-8902fd98-2b56-4299-812a-be883bc042e8 tempest-VolumesTransfersTest-79578969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-40dbc096-8ab7-432c-9938-80f9bdc2a018" returned: 0 in 0.269s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:50 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-8902fd98-2b56-4299-812a-be883bc042e8 tempest-VolumesTransfersTest-79578969 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:47:50 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-8902fd98-2b56-4299-812a-be883bc042e8 tempest-VolumesTransfersTest-79578969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:47:50 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-8902fd98-2b56-4299-812a-be883bc042e8 tempest-VolumesTransfersTest-79578969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75aab402-950a-45e5-8e1c-9e7cf486ceb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40dbc096-8ab7-432c-9938-80f9bdc2a018', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:47:50 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-8902fd98-2b56-4299-812a-be883bc042e8 tempest-VolumesTransfersTest-79578969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c6b6cb0-49e9-49e6-a7c7-52d034290191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:47:50 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-8902fd98-2b56-4299-812a-be883bc042e8 tempest-VolumesTransfersTest-79578969 None] Volume volume-40dbc096-8ab7-432c-9938-80f9bdc2a018 (40dbc096-8ab7-432c-9938-80f9bdc2a018): created successfully Sep 18 21:47:50 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-8902fd98-2b56-4299-812a-be883bc042e8 tempest-VolumesTransfersTest-79578969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c6b6cb0-49e9-49e6-a7c7-52d034290191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:47:50 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-8902fd98-2b56-4299-812a-be883bc042e8 tempest-VolumesTransfersTest-79578969 None] Flow 'volume_create_manager' (720cd27f-8dfe-48fc-99c8-56e6ceaee8cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:47:50 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-8902fd98-2b56-4299-812a-be883bc042e8 tempest-VolumesTransfersTest-79578969 None] Created volume successfully. Sep 18 21:47:52 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-95603345-2382-4234-abb2-8f171f4a4152 tempest-VolumesTransfersTest-1475270935 None] Acquiring lock "cinder-40dbc096-8ab7-432c-9938-80f9bdc2a018-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:47:52 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-95603345-2382-4234-abb2-8f171f4a4152 tempest-VolumesTransfersTest-1475270935 None] Lock "cinder-40dbc096-8ab7-432c-9938-80f9bdc2a018-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:47:52 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-95603345-2382-4234-abb2-8f171f4a4152 tempest-VolumesTransfersTest-1475270935 None] Acquiring lock "cinder-quobyte-40dbc096-8ab7-432c-9938-80f9bdc2a018" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:47:52 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-95603345-2382-4234-abb2-8f171f4a4152 tempest-VolumesTransfersTest-1475270935 None] Lock "cinder-quobyte-40dbc096-8ab7-432c-9938-80f9bdc2a018" acquired by "delete_volume" :: waited 0.016s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:47:52 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[defa3bea-2f4e-49f5-8e29-cb0e58ee8449]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:47:52 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-95603345-2382-4234-abb2-8f171f4a4152 tempest-VolumesTransfersTest-1475270935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-40dbc096-8ab7-432c-9938-80f9bdc2a018 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:52 devstack sudo[101991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-40dbc096-8ab7-432c-9938-80f9bdc2a018 Sep 18 21:47:52 devstack sudo[101991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:52 devstack sudo[101991]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:52 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-95603345-2382-4234-abb2-8f171f4a4152 tempest-VolumesTransfersTest-1475270935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-40dbc096-8ab7-432c-9938-80f9bdc2a018" returned: 0 in 0.396s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:52 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-95603345-2382-4234-abb2-8f171f4a4152 tempest-VolumesTransfersTest-1475270935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-40dbc096-8ab7-432c-9938-80f9bdc2a018 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:52 devstack sudo[101996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-40dbc096-8ab7-432c-9938-80f9bdc2a018 Sep 18 21:47:52 devstack sudo[101996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:52 devstack sudo[101996]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:52 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-95603345-2382-4234-abb2-8f171f4a4152 tempest-VolumesTransfersTest-1475270935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-40dbc096-8ab7-432c-9938-80f9bdc2a018" returned: 0 in 0.248s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:53 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-95603345-2382-4234-abb2-8f171f4a4152 tempest-VolumesTransfersTest-1475270935 None] Lock "cinder-quobyte-40dbc096-8ab7-432c-9938-80f9bdc2a018" released by "delete_volume" :: held 0.697s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:47:53 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-95603345-2382-4234-abb2-8f171f4a4152 tempest-VolumesTransfersTest-1475270935 None] Created reservations ['3f377c0a-10a1-4320-a9fc-d2804b13a7df', '93106a98-b148-45fb-b353-fb2f1ea13431', 'dede4b37-af0f-4cf0-b8e0-8def031b8b43', '247b4c49-eedd-4253-bc26-7d4e154a9aad'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:47:53 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-95603345-2382-4234-abb2-8f171f4a4152 tempest-VolumesTransfersTest-1475270935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:47:53 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-95603345-2382-4234-abb2-8f171f4a4152 tempest-VolumesTransfersTest-1475270935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:47:53 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-95603345-2382-4234-abb2-8f171f4a4152 tempest-VolumesTransfersTest-1475270935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:47:53 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-95603345-2382-4234-abb2-8f171f4a4152 tempest-VolumesTransfersTest-1475270935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:47:53 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-95603345-2382-4234-abb2-8f171f4a4152 tempest-VolumesTransfersTest-1475270935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:47:53 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-95603345-2382-4234-abb2-8f171f4a4152 tempest-VolumesTransfersTest-1475270935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:53 devstack sudo[101999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:47:53 devstack sudo[101999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:53 devstack sudo[101999]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:53 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-95603345-2382-4234-abb2-8f171f4a4152 tempest-VolumesTransfersTest-1475270935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.248s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:53 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-95603345-2382-4234-abb2-8f171f4a4152 tempest-VolumesTransfersTest-1475270935 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:47:53 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-95603345-2382-4234-abb2-8f171f4a4152 tempest-VolumesTransfersTest-1475270935 None] Deleted volume successfully. Sep 18 21:47:53 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-95603345-2382-4234-abb2-8f171f4a4152 tempest-VolumesTransfersTest-1475270935 None] Lock "cinder-40dbc096-8ab7-432c-9938-80f9bdc2a018-delete_volume" released by "delete_volume" :: held 1.149s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:47:56 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-16fd2a5b-d54a-4e76-bc7f-4cace9549679 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:47:56 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-16fd2a5b-d54a-4e76-bc7f-4cace9549679 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] Flow 'volume_create_manager' (26ffc80c-7328-4e89-b93b-37ac3925ac98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:47:56 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-16fd2a5b-d54a-4e76-bc7f-4cace9549679 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01794e92-79e8-48f9-b52b-7624c0539681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:47:56 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-16fd2a5b-d54a-4e76-bc7f-4cace9549679 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01794e92-79e8-48f9-b52b-7624c0539681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:47:56Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b9da8c1-b82a-4780-bd6c-7c11b6163276,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc52ee31619a4ea4ad037aab8af2660c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:47:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:47:57Z,use_quota=True,user_id='28d32266c1da428fb0f3fbe00dc74dbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef573ecb-296b-49a0-bf35-084df4e00ed5),volume_type_id=ef573ecb-296b-49a0-bf35-084df4e00ed5)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:47:56 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-16fd2a5b-d54a-4e76-bc7f-4cace9549679 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36a914ac-78e0-4995-b372-9b303864c3ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:47:56 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-16fd2a5b-d54a-4e76-bc7f-4cace9549679 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36a914ac-78e0-4995-b372-9b303864c3ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:47:56 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-16fd2a5b-d54a-4e76-bc7f-4cace9549679 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a2e6e98-06fa-4494-8ce3-8e82a76da026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:47:56 devstack cinder-volume[86136]: DEBUG cinder.image.glance [None req-16fd2a5b-d54a-4e76-bc7f-4cace9549679 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] Creating Keystone auth plugin from conf {{(pid=86136) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 18 21:47:57 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-16fd2a5b-d54a-4e76-bc7f-4cace9549679 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a2e6e98-06fa-4494-8ce3-8e82a76da026) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8b9da8c1-b82a-4780-bd6c-7c11b6163276', 'volume_name': 'volume-8b9da8c1-b82a-4780-bd6c-7c11b6163276', 'volume_size': 1, 'image_id': '32800a64-c187-4c60-a7c2-ab0e8e8d8cab', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/32800a64-c187-4c60-a7c2-ab0e8e8d8cab', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a91204a3f3653fe4bd48fe4a8c4d68fc', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fc52ee31619a4ea4ad037aab8af2660c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c176ae0676e2663b3ac0a71ee5d7d86f1ebe5bb2fffd4f3a1fb603509c319bef8e7036c53aa2cc972a143530794eeab6a5b19a762af26258915f89608b0b1811', 'id': '32800a64-c187-4c60-a7c2-ab0e8e8d8cab', 'created_at': datetime.datetime(2026, 9, 18, 19, 47, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 18, 19, 47, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/32800a64-c187-4c60-a7c2-ab0e8e8d8cab/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:47:57 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-16fd2a5b-d54a-4e76-bc7f-4cace9549679 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24ae6353-e017-49c8-8210-089620cb20a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:47:57 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-16fd2a5b-d54a-4e76-bc7f-4cace9549679 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24ae6353-e017-49c8-8210-089620cb20a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:47:57 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-16fd2a5b-d54a-4e76-bc7f-4cace9549679 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9012f79f-314a-49b2-a190-7f3457ff092d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:47:57 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-16fd2a5b-d54a-4e76-bc7f-4cace9549679 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] Volume 8b9da8c1-b82a-4780-bd6c-7c11b6163276: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8b9da8c1-b82a-4780-bd6c-7c11b6163276', 'volume_size': 1, 'image_id': '32800a64-c187-4c60-a7c2-ab0e8e8d8cab', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/32800a64-c187-4c60-a7c2-ab0e8e8d8cab', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a91204a3f3653fe4bd48fe4a8c4d68fc', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fc52ee31619a4ea4ad037aab8af2660c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c176ae0676e2663b3ac0a71ee5d7d86f1ebe5bb2fffd4f3a1fb603509c319bef8e7036c53aa2cc972a143530794eeab6a5b19a762af26258915f89608b0b1811', 'id': '32800a64-c187-4c60-a7c2-ab0e8e8d8cab', 'created_at': datetime.datetime(2026, 9, 18, 19, 47, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 18, 19, 47, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/32800a64-c187-4c60-a7c2-ab0e8e8d8cab/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 18 21:47:57 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-16fd2a5b-d54a-4e76-bc7f-4cace9549679 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] Trying to clone 8b9da8c1-b82a-4780-bd6c-7c11b6163276 from image 32800a64-c187-4c60-a7c2-ab0e8e8d8cab at location (None, [{'url': 'file:///opt/stack/data/glance/images/32800a64-c187-4c60-a7c2-ab0e8e8d8cab', 'metadata': {}}]). {{(pid=86136) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 18 21:47:57 devstack cinder-volume[86136]: DEBUG cinder.image.image_utils [None req-16fd2a5b-d54a-4e76-bc7f-4cace9549679 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_32800a64-c187-4c60-a7c2-ab0e8e8d8cab_h5jyf49wdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86136) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 18 21:47:57 devstack cinder-volume[86136]: INFO cinder.image.image_utils [None req-16fd2a5b-d54a-4e76-bc7f-4cace9549679 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] Image download 0.00 MB at 0.00 MB/s Sep 18 21:47:57 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[68333699-7fa5-48b3-a425-45e20430c043]: (4, 'raw') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:47:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-16fd2a5b-d54a-4e76-bc7f-4cace9549679 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_32800a64-c187-4c60-a7c2-ab0e8e8d8cab_h5jyf49wdevstack@QuobyteHD {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:57 devstack sudo[102002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_32800a64-c187-4c60-a7c2-ab0e8e8d8cab_h5jyf49wdevstack@QuobyteHD Sep 18 21:47:57 devstack sudo[102002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:57 devstack sudo[102002]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-16fd2a5b-d54a-4e76-bc7f-4cace9549679 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_32800a64-c187-4c60-a7c2-ab0e8e8d8cab_h5jyf49wdevstack@QuobyteHD" returned: 0 in 0.357s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-16fd2a5b-d54a-4e76-bc7f-4cace9549679 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_32800a64-c187-4c60-a7c2-ab0e8e8d8cab_h5jyf49wdevstack@QuobyteHD {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:57 devstack sudo[102006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_32800a64-c187-4c60-a7c2-ab0e8e8d8cab_h5jyf49wdevstack@QuobyteHD Sep 18 21:47:57 devstack sudo[102006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:58 devstack sudo[102006]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-16fd2a5b-d54a-4e76-bc7f-4cace9549679 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_32800a64-c187-4c60-a7c2-ab0e8e8d8cab_h5jyf49wdevstack@QuobyteHD" returned: 1 in 0.346s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-16fd2a5b-d54a-4e76-bc7f-4cace9549679 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_32800a64-c187-4c60-a7c2-ab0e8e8d8cab_h5jyf49wdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 18 21:47:58 devstack cinder-volume[86136]: DEBUG cinder.image.image_utils [None req-16fd2a5b-d54a-4e76-bc7f-4cace9549679 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] Temporary image 32800a64-c187-4c60-a7c2-ab0e8e8d8cab is fetched for user 28d32266c1da428fb0f3fbe00dc74dbc. {{(pid=86136) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 18 21:47:58 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[242d3a8d-b9a3-4652-861a-543e72139858]: (4, 'raw') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:47:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-16fd2a5b-d54a-4e76-bc7f-4cace9549679 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_32800a64-c187-4c60-a7c2-ab0e8e8d8cab_h5jyf49wdevstack@QuobyteHD {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:58 devstack sudo[102011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_32800a64-c187-4c60-a7c2-ab0e8e8d8cab_h5jyf49wdevstack@QuobyteHD Sep 18 21:47:58 devstack sudo[102011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:58 devstack sudo[102011]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-16fd2a5b-d54a-4e76-bc7f-4cace9549679 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_32800a64-c187-4c60-a7c2-ab0e8e8d8cab_h5jyf49wdevstack@QuobyteHD" returned: 0 in 0.369s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-16fd2a5b-d54a-4e76-bc7f-4cace9549679 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_32800a64-c187-4c60-a7c2-ab0e8e8d8cab_h5jyf49wdevstack@QuobyteHD {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:58 devstack sudo[102015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_32800a64-c187-4c60-a7c2-ab0e8e8d8cab_h5jyf49wdevstack@QuobyteHD Sep 18 21:47:58 devstack sudo[102015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:58 devstack sudo[102015]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-16fd2a5b-d54a-4e76-bc7f-4cace9549679 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_32800a64-c187-4c60-a7c2-ab0e8e8d8cab_h5jyf49wdevstack@QuobyteHD" returned: 1 in 0.352s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-16fd2a5b-d54a-4e76-bc7f-4cace9549679 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_32800a64-c187-4c60-a7c2-ab0e8e8d8cab_h5jyf49wdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 18 21:47:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-16fd2a5b-d54a-4e76-bc7f-4cace9549679 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:47:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-16fd2a5b-d54a-4e76-bc7f-4cace9549679 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:47:58 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-16fd2a5b-d54a-4e76-bc7f-4cace9549679 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:47:56Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b9da8c1-b82a-4780-bd6c-7c11b6163276,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc52ee31619a4ea4ad037aab8af2660c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:47:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:47:57Z,use_quota=True,user_id='28d32266c1da428fb0f3fbe00dc74dbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef573ecb-296b-49a0-bf35-084df4e00ed5),volume_type_id=ef573ecb-296b-49a0-bf35-084df4e00ed5)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:47:58 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-16fd2a5b-d54a-4e76-bc7f-4cace9549679 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] Creating volume 8b9da8c1-b82a-4780-bd6c-7c11b6163276 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:47:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-16fd2a5b-d54a-4e76-bc7f-4cace9549679 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:47:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-16fd2a5b-d54a-4e76-bc7f-4cace9549679 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:47:58 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-16fd2a5b-d54a-4e76-bc7f-4cace9549679 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:47:58 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-16fd2a5b-d54a-4e76-bc7f-4cace9549679 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:47:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-16fd2a5b-d54a-4e76-bc7f-4cace9549679 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:47:58 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-16fd2a5b-d54a-4e76-bc7f-4cace9549679 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:47:58 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-16fd2a5b-d54a-4e76-bc7f-4cace9549679 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:47:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-16fd2a5b-d54a-4e76-bc7f-4cace9549679 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-8b9da8c1-b82a-4780-bd6c-7c11b6163276 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:58 devstack sudo[102024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-8b9da8c1-b82a-4780-bd6c-7c11b6163276 1073741824 Sep 18 21:47:58 devstack sudo[102024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:59 devstack sudo[102024]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-16fd2a5b-d54a-4e76-bc7f-4cace9549679 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-8b9da8c1-b82a-4780-bd6c-7c11b6163276 1073741824" returned: 0 in 0.531s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-16fd2a5b-d54a-4e76-bc7f-4cace9549679 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-8b9da8c1-b82a-4780-bd6c-7c11b6163276 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:47:59 devstack sudo[102033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-8b9da8c1-b82a-4780-bd6c-7c11b6163276 Sep 18 21:47:59 devstack sudo[102033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:47:59 devstack sudo[102033]: pam_unix(sudo:session): session closed for user root Sep 18 21:47:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-16fd2a5b-d54a-4e76-bc7f-4cace9549679 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-8b9da8c1-b82a-4780-bd6c-7c11b6163276" returned: 0 in 0.314s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:47:59 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-16fd2a5b-d54a-4e76-bc7f-4cace9549679 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:47:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-16fd2a5b-d54a-4e76-bc7f-4cace9549679 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:47:59 devstack cinder-volume[86136]: DEBUG cinder.volume.volume_utils [None req-16fd2a5b-d54a-4e76-bc7f-4cace9549679 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] Attempting download of 32800a64-c187-4c60-a7c2-ab0e8e8d8cab ((None, [{'url': 'file:///opt/stack/data/glance/images/32800a64-c187-4c60-a7c2-ab0e8e8d8cab', 'metadata': {}}])) to volume 8b9da8c1-b82a-4780-bd6c-7c11b6163276. {{(pid=86136) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 18 21:47:59 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e85c30-7f43-4e7c-963b-b2f6eab21490]: (4, 'raw') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:47:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-16fd2a5b-d54a-4e76-bc7f-4cace9549679 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_32800a64-c187-4c60-a7c2-ab0e8e8d8cab_4bvp7vt1 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:00 devstack sudo[102041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_32800a64-c187-4c60-a7c2-ab0e8e8d8cab_4bvp7vt1 Sep 18 21:48:00 devstack sudo[102041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-80c1517a-3979-4758-b323-31574b84da75 req-4e4ef023-447e-4d3c-9aad-3be10e488283 tempest-TestStampPattern-580697789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:48:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-80c1517a-3979-4758-b323-31574b84da75 req-4e4ef023-447e-4d3c-9aad-3be10e488283 tempest-TestStampPattern-580697789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:48:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [req-80c1517a-3979-4758-b323-31574b84da75 req-4e4ef023-447e-4d3c-9aad-3be10e488283 tempest-TestStampPattern-580697789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:48:00 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [req-80c1517a-3979-4758-b323-31574b84da75 req-4e4ef023-447e-4d3c-9aad-3be10e488283 tempest-TestStampPattern-580697789 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff', 'name': 'volume-9d58229e-d2f2-4c10-a3c7-5eab09caeaa3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a4943de8-7f04-4fe4-9a52-f0e73933ac27', 'enforce_multipath': True} {{(pid=86136) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 18 21:48:00 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2ad5bbb-49a9-4df1-a61a-a8acc055db7a tempest-VolumesCloneNegativeTest-1196095886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:48:00 devstack sudo[102041]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:00 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c2ad5bbb-49a9-4df1-a61a-a8acc055db7a tempest-VolumesCloneNegativeTest-1196095886 None] Flow 'volume_create_manager' (5d97b838-8c89-442c-bacb-3106df3b2720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:48:00 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c2ad5bbb-49a9-4df1-a61a-a8acc055db7a tempest-VolumesCloneNegativeTest-1196095886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (868dbbc2-dd8f-4f60-98db-cccc99a5c6af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-16fd2a5b-d54a-4e76-bc7f-4cace9549679 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_32800a64-c187-4c60-a7c2-ab0e8e8d8cab_4bvp7vt1" returned: 0 in 0.366s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-16fd2a5b-d54a-4e76-bc7f-4cace9549679 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_32800a64-c187-4c60-a7c2-ab0e8e8d8cab_4bvp7vt1 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:00 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c2ad5bbb-49a9-4df1-a61a-a8acc055db7a tempest-VolumesCloneNegativeTest-1196095886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (868dbbc2-dd8f-4f60-98db-cccc99a5c6af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:48:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1110911133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4159b76f-fbf2-4edd-bb83-851e447226fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='953913040a23464ebdf0c6fab7969766',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:48:00Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:48:00Z,use_quota=True,user_id='582a837113834298b2a6cf5ab8eb3241',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:00 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c2ad5bbb-49a9-4df1-a61a-a8acc055db7a tempest-VolumesCloneNegativeTest-1196095886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff00e9b2-e69a-4673-bdd5-9e287a8fd8b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:00 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c2ad5bbb-49a9-4df1-a61a-a8acc055db7a tempest-VolumesCloneNegativeTest-1196095886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff00e9b2-e69a-4673-bdd5-9e287a8fd8b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:00 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c2ad5bbb-49a9-4df1-a61a-a8acc055db7a tempest-VolumesCloneNegativeTest-1196095886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7a3062b-222a-4181-8a68-f133e510d102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:00 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c2ad5bbb-49a9-4df1-a61a-a8acc055db7a tempest-VolumesCloneNegativeTest-1196095886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7a3062b-222a-4181-8a68-f133e510d102) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4159b76f-fbf2-4edd-bb83-851e447226fa', 'volume_name': 'volume-4159b76f-fbf2-4edd-bb83-851e447226fa', 'volume_size': 2}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:00 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c2ad5bbb-49a9-4df1-a61a-a8acc055db7a tempest-VolumesCloneNegativeTest-1196095886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86dd2e82-d99c-41ea-9d9f-a1cabe188caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:00 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c2ad5bbb-49a9-4df1-a61a-a8acc055db7a tempest-VolumesCloneNegativeTest-1196095886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86dd2e82-d99c-41ea-9d9f-a1cabe188caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:00 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c2ad5bbb-49a9-4df1-a61a-a8acc055db7a tempest-VolumesCloneNegativeTest-1196095886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45b43489-28bb-4475-be48-0069e7a745d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:00 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-c2ad5bbb-49a9-4df1-a61a-a8acc055db7a tempest-VolumesCloneNegativeTest-1196095886 None] Volume 4159b76f-fbf2-4edd-bb83-851e447226fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4159b76f-fbf2-4edd-bb83-851e447226fa', 'volume_size': 2} Sep 18 21:48:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c2ad5bbb-49a9-4df1-a61a-a8acc055db7a tempest-VolumesCloneNegativeTest-1196095886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:48:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c2ad5bbb-49a9-4df1-a61a-a8acc055db7a tempest-VolumesCloneNegativeTest-1196095886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:48:00 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-c2ad5bbb-49a9-4df1-a61a-a8acc055db7a tempest-VolumesCloneNegativeTest-1196095886 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:48:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1110911133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4159b76f-fbf2-4edd-bb83-851e447226fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='953913040a23464ebdf0c6fab7969766',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:48:00Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:48:00Z,use_quota=True,user_id='582a837113834298b2a6cf5ab8eb3241',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:48:00 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-c2ad5bbb-49a9-4df1-a61a-a8acc055db7a tempest-VolumesCloneNegativeTest-1196095886 None] Creating volume 4159b76f-fbf2-4edd-bb83-851e447226fa {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:48:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c2ad5bbb-49a9-4df1-a61a-a8acc055db7a tempest-VolumesCloneNegativeTest-1196095886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:48:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c2ad5bbb-49a9-4df1-a61a-a8acc055db7a tempest-VolumesCloneNegativeTest-1196095886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:48:00 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-c2ad5bbb-49a9-4df1-a61a-a8acc055db7a tempest-VolumesCloneNegativeTest-1196095886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:48:00 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-c2ad5bbb-49a9-4df1-a61a-a8acc055db7a tempest-VolumesCloneNegativeTest-1196095886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:48:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c2ad5bbb-49a9-4df1-a61a-a8acc055db7a tempest-VolumesCloneNegativeTest-1196095886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:48:00 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-c2ad5bbb-49a9-4df1-a61a-a8acc055db7a tempest-VolumesCloneNegativeTest-1196095886 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:48:00 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-c2ad5bbb-49a9-4df1-a61a-a8acc055db7a tempest-VolumesCloneNegativeTest-1196095886 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:48:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c2ad5bbb-49a9-4df1-a61a-a8acc055db7a tempest-VolumesCloneNegativeTest-1196095886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4159b76f-fbf2-4edd-bb83-851e447226fa 2147483648 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:00 devstack sudo[102049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4159b76f-fbf2-4edd-bb83-851e447226fa 2147483648 Sep 18 21:48:00 devstack sudo[102049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:00 devstack cinder-volume[86136]: INFO cinder.volume.manager [req-80c1517a-3979-4758-b323-31574b84da75 req-4e4ef023-447e-4d3c-9aad-3be10e488283 tempest-TestStampPattern-580697789 None] attachment_update completed successfully. Sep 18 21:48:00 devstack sudo[102048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_32800a64-c187-4c60-a7c2-ab0e8e8d8cab_4bvp7vt1 Sep 18 21:48:00 devstack sudo[102048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:00 devstack sudo[102048]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-16fd2a5b-d54a-4e76-bc7f-4cace9549679 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_32800a64-c187-4c60-a7c2-ab0e8e8d8cab_4bvp7vt1" returned: 1 in 0.361s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-16fd2a5b-d54a-4e76-bc7f-4cace9549679 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_32800a64-c187-4c60-a7c2-ab0e8e8d8cab_4bvp7vt1' failed. Not Retrying. {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 18 21:48:00 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a86aa6-a51b-4be3-b2af-44f202213fe2]: (4, 'raw') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:48:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-16fd2a5b-d54a-4e76-bc7f-4cace9549679 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_32800a64-c187-4c60-a7c2-ab0e8e8d8cab_h5jyf49wdevstack@QuobyteHD {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:00 devstack sudo[102153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_32800a64-c187-4c60-a7c2-ab0e8e8d8cab_h5jyf49wdevstack@QuobyteHD Sep 18 21:48:00 devstack sudo[102153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:00 devstack sudo[102049]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c2ad5bbb-49a9-4df1-a61a-a8acc055db7a tempest-VolumesCloneNegativeTest-1196095886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4159b76f-fbf2-4edd-bb83-851e447226fa 2147483648" returned: 0 in 0.608s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c2ad5bbb-49a9-4df1-a61a-a8acc055db7a tempest-VolumesCloneNegativeTest-1196095886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4159b76f-fbf2-4edd-bb83-851e447226fa {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:01 devstack sudo[102475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4159b76f-fbf2-4edd-bb83-851e447226fa Sep 18 21:48:01 devstack sudo[102475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:01 devstack sudo[102153]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-16fd2a5b-d54a-4e76-bc7f-4cace9549679 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_32800a64-c187-4c60-a7c2-ab0e8e8d8cab_h5jyf49wdevstack@QuobyteHD" returned: 0 in 0.431s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-16fd2a5b-d54a-4e76-bc7f-4cace9549679 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_32800a64-c187-4c60-a7c2-ab0e8e8d8cab_h5jyf49wdevstack@QuobyteHD {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:01 devstack sudo[102477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_32800a64-c187-4c60-a7c2-ab0e8e8d8cab_h5jyf49wdevstack@QuobyteHD Sep 18 21:48:01 devstack sudo[102477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:01 devstack sudo[102475]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c2ad5bbb-49a9-4df1-a61a-a8acc055db7a tempest-VolumesCloneNegativeTest-1196095886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4159b76f-fbf2-4edd-bb83-851e447226fa" returned: 0 in 0.296s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:01 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-c2ad5bbb-49a9-4df1-a61a-a8acc055db7a tempest-VolumesCloneNegativeTest-1196095886 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:48:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c2ad5bbb-49a9-4df1-a61a-a8acc055db7a tempest-VolumesCloneNegativeTest-1196095886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:48:01 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c2ad5bbb-49a9-4df1-a61a-a8acc055db7a tempest-VolumesCloneNegativeTest-1196095886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45b43489-28bb-4475-be48-0069e7a745d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4159b76f-fbf2-4edd-bb83-851e447226fa', 'volume_size': 2}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:01 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c2ad5bbb-49a9-4df1-a61a-a8acc055db7a tempest-VolumesCloneNegativeTest-1196095886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c71a1ae-8383-452e-bdea-9a80864496c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:01 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-c2ad5bbb-49a9-4df1-a61a-a8acc055db7a tempest-VolumesCloneNegativeTest-1196095886 None] Volume volume-4159b76f-fbf2-4edd-bb83-851e447226fa (4159b76f-fbf2-4edd-bb83-851e447226fa): created successfully Sep 18 21:48:01 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c2ad5bbb-49a9-4df1-a61a-a8acc055db7a tempest-VolumesCloneNegativeTest-1196095886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c71a1ae-8383-452e-bdea-9a80864496c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:01 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c2ad5bbb-49a9-4df1-a61a-a8acc055db7a tempest-VolumesCloneNegativeTest-1196095886 None] Flow 'volume_create_manager' (5d97b838-8c89-442c-bacb-3106df3b2720) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:48:01 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-c2ad5bbb-49a9-4df1-a61a-a8acc055db7a tempest-VolumesCloneNegativeTest-1196095886 None] Created volume successfully. Sep 18 21:48:01 devstack sudo[102477]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-16fd2a5b-d54a-4e76-bc7f-4cace9549679 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_32800a64-c187-4c60-a7c2-ab0e8e8d8cab_h5jyf49wdevstack@QuobyteHD" returned: 1 in 0.372s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-16fd2a5b-d54a-4e76-bc7f-4cace9549679 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_32800a64-c187-4c60-a7c2-ab0e8e8d8cab_h5jyf49wdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 18 21:48:01 devstack cinder-volume[86136]: DEBUG cinder.image.image_utils [None req-16fd2a5b-d54a-4e76-bc7f-4cace9549679 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] 32800a64-c187-4c60-a7c2-ab0e8e8d8cab was raw, converting to qcow2 {{(pid=86136) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 18 21:48:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-16fd2a5b-d54a-4e76-bc7f-4cace9549679 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_32800a64-c187-4c60-a7c2-ab0e8e8d8cab_h5jyf49wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-8b9da8c1-b82a-4780-bd6c-7c11b6163276 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:01 devstack sudo[102483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_32800a64-c187-4c60-a7c2-ab0e8e8d8cab_h5jyf49wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-8b9da8c1-b82a-4780-bd6c-7c11b6163276 Sep 18 21:48:01 devstack sudo[102483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:01 devstack sudo[102483]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-16fd2a5b-d54a-4e76-bc7f-4cace9549679 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_32800a64-c187-4c60-a7c2-ab0e8e8d8cab_h5jyf49wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-8b9da8c1-b82a-4780-bd6c-7c11b6163276" returned: 0 in 0.481s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:01 devstack cinder-volume[86136]: DEBUG cinder.image.image_utils [None req-16fd2a5b-d54a-4e76-bc7f-4cace9549679 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_32800a64-c187-4c60-a7c2-ab0e8e8d8cab_h5jyf49wdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-8b9da8c1-b82a-4780-bd6c-7c11b6163276 {{(pid=86136) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 18 21:48:01 devstack cinder-volume[86136]: INFO cinder.image.image_utils [None req-16fd2a5b-d54a-4e76-bc7f-4cace9549679 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] Converted 0.00 MB image at 0.00 MB/s Sep 18 21:48:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-16fd2a5b-d54a-4e76-bc7f-4cace9549679 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-8b9da8c1-b82a-4780-bd6c-7c11b6163276 1G {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:01 devstack sudo[102493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-8b9da8c1-b82a-4780-bd6c-7c11b6163276 1G Sep 18 21:48:01 devstack sudo[102493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:02 devstack sudo[102493]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:02 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-16fd2a5b-d54a-4e76-bc7f-4cace9549679 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-8b9da8c1-b82a-4780-bd6c-7c11b6163276 1G" returned: 0 in 0.358s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:02 devstack cinder-volume[86136]: DEBUG cinder.volume.volume_utils [None req-16fd2a5b-d54a-4e76-bc7f-4cace9549679 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] Downloaded image 32800a64-c187-4c60-a7c2-ab0e8e8d8cab ((None, [{'url': 'file:///opt/stack/data/glance/images/32800a64-c187-4c60-a7c2-ab0e8e8d8cab', 'metadata': {}}])) to volume 8b9da8c1-b82a-4780-bd6c-7c11b6163276 successfully. {{(pid=86136) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 18 21:48:02 devstack cinder-volume[86136]: DEBUG cinder.image.image_utils [None req-16fd2a5b-d54a-4e76-bc7f-4cace9549679 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] Temporary image 32800a64-c187-4c60-a7c2-ab0e8e8d8cab for user 28d32266c1da428fb0f3fbe00dc74dbc is deleted. {{(pid=86136) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 18 21:48:02 devstack cinder-volume[86136]: DEBUG cinder.volume.volume_utils [None req-16fd2a5b-d54a-4e76-bc7f-4cace9549679 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] Marking volume 8b9da8c1-b82a-4780-bd6c-7c11b6163276 as bootable. {{(pid=86136) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 18 21:48:02 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-16fd2a5b-d54a-4e76-bc7f-4cace9549679 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] Copying metadata from image 32800a64-c187-4c60-a7c2-ab0e8e8d8cab to 8b9da8c1-b82a-4780-bd6c-7c11b6163276. {{(pid=86136) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 18 21:48:02 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-16fd2a5b-d54a-4e76-bc7f-4cace9549679 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] Creating volume glance metadata for volume 8b9da8c1-b82a-4780-bd6c-7c11b6163276 backed by image 32800a64-c187-4c60-a7c2-ab0e8e8d8cab with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '32800a64-c187-4c60-a7c2-ab0e8e8d8cab', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'a91204a3f3653fe4bd48fe4a8c4d68fc', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86136) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 18 21:48:02 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-16fd2a5b-d54a-4e76-bc7f-4cace9549679 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9012f79f-314a-49b2-a190-7f3457ff092d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b9da8c1-b82a-4780-bd6c-7c11b6163276', 'volume_size': 1, 'image_id': '32800a64-c187-4c60-a7c2-ab0e8e8d8cab', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/32800a64-c187-4c60-a7c2-ab0e8e8d8cab', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a91204a3f3653fe4bd48fe4a8c4d68fc', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fc52ee31619a4ea4ad037aab8af2660c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c176ae0676e2663b3ac0a71ee5d7d86f1ebe5bb2fffd4f3a1fb603509c319bef8e7036c53aa2cc972a143530794eeab6a5b19a762af26258915f89608b0b1811', 'id': '32800a64-c187-4c60-a7c2-ab0e8e8d8cab', 'created_at': datetime.datetime(2026, 9, 18, 19, 47, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 18, 19, 47, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/32800a64-c187-4c60-a7c2-ab0e8e8d8cab/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:02 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-16fd2a5b-d54a-4e76-bc7f-4cace9549679 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f7afda7-4006-4e86-9c15-284586cc4711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:02 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-16fd2a5b-d54a-4e76-bc7f-4cace9549679 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] Volume volume-8b9da8c1-b82a-4780-bd6c-7c11b6163276 (8b9da8c1-b82a-4780-bd6c-7c11b6163276): created successfully Sep 18 21:48:02 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-16fd2a5b-d54a-4e76-bc7f-4cace9549679 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f7afda7-4006-4e86-9c15-284586cc4711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:02 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-16fd2a5b-d54a-4e76-bc7f-4cace9549679 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] Flow 'volume_create_manager' (26ffc80c-7328-4e89-b93b-37ac3925ac98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:48:02 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-16fd2a5b-d54a-4e76-bc7f-4cace9549679 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] Created volume successfully. Sep 18 21:48:02 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-4f401924-3f12-4b52-9021-ad23230c85c9 tempest-VolumesCloneNegativeTest-1196095886 None] Acquiring lock "cinder-4159b76f-fbf2-4edd-bb83-851e447226fa-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:48:02 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-4f401924-3f12-4b52-9021-ad23230c85c9 tempest-VolumesCloneNegativeTest-1196095886 None] Lock "cinder-4159b76f-fbf2-4edd-bb83-851e447226fa-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:48:02 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-4f401924-3f12-4b52-9021-ad23230c85c9 tempest-VolumesCloneNegativeTest-1196095886 None] Acquiring lock "cinder-quobyte-4159b76f-fbf2-4edd-bb83-851e447226fa" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:48:02 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-4f401924-3f12-4b52-9021-ad23230c85c9 tempest-VolumesCloneNegativeTest-1196095886 None] Lock "cinder-quobyte-4159b76f-fbf2-4edd-bb83-851e447226fa" acquired by "delete_volume" :: waited 0.022s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:48:02 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b6ce404-29e6-4c4e-af3a-5e7f68a399b0]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:48:02 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-4f401924-3f12-4b52-9021-ad23230c85c9 tempest-VolumesCloneNegativeTest-1196095886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4159b76f-fbf2-4edd-bb83-851e447226fa {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:02 devstack sudo[102510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4159b76f-fbf2-4edd-bb83-851e447226fa Sep 18 21:48:02 devstack sudo[102510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:03 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-f2ad628a-c918-4a34-ae89-7b88ec09f2b4 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] Acquiring lock "cinder-8b9da8c1-b82a-4780-bd6c-7c11b6163276-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:48:03 devstack sudo[102510]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-4f401924-3f12-4b52-9021-ad23230c85c9 tempest-VolumesCloneNegativeTest-1196095886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4159b76f-fbf2-4edd-bb83-851e447226fa" returned: 0 in 0.438s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-4f401924-3f12-4b52-9021-ad23230c85c9 tempest-VolumesCloneNegativeTest-1196095886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4159b76f-fbf2-4edd-bb83-851e447226fa {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:03 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-f2ad628a-c918-4a34-ae89-7b88ec09f2b4 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] Lock "cinder-8b9da8c1-b82a-4780-bd6c-7c11b6163276-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:48:03 devstack sudo[102515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4159b76f-fbf2-4edd-bb83-851e447226fa Sep 18 21:48:03 devstack sudo[102515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:03 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-f2ad628a-c918-4a34-ae89-7b88ec09f2b4 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] Acquiring lock "cinder-quobyte-8b9da8c1-b82a-4780-bd6c-7c11b6163276" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:48:03 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-f2ad628a-c918-4a34-ae89-7b88ec09f2b4 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] Lock "cinder-quobyte-8b9da8c1-b82a-4780-bd6c-7c11b6163276" acquired by "delete_volume" :: waited 0.018s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:48:03 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc0237e-5301-495b-819d-cc46cd67647c]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:48:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f2ad628a-c918-4a34-ae89-7b88ec09f2b4 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-8b9da8c1-b82a-4780-bd6c-7c11b6163276 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:03 devstack sudo[102518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-8b9da8c1-b82a-4780-bd6c-7c11b6163276 Sep 18 21:48:03 devstack sudo[102518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:03 devstack sudo[102515]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-4f401924-3f12-4b52-9021-ad23230c85c9 tempest-VolumesCloneNegativeTest-1196095886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-4159b76f-fbf2-4edd-bb83-851e447226fa" returned: 0 in 0.284s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:03 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-4f401924-3f12-4b52-9021-ad23230c85c9 tempest-VolumesCloneNegativeTest-1196095886 None] Lock "cinder-quobyte-4159b76f-fbf2-4edd-bb83-851e447226fa" released by "delete_volume" :: held 0.772s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:48:03 devstack cinder-volume[86136]: INFO cinder.volume.manager [req-21ca2f3d-83f6-466d-b6fa-c4386333f490 req-84de3e52-e459-4ed0-bad6-e168c26b5cb1 tempest-TestStampPattern-580697789 None] Terminate volume connection completed successfully. Sep 18 21:48:03 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [req-21ca2f3d-83f6-466d-b6fa-c4386333f490 req-84de3e52-e459-4ed0-bad6-e168c26b5cb1 tempest-TestStampPattern-580697789 None] Deleting attachment a4943de8-7f04-4fe4-9a52-f0e73933ac27. {{(pid=86136) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 18 21:48:03 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-4f401924-3f12-4b52-9021-ad23230c85c9 tempest-VolumesCloneNegativeTest-1196095886 None] Created reservations ['569aaae1-ae89-40be-84df-8ee88280b628', '9803c175-50c2-4aa6-9349-10a717084054', '83e54437-a9fb-4578-bd8e-473f26ea44d2', '9bdf789c-59a5-4ca6-9715-cab1e54a6c8b'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:48:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-4f401924-3f12-4b52-9021-ad23230c85c9 tempest-VolumesCloneNegativeTest-1196095886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:48:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-4f401924-3f12-4b52-9021-ad23230c85c9 tempest-VolumesCloneNegativeTest-1196095886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:48:03 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-4f401924-3f12-4b52-9021-ad23230c85c9 tempest-VolumesCloneNegativeTest-1196095886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:48:03 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-4f401924-3f12-4b52-9021-ad23230c85c9 tempest-VolumesCloneNegativeTest-1196095886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:48:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-4f401924-3f12-4b52-9021-ad23230c85c9 tempest-VolumesCloneNegativeTest-1196095886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:48:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-4f401924-3f12-4b52-9021-ad23230c85c9 tempest-VolumesCloneNegativeTest-1196095886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:03 devstack sudo[102550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:48:03 devstack sudo[102550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:03 devstack sudo[102518]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f2ad628a-c918-4a34-ae89-7b88ec09f2b4 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-8b9da8c1-b82a-4780-bd6c-7c11b6163276" returned: 0 in 0.498s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f2ad628a-c918-4a34-ae89-7b88ec09f2b4 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-8b9da8c1-b82a-4780-bd6c-7c11b6163276 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:03 devstack sudo[102553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-8b9da8c1-b82a-4780-bd6c-7c11b6163276 Sep 18 21:48:03 devstack sudo[102553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:03 devstack sudo[102550]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-4f401924-3f12-4b52-9021-ad23230c85c9 tempest-VolumesCloneNegativeTest-1196095886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.317s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:03 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-4f401924-3f12-4b52-9021-ad23230c85c9 tempest-VolumesCloneNegativeTest-1196095886 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:48:03 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-4f401924-3f12-4b52-9021-ad23230c85c9 tempest-VolumesCloneNegativeTest-1196095886 None] Deleted volume successfully. Sep 18 21:48:03 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-4f401924-3f12-4b52-9021-ad23230c85c9 tempest-VolumesCloneNegativeTest-1196095886 None] Lock "cinder-4159b76f-fbf2-4edd-bb83-851e447226fa-delete_volume" released by "delete_volume" :: held 1.358s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:48:03 devstack sudo[102553]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f2ad628a-c918-4a34-ae89-7b88ec09f2b4 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-8b9da8c1-b82a-4780-bd6c-7c11b6163276" returned: 0 in 0.313s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:03 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-f2ad628a-c918-4a34-ae89-7b88ec09f2b4 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] Lock "cinder-quobyte-8b9da8c1-b82a-4780-bd6c-7c11b6163276" released by "delete_volume" :: held 0.857s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:48:04 devstack cinder-volume[86136]: WARNING cinder.quota [None req-f2ad628a-c918-4a34-ae89-7b88ec09f2b4 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 18 21:48:04 devstack cinder-volume[86136]: WARNING cinder.quota [None req-f2ad628a-c918-4a34-ae89-7b88ec09f2b4 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 18 21:48:04 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-f2ad628a-c918-4a34-ae89-7b88ec09f2b4 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] Created reservations ['129cfb41-d738-4ea1-bf3e-fbec4138d686', 'dd21aa3a-200f-4326-a61a-3ca50600d5d4', '651cef2f-6855-4696-953d-1f18d018bf11', '6e565b07-2f22-4dd5-9350-8df78d464962'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:48:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-f2ad628a-c918-4a34-ae89-7b88ec09f2b4 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:48:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-f2ad628a-c918-4a34-ae89-7b88ec09f2b4 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:48:04 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-f2ad628a-c918-4a34-ae89-7b88ec09f2b4 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:48:04 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-f2ad628a-c918-4a34-ae89-7b88ec09f2b4 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:48:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-f2ad628a-c918-4a34-ae89-7b88ec09f2b4 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:48:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f2ad628a-c918-4a34-ae89-7b88ec09f2b4 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:04 devstack sudo[102557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:48:04 devstack sudo[102557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:04 devstack sudo[102557]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f2ad628a-c918-4a34-ae89-7b88ec09f2b4 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.322s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:04 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-f2ad628a-c918-4a34-ae89-7b88ec09f2b4 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:48:04 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-f2ad628a-c918-4a34-ae89-7b88ec09f2b4 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] Deleted volume successfully. Sep 18 21:48:04 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-f2ad628a-c918-4a34-ae89-7b88ec09f2b4 tempest-VolumeAndVolumeTypeFromImageTest-1454612013 None] Lock "cinder-8b9da8c1-b82a-4780-bd6c-7c11b6163276-delete_volume" released by "delete_volume" :: held 1.449s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:48:05 devstack cinder-volume[86136]: DEBUG oslo_service.periodic_task [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86136) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 21:48:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:48:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:48:05 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:48:05 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:48:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:48:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:05 devstack sudo[102562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:48:05 devstack sudo[102562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:05 devstack sudo[102562]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.349s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:05 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:48:05 devstack cinder-volume[86136]: DEBUG oslo_service.periodic_task [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Running periodic task VolumeManager._thread_info {{(pid=86136) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 21:48:05 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] thread count: 28 {{(pid=86136) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 18 21:48:05 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] thread info: [<_MainThread(MainThread, started 138548347871360)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86136) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 18 21:48:08 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-2ddbee84-5f28-4eee-8440-2958f25d83fa tempest-TestStampPattern-580697789 None] Acquiring lock "cinder-9d58229e-d2f2-4c10-a3c7-5eab09caeaa3-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:48:08 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-2ddbee84-5f28-4eee-8440-2958f25d83fa tempest-TestStampPattern-580697789 None] Lock "cinder-9d58229e-d2f2-4c10-a3c7-5eab09caeaa3-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:48:08 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-177a954a-deb2-4dc9-a624-602cf27c7af9 tempest-VolumesGetTest-2025585433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:48:09 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-177a954a-deb2-4dc9-a624-602cf27c7af9 tempest-VolumesGetTest-2025585433 None] Flow 'volume_create_manager' (873617c7-8eb4-4e28-8c42-dda622d9dabe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:48:09 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-177a954a-deb2-4dc9-a624-602cf27c7af9 tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1349c59f-692b-4857-9d96-10f66cd0a4d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:09 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-2ddbee84-5f28-4eee-8440-2958f25d83fa tempest-TestStampPattern-580697789 None] Acquiring lock "cinder-quobyte-9d58229e-d2f2-4c10-a3c7-5eab09caeaa3" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:48:09 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-177a954a-deb2-4dc9-a624-602cf27c7af9 tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1349c59f-692b-4857-9d96-10f66cd0a4d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:48:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-596607709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=effe7413-1350-4242-9944-c9672fd6d9bc,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c6cd15df09da425c84d7c465a1bd7b81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:48:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:48:09Z,use_quota=True,user_id='93d906f234b946cea603ec1bfebe96ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:09 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-177a954a-deb2-4dc9-a624-602cf27c7af9 tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a023591-26f6-4982-a15e-a26f48841ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:09 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-177a954a-deb2-4dc9-a624-602cf27c7af9 tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a023591-26f6-4982-a15e-a26f48841ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:09 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-177a954a-deb2-4dc9-a624-602cf27c7af9 tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee7c5ce5-adfe-459b-88e0-105f3bdd650f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:09 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-177a954a-deb2-4dc9-a624-602cf27c7af9 tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee7c5ce5-adfe-459b-88e0-105f3bdd650f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'effe7413-1350-4242-9944-c9672fd6d9bc', 'volume_name': 'volume-effe7413-1350-4242-9944-c9672fd6d9bc', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:09 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-177a954a-deb2-4dc9-a624-602cf27c7af9 tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e27296f-352a-41fc-9d3d-508d4a5afd5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:09 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-177a954a-deb2-4dc9-a624-602cf27c7af9 tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e27296f-352a-41fc-9d3d-508d4a5afd5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:09 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-177a954a-deb2-4dc9-a624-602cf27c7af9 tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3de9a042-ad51-4892-8838-221cb39a7868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:09 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-177a954a-deb2-4dc9-a624-602cf27c7af9 tempest-VolumesGetTest-2025585433 None] Volume effe7413-1350-4242-9944-c9672fd6d9bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-effe7413-1350-4242-9944-c9672fd6d9bc', 'volume_size': 1} Sep 18 21:48:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-177a954a-deb2-4dc9-a624-602cf27c7af9 tempest-VolumesGetTest-2025585433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:48:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-177a954a-deb2-4dc9-a624-602cf27c7af9 tempest-VolumesGetTest-2025585433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:48:09 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-177a954a-deb2-4dc9-a624-602cf27c7af9 tempest-VolumesGetTest-2025585433 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:48:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-596607709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=effe7413-1350-4242-9944-c9672fd6d9bc,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c6cd15df09da425c84d7c465a1bd7b81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:48:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:48:09Z,use_quota=True,user_id='93d906f234b946cea603ec1bfebe96ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:48:09 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-177a954a-deb2-4dc9-a624-602cf27c7af9 tempest-VolumesGetTest-2025585433 None] Creating volume effe7413-1350-4242-9944-c9672fd6d9bc {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:48:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-177a954a-deb2-4dc9-a624-602cf27c7af9 tempest-VolumesGetTest-2025585433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:48:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-177a954a-deb2-4dc9-a624-602cf27c7af9 tempest-VolumesGetTest-2025585433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:48:09 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-177a954a-deb2-4dc9-a624-602cf27c7af9 tempest-VolumesGetTest-2025585433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:48:09 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-177a954a-deb2-4dc9-a624-602cf27c7af9 tempest-VolumesGetTest-2025585433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:48:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-177a954a-deb2-4dc9-a624-602cf27c7af9 tempest-VolumesGetTest-2025585433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:48:09 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-177a954a-deb2-4dc9-a624-602cf27c7af9 tempest-VolumesGetTest-2025585433 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:48:09 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-177a954a-deb2-4dc9-a624-602cf27c7af9 tempest-VolumesGetTest-2025585433 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:48:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-177a954a-deb2-4dc9-a624-602cf27c7af9 tempest-VolumesGetTest-2025585433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-effe7413-1350-4242-9944-c9672fd6d9bc 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:09 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-2ddbee84-5f28-4eee-8440-2958f25d83fa tempest-TestStampPattern-580697789 None] Lock "cinder-quobyte-9d58229e-d2f2-4c10-a3c7-5eab09caeaa3" acquired by "delete_volume" :: waited 0.090s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:48:09 devstack sudo[102600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-effe7413-1350-4242-9944-c9672fd6d9bc 1073741824 Sep 18 21:48:09 devstack sudo[102600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:09 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10e3fa9-ea7c-444b-9861-6fa5404ae9b3]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:48:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-2ddbee84-5f28-4eee-8440-2958f25d83fa tempest-TestStampPattern-580697789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9d58229e-d2f2-4c10-a3c7-5eab09caeaa3 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:09 devstack sudo[102602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9d58229e-d2f2-4c10-a3c7-5eab09caeaa3 Sep 18 21:48:09 devstack sudo[102602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:09 devstack sudo[102602]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-2ddbee84-5f28-4eee-8440-2958f25d83fa tempest-TestStampPattern-580697789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9d58229e-d2f2-4c10-a3c7-5eab09caeaa3" returned: 0 in 0.447s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-2ddbee84-5f28-4eee-8440-2958f25d83fa tempest-TestStampPattern-580697789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9d58229e-d2f2-4c10-a3c7-5eab09caeaa3 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:09 devstack sudo[102611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9d58229e-d2f2-4c10-a3c7-5eab09caeaa3 Sep 18 21:48:09 devstack sudo[102611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:09 devstack sudo[102600]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-177a954a-deb2-4dc9-a624-602cf27c7af9 tempest-VolumesGetTest-2025585433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-effe7413-1350-4242-9944-c9672fd6d9bc 1073741824" returned: 0 in 0.550s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-177a954a-deb2-4dc9-a624-602cf27c7af9 tempest-VolumesGetTest-2025585433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-effe7413-1350-4242-9944-c9672fd6d9bc {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:09 devstack sudo[102613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-effe7413-1350-4242-9944-c9672fd6d9bc Sep 18 21:48:09 devstack sudo[102613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:09 devstack sudo[102611]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-2ddbee84-5f28-4eee-8440-2958f25d83fa tempest-TestStampPattern-580697789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9d58229e-d2f2-4c10-a3c7-5eab09caeaa3" returned: 0 in 0.262s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:09 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-2ddbee84-5f28-4eee-8440-2958f25d83fa tempest-TestStampPattern-580697789 None] Lock "cinder-quobyte-9d58229e-d2f2-4c10-a3c7-5eab09caeaa3" released by "delete_volume" :: held 0.773s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:48:09 devstack sudo[102613]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-177a954a-deb2-4dc9-a624-602cf27c7af9 tempest-VolumesGetTest-2025585433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-effe7413-1350-4242-9944-c9672fd6d9bc" returned: 0 in 0.254s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:09 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-177a954a-deb2-4dc9-a624-602cf27c7af9 tempest-VolumesGetTest-2025585433 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:48:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-177a954a-deb2-4dc9-a624-602cf27c7af9 tempest-VolumesGetTest-2025585433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:48:09 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-2ddbee84-5f28-4eee-8440-2958f25d83fa tempest-TestStampPattern-580697789 None] Created reservations ['91ce13d3-8775-4ebc-9dff-21dfbe6b216d', 'b04a4cb7-f7cf-434c-bd06-831b60c1b26b', 'a4343b5e-203f-480a-9ffc-2f17d668dc95', '9262d895-8feb-4f8b-a54b-ca62177df2b9'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:48:09 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-177a954a-deb2-4dc9-a624-602cf27c7af9 tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3de9a042-ad51-4892-8838-221cb39a7868) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-effe7413-1350-4242-9944-c9672fd6d9bc', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:09 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-177a954a-deb2-4dc9-a624-602cf27c7af9 tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f0dda24-2af2-4ca6-956f-92b4a5d44e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:09 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-177a954a-deb2-4dc9-a624-602cf27c7af9 tempest-VolumesGetTest-2025585433 None] Volume volume-effe7413-1350-4242-9944-c9672fd6d9bc (effe7413-1350-4242-9944-c9672fd6d9bc): created successfully Sep 18 21:48:09 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-177a954a-deb2-4dc9-a624-602cf27c7af9 tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f0dda24-2af2-4ca6-956f-92b4a5d44e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:10 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-177a954a-deb2-4dc9-a624-602cf27c7af9 tempest-VolumesGetTest-2025585433 None] Flow 'volume_create_manager' (873617c7-8eb4-4e28-8c42-dda622d9dabe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:48:10 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-177a954a-deb2-4dc9-a624-602cf27c7af9 tempest-VolumesGetTest-2025585433 None] Created volume successfully. Sep 18 21:48:10 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-2ddbee84-5f28-4eee-8440-2958f25d83fa tempest-TestStampPattern-580697789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:48:10 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-2ddbee84-5f28-4eee-8440-2958f25d83fa tempest-TestStampPattern-580697789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:48:10 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-2ddbee84-5f28-4eee-8440-2958f25d83fa tempest-TestStampPattern-580697789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:48:10 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-2ddbee84-5f28-4eee-8440-2958f25d83fa tempest-TestStampPattern-580697789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:48:10 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-2ddbee84-5f28-4eee-8440-2958f25d83fa tempest-TestStampPattern-580697789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:48:10 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-2ddbee84-5f28-4eee-8440-2958f25d83fa tempest-TestStampPattern-580697789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:10 devstack sudo[102617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:48:10 devstack sudo[102617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:10 devstack sudo[102617]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:10 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-2ddbee84-5f28-4eee-8440-2958f25d83fa tempest-TestStampPattern-580697789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.265s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:10 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-2ddbee84-5f28-4eee-8440-2958f25d83fa tempest-TestStampPattern-580697789 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:48:10 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-2ddbee84-5f28-4eee-8440-2958f25d83fa tempest-TestStampPattern-580697789 None] Deleted volume successfully. Sep 18 21:48:10 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-2ddbee84-5f28-4eee-8440-2958f25d83fa tempest-TestStampPattern-580697789 None] Lock "cinder-9d58229e-d2f2-4c10-a3c7-5eab09caeaa3-delete_volume" released by "delete_volume" :: held 1.403s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:48:10 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-6f1d2410-87ec-4a59-8f85-b0550ea0a239 tempest-TestStampPattern-580697789 None] Acquiring lock "cinder-8781d896-20dd-4f26-a8c4-7feb8d88d94e-delete_snapshot" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:48:10 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-6f1d2410-87ec-4a59-8f85-b0550ea0a239 tempest-TestStampPattern-580697789 None] Lock "cinder-8781d896-20dd-4f26-a8c4-7feb8d88d94e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:48:10 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-6f1d2410-87ec-4a59-8f85-b0550ea0a239 tempest-TestStampPattern-580697789 None] Acquiring lock "cinder-quobyte-a6eaf836-5be5-4ea9-a3b4-497ffeaa19df" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:48:10 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-6f1d2410-87ec-4a59-8f85-b0550ea0a239 tempest-TestStampPattern-580697789 None] Lock "cinder-quobyte-a6eaf836-5be5-4ea9-a3b4-497ffeaa19df" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:48:10 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-6f1d2410-87ec-4a59-8f85-b0550ea0a239 tempest-TestStampPattern-580697789 None] Acquiring lock "cinder-quobyte-8781d896-20dd-4f26-a8c4-7feb8d88d94e" by "_delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:48:10 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-6f1d2410-87ec-4a59-8f85-b0550ea0a239 tempest-TestStampPattern-580697789 None] Lock "cinder-quobyte-8781d896-20dd-4f26-a8c4-7feb8d88d94e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:48:10 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-6f1d2410-87ec-4a59-8f85-b0550ea0a239 tempest-TestStampPattern-580697789 None] Deleting offline snapshot 8781d896-20dd-4f26-a8c4-7feb8d88d94e of volume a6eaf836-5be5-4ea9-a3b4-497ffeaa19df {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 21:48:10 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-6f1d2410-87ec-4a59-8f85-b0550ea0a239 tempest-TestStampPattern-580697789 None] snapshot_file for this snap is: volume-a6eaf836-5be5-4ea9-a3b4-497ffeaa19df.8781d896-20dd-4f26-a8c4-7feb8d88d94e {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 21:48:10 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c68a979-af14-4822-aed5-fc3246ebc90e]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:48:10 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6f1d2410-87ec-4a59-8f85-b0550ea0a239 tempest-TestStampPattern-580697789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a6eaf836-5be5-4ea9-a3b4-497ffeaa19df.8781d896-20dd-4f26-a8c4-7feb8d88d94e {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:10 devstack sudo[102620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a6eaf836-5be5-4ea9-a3b4-497ffeaa19df.8781d896-20dd-4f26-a8c4-7feb8d88d94e Sep 18 21:48:10 devstack sudo[102620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:10 devstack sudo[102620]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:10 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6f1d2410-87ec-4a59-8f85-b0550ea0a239 tempest-TestStampPattern-580697789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a6eaf836-5be5-4ea9-a3b4-497ffeaa19df.8781d896-20dd-4f26-a8c4-7feb8d88d94e" returned: 0 in 0.376s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:10 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-6f1d2410-87ec-4a59-8f85-b0550ea0a239 tempest-TestStampPattern-580697789 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a6eaf836-5be5-4ea9-a3b4-497ffeaa19df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86136) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 21:48:10 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[da82f5f4-618a-418d-b79c-bd16f5d998e0]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:48:10 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6f1d2410-87ec-4a59-8f85-b0550ea0a239 tempest-TestStampPattern-580697789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a6eaf836-5be5-4ea9-a3b4-497ffeaa19df {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:11 devstack sudo[102626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a6eaf836-5be5-4ea9-a3b4-497ffeaa19df Sep 18 21:48:11 devstack sudo[102626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:11 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fc58a89-e4f1-4653-a8a7-5ee20a8b2c80 tempest-ProjectReaderTests-1404803890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:48:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2fc58a89-e4f1-4653-a8a7-5ee20a8b2c80 tempest-ProjectReaderTests-1404803890 None] Flow 'volume_create_manager' (226603c0-5254-4090-97d6-ec8861dc828d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:48:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2fc58a89-e4f1-4653-a8a7-5ee20a8b2c80 tempest-ProjectReaderTests-1404803890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b661170-8c77-4ede-bcdf-fcdeeeae4a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2fc58a89-e4f1-4653-a8a7-5ee20a8b2c80 tempest-ProjectReaderTests-1404803890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b661170-8c77-4ede-bcdf-fcdeeeae4a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:48:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-475932687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59d2fc1a-cce2-4d9f-99f6-469ab16dede2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a097af78d4124cd49bb52715285be18b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:48:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:48:11Z,use_quota=True,user_id='1d900393f22747d3a02b32672000a36a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2fc58a89-e4f1-4653-a8a7-5ee20a8b2c80 tempest-ProjectReaderTests-1404803890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f95a04d9-b047-4155-99cd-721a4124178a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2fc58a89-e4f1-4653-a8a7-5ee20a8b2c80 tempest-ProjectReaderTests-1404803890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f95a04d9-b047-4155-99cd-721a4124178a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2fc58a89-e4f1-4653-a8a7-5ee20a8b2c80 tempest-ProjectReaderTests-1404803890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b62ab256-3340-4643-875d-74a3f77789bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2fc58a89-e4f1-4653-a8a7-5ee20a8b2c80 tempest-ProjectReaderTests-1404803890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b62ab256-3340-4643-875d-74a3f77789bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59d2fc1a-cce2-4d9f-99f6-469ab16dede2', 'volume_name': 'volume-59d2fc1a-cce2-4d9f-99f6-469ab16dede2', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2fc58a89-e4f1-4653-a8a7-5ee20a8b2c80 tempest-ProjectReaderTests-1404803890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42b37832-b7f1-4fb0-8c6c-8d794227a5bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2fc58a89-e4f1-4653-a8a7-5ee20a8b2c80 tempest-ProjectReaderTests-1404803890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42b37832-b7f1-4fb0-8c6c-8d794227a5bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2fc58a89-e4f1-4653-a8a7-5ee20a8b2c80 tempest-ProjectReaderTests-1404803890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47c4159d-d5fc-4779-bc23-f51c13d15cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:11 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-2fc58a89-e4f1-4653-a8a7-5ee20a8b2c80 tempest-ProjectReaderTests-1404803890 None] Volume 59d2fc1a-cce2-4d9f-99f6-469ab16dede2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59d2fc1a-cce2-4d9f-99f6-469ab16dede2', 'volume_size': 1} Sep 18 21:48:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-2fc58a89-e4f1-4653-a8a7-5ee20a8b2c80 tempest-ProjectReaderTests-1404803890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:48:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-2fc58a89-e4f1-4653-a8a7-5ee20a8b2c80 tempest-ProjectReaderTests-1404803890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:48:11 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-2fc58a89-e4f1-4653-a8a7-5ee20a8b2c80 tempest-ProjectReaderTests-1404803890 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:48:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-475932687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59d2fc1a-cce2-4d9f-99f6-469ab16dede2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a097af78d4124cd49bb52715285be18b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:48:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:48:11Z,use_quota=True,user_id='1d900393f22747d3a02b32672000a36a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:48:11 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-2fc58a89-e4f1-4653-a8a7-5ee20a8b2c80 tempest-ProjectReaderTests-1404803890 None] Creating volume 59d2fc1a-cce2-4d9f-99f6-469ab16dede2 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:48:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-2fc58a89-e4f1-4653-a8a7-5ee20a8b2c80 tempest-ProjectReaderTests-1404803890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:48:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-2fc58a89-e4f1-4653-a8a7-5ee20a8b2c80 tempest-ProjectReaderTests-1404803890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:48:11 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-2fc58a89-e4f1-4653-a8a7-5ee20a8b2c80 tempest-ProjectReaderTests-1404803890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:48:11 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-2fc58a89-e4f1-4653-a8a7-5ee20a8b2c80 tempest-ProjectReaderTests-1404803890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:48:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-2fc58a89-e4f1-4653-a8a7-5ee20a8b2c80 tempest-ProjectReaderTests-1404803890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:48:11 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-2fc58a89-e4f1-4653-a8a7-5ee20a8b2c80 tempest-ProjectReaderTests-1404803890 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:48:11 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-2fc58a89-e4f1-4653-a8a7-5ee20a8b2c80 tempest-ProjectReaderTests-1404803890 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:48:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-2fc58a89-e4f1-4653-a8a7-5ee20a8b2c80 tempest-ProjectReaderTests-1404803890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-59d2fc1a-cce2-4d9f-99f6-469ab16dede2 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:11 devstack sudo[102630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-59d2fc1a-cce2-4d9f-99f6-469ab16dede2 1073741824 Sep 18 21:48:11 devstack sudo[102630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:11 devstack sudo[102626]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6f1d2410-87ec-4a59-8f85-b0550ea0a239 tempest-TestStampPattern-580697789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a6eaf836-5be5-4ea9-a3b4-497ffeaa19df" returned: 0 in 0.637s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6f1d2410-87ec-4a59-8f85-b0550ea0a239 tempest-TestStampPattern-580697789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a6eaf836-5be5-4ea9-a3b4-497ffeaa19df.8781d896-20dd-4f26-a8c4-7feb8d88d94e {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:11 devstack sudo[102633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a6eaf836-5be5-4ea9-a3b4-497ffeaa19df.8781d896-20dd-4f26-a8c4-7feb8d88d94e Sep 18 21:48:11 devstack sudo[102633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:11 devstack sudo[102630]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-2fc58a89-e4f1-4653-a8a7-5ee20a8b2c80 tempest-ProjectReaderTests-1404803890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-59d2fc1a-cce2-4d9f-99f6-469ab16dede2 1073741824" returned: 0 in 0.519s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-2fc58a89-e4f1-4653-a8a7-5ee20a8b2c80 tempest-ProjectReaderTests-1404803890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-59d2fc1a-cce2-4d9f-99f6-469ab16dede2 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:11 devstack sudo[102642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-59d2fc1a-cce2-4d9f-99f6-469ab16dede2 Sep 18 21:48:11 devstack sudo[102642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:11 devstack sudo[102633]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6f1d2410-87ec-4a59-8f85-b0550ea0a239 tempest-TestStampPattern-580697789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a6eaf836-5be5-4ea9-a3b4-497ffeaa19df.8781d896-20dd-4f26-a8c4-7feb8d88d94e" returned: 0 in 0.419s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6f1d2410-87ec-4a59-8f85-b0550ea0a239 tempest-TestStampPattern-580697789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a6eaf836-5be5-4ea9-a3b4-497ffeaa19df.8781d896-20dd-4f26-a8c4-7feb8d88d94e {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:11 devstack sudo[102644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a6eaf836-5be5-4ea9-a3b4-497ffeaa19df.8781d896-20dd-4f26-a8c4-7feb8d88d94e Sep 18 21:48:11 devstack sudo[102644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:12 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c8f16d4-6354-46f1-87b9-7fae74ba857e tempest-VolumesGetTest-2025585433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:48:12 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6c8f16d4-6354-46f1-87b9-7fae74ba857e tempest-VolumesGetTest-2025585433 None] Flow 'volume_create_manager' (9335cbe9-c1fc-4974-849c-7d821e240fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:48:12 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6c8f16d4-6354-46f1-87b9-7fae74ba857e tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edec4322-27b5-4513-ad29-606130809af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:12 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6c8f16d4-6354-46f1-87b9-7fae74ba857e tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edec4322-27b5-4513-ad29-606130809af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:48:12Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-876157637',display_name='tempest-VolumesGetTest-Volume-1339902990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60ca81b4-00ba-4664-bb77-b89498cbcb04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6cd15df09da425c84d7c465a1bd7b81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:48:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:48:12Z,use_quota=True,user_id='93d906f234b946cea603ec1bfebe96ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:12 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6c8f16d4-6354-46f1-87b9-7fae74ba857e tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da063451-8fcb-4036-ab63-2b182ff4dd62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:12 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6c8f16d4-6354-46f1-87b9-7fae74ba857e tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da063451-8fcb-4036-ab63-2b182ff4dd62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:12 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6c8f16d4-6354-46f1-87b9-7fae74ba857e tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00011d7b-4f6b-4f63-a52c-e7f6c705e641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:12 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6c8f16d4-6354-46f1-87b9-7fae74ba857e tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00011d7b-4f6b-4f63-a52c-e7f6c705e641) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60ca81b4-00ba-4664-bb77-b89498cbcb04', 'volume_name': 'volume-60ca81b4-00ba-4664-bb77-b89498cbcb04', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:12 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6c8f16d4-6354-46f1-87b9-7fae74ba857e tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a244c54f-5baf-4c47-b1ca-49e93c742011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:12 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6c8f16d4-6354-46f1-87b9-7fae74ba857e tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a244c54f-5baf-4c47-b1ca-49e93c742011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:12 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6c8f16d4-6354-46f1-87b9-7fae74ba857e tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfb0889f-038f-4c0f-8b9c-55083d083e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:12 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-6c8f16d4-6354-46f1-87b9-7fae74ba857e tempest-VolumesGetTest-2025585433 None] Volume 60ca81b4-00ba-4664-bb77-b89498cbcb04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60ca81b4-00ba-4664-bb77-b89498cbcb04', 'volume_size': 1} Sep 18 21:48:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6c8f16d4-6354-46f1-87b9-7fae74ba857e tempest-VolumesGetTest-2025585433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:48:12 devstack sudo[102642]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-2fc58a89-e4f1-4653-a8a7-5ee20a8b2c80 tempest-ProjectReaderTests-1404803890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-59d2fc1a-cce2-4d9f-99f6-469ab16dede2" returned: 0 in 0.282s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:12 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-2fc58a89-e4f1-4653-a8a7-5ee20a8b2c80 tempest-ProjectReaderTests-1404803890 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:48:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-2fc58a89-e4f1-4653-a8a7-5ee20a8b2c80 tempest-ProjectReaderTests-1404803890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:48:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6c8f16d4-6354-46f1-87b9-7fae74ba857e tempest-VolumesGetTest-2025585433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.082s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:48:12 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-6c8f16d4-6354-46f1-87b9-7fae74ba857e tempest-VolumesGetTest-2025585433 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:48:12Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-876157637',display_name='tempest-VolumesGetTest-Volume-1339902990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60ca81b4-00ba-4664-bb77-b89498cbcb04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6cd15df09da425c84d7c465a1bd7b81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:48:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:48:12Z,use_quota=True,user_id='93d906f234b946cea603ec1bfebe96ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:48:12 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-6c8f16d4-6354-46f1-87b9-7fae74ba857e tempest-VolumesGetTest-2025585433 None] Creating volume 60ca81b4-00ba-4664-bb77-b89498cbcb04 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:48:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6c8f16d4-6354-46f1-87b9-7fae74ba857e tempest-VolumesGetTest-2025585433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:48:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6c8f16d4-6354-46f1-87b9-7fae74ba857e tempest-VolumesGetTest-2025585433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:48:12 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-6c8f16d4-6354-46f1-87b9-7fae74ba857e tempest-VolumesGetTest-2025585433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:48:12 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-6c8f16d4-6354-46f1-87b9-7fae74ba857e tempest-VolumesGetTest-2025585433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:48:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6c8f16d4-6354-46f1-87b9-7fae74ba857e tempest-VolumesGetTest-2025585433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:48:12 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-6c8f16d4-6354-46f1-87b9-7fae74ba857e tempest-VolumesGetTest-2025585433 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:48:12 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-6c8f16d4-6354-46f1-87b9-7fae74ba857e tempest-VolumesGetTest-2025585433 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:48:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6c8f16d4-6354-46f1-87b9-7fae74ba857e tempest-VolumesGetTest-2025585433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-60ca81b4-00ba-4664-bb77-b89498cbcb04 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:12 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2fc58a89-e4f1-4653-a8a7-5ee20a8b2c80 tempest-ProjectReaderTests-1404803890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47c4159d-d5fc-4779-bc23-f51c13d15cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59d2fc1a-cce2-4d9f-99f6-469ab16dede2', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:12 devstack sudo[102648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-60ca81b4-00ba-4664-bb77-b89498cbcb04 1073741824 Sep 18 21:48:12 devstack sudo[102648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:12 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2fc58a89-e4f1-4653-a8a7-5ee20a8b2c80 tempest-ProjectReaderTests-1404803890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a77e15a6-c2a7-48b6-b317-535d36801ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:12 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-2fc58a89-e4f1-4653-a8a7-5ee20a8b2c80 tempest-ProjectReaderTests-1404803890 None] Volume volume-59d2fc1a-cce2-4d9f-99f6-469ab16dede2 (59d2fc1a-cce2-4d9f-99f6-469ab16dede2): created successfully Sep 18 21:48:12 devstack sudo[102644]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:12 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2fc58a89-e4f1-4653-a8a7-5ee20a8b2c80 tempest-ProjectReaderTests-1404803890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a77e15a6-c2a7-48b6-b317-535d36801ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:12 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2fc58a89-e4f1-4653-a8a7-5ee20a8b2c80 tempest-ProjectReaderTests-1404803890 None] Flow 'volume_create_manager' (226603c0-5254-4090-97d6-ec8861dc828d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:48:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6f1d2410-87ec-4a59-8f85-b0550ea0a239 tempest-TestStampPattern-580697789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a6eaf836-5be5-4ea9-a3b4-497ffeaa19df.8781d896-20dd-4f26-a8c4-7feb8d88d94e" returned: 0 in 0.297s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:12 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-2fc58a89-e4f1-4653-a8a7-5ee20a8b2c80 tempest-ProjectReaderTests-1404803890 None] Created volume successfully. Sep 18 21:48:12 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-6f1d2410-87ec-4a59-8f85-b0550ea0a239 tempest-TestStampPattern-580697789 None] Lock "cinder-quobyte-8781d896-20dd-4f26-a8c4-7feb8d88d94e" released by "_delete_snapshot" :: held 1.851s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:48:12 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-6f1d2410-87ec-4a59-8f85-b0550ea0a239 tempest-TestStampPattern-580697789 None] Lock "cinder-quobyte-a6eaf836-5be5-4ea9-a3b4-497ffeaa19df" released by "delete_snapshot" :: held 1.874s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:48:12 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-6f1d2410-87ec-4a59-8f85-b0550ea0a239 tempest-TestStampPattern-580697789 None] Created reservations ['28d39304-bd7c-44b2-824e-a61bc38780af', '92604e0e-8c13-429f-a5ac-288694f51290', '5e0dcf77-1ed4-48cb-84eb-7294c321b758', 'e8d1d954-cc90-458f-9866-91d38f24543c'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:48:12 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-6f1d2410-87ec-4a59-8f85-b0550ea0a239 tempest-TestStampPattern-580697789 None] Delete snapshot completed successfully. Sep 18 21:48:12 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-6f1d2410-87ec-4a59-8f85-b0550ea0a239 tempest-TestStampPattern-580697789 None] Lock "cinder-8781d896-20dd-4f26-a8c4-7feb8d88d94e-delete_snapshot" released by "delete_snapshot" :: held 2.000s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:48:12 devstack sudo[102648]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6c8f16d4-6354-46f1-87b9-7fae74ba857e tempest-VolumesGetTest-2025585433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-60ca81b4-00ba-4664-bb77-b89498cbcb04 1073741824" returned: 0 in 0.440s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6c8f16d4-6354-46f1-87b9-7fae74ba857e tempest-VolumesGetTest-2025585433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-60ca81b4-00ba-4664-bb77-b89498cbcb04 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:12 devstack sudo[102653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-60ca81b4-00ba-4664-bb77-b89498cbcb04 Sep 18 21:48:12 devstack sudo[102653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:13 devstack sudo[102653]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6c8f16d4-6354-46f1-87b9-7fae74ba857e tempest-VolumesGetTest-2025585433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-60ca81b4-00ba-4664-bb77-b89498cbcb04" returned: 0 in 0.272s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:13 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-6c8f16d4-6354-46f1-87b9-7fae74ba857e tempest-VolumesGetTest-2025585433 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:48:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6c8f16d4-6354-46f1-87b9-7fae74ba857e tempest-VolumesGetTest-2025585433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:48:13 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6c8f16d4-6354-46f1-87b9-7fae74ba857e tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfb0889f-038f-4c0f-8b9c-55083d083e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60ca81b4-00ba-4664-bb77-b89498cbcb04', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:13 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6c8f16d4-6354-46f1-87b9-7fae74ba857e tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88a2980e-6aa7-45a4-affc-e4e3a6986356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:13 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-6c8f16d4-6354-46f1-87b9-7fae74ba857e tempest-VolumesGetTest-2025585433 None] Volume volume-60ca81b4-00ba-4664-bb77-b89498cbcb04 (60ca81b4-00ba-4664-bb77-b89498cbcb04): created successfully Sep 18 21:48:13 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6c8f16d4-6354-46f1-87b9-7fae74ba857e tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88a2980e-6aa7-45a4-affc-e4e3a6986356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:13 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6c8f16d4-6354-46f1-87b9-7fae74ba857e tempest-VolumesGetTest-2025585433 None] Flow 'volume_create_manager' (9335cbe9-c1fc-4974-849c-7d821e240fc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:48:13 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-6c8f16d4-6354-46f1-87b9-7fae74ba857e tempest-VolumesGetTest-2025585433 None] Created volume successfully. Sep 18 21:48:13 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-8cbcc3ef-2017-4852-a34b-832b780557d9 tempest-ProjectReaderTests-1404803890 None] Acquiring lock "cinder-59d2fc1a-cce2-4d9f-99f6-469ab16dede2-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:48:13 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-8cbcc3ef-2017-4852-a34b-832b780557d9 tempest-ProjectReaderTests-1404803890 None] Lock "cinder-59d2fc1a-cce2-4d9f-99f6-469ab16dede2-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:48:13 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-8cbcc3ef-2017-4852-a34b-832b780557d9 tempest-ProjectReaderTests-1404803890 None] Acquiring lock "cinder-quobyte-59d2fc1a-cce2-4d9f-99f6-469ab16dede2" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:48:13 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-8cbcc3ef-2017-4852-a34b-832b780557d9 tempest-ProjectReaderTests-1404803890 None] Lock "cinder-quobyte-59d2fc1a-cce2-4d9f-99f6-469ab16dede2" acquired by "delete_volume" :: waited 0.017s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:48:13 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[b122a65b-fb47-4890-981a-5d439b3d908b]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:48:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-8cbcc3ef-2017-4852-a34b-832b780557d9 tempest-ProjectReaderTests-1404803890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-59d2fc1a-cce2-4d9f-99f6-469ab16dede2 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:13 devstack sudo[102659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-59d2fc1a-cce2-4d9f-99f6-469ab16dede2 Sep 18 21:48:13 devstack sudo[102659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:14 devstack sudo[102659]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-8cbcc3ef-2017-4852-a34b-832b780557d9 tempest-ProjectReaderTests-1404803890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-59d2fc1a-cce2-4d9f-99f6-469ab16dede2" returned: 0 in 0.616s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-8cbcc3ef-2017-4852-a34b-832b780557d9 tempest-ProjectReaderTests-1404803890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-59d2fc1a-cce2-4d9f-99f6-469ab16dede2 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:14 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-fd859467-3041-439f-9e8d-a1d10bd59c9d tempest-VolumesGetTest-2025585433 None] Acquiring lock "cinder-60ca81b4-00ba-4664-bb77-b89498cbcb04-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:48:14 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-fd859467-3041-439f-9e8d-a1d10bd59c9d tempest-VolumesGetTest-2025585433 None] Lock "cinder-60ca81b4-00ba-4664-bb77-b89498cbcb04-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:48:14 devstack sudo[102684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-59d2fc1a-cce2-4d9f-99f6-469ab16dede2 Sep 18 21:48:14 devstack sudo[102684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:14 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-fd859467-3041-439f-9e8d-a1d10bd59c9d tempest-VolumesGetTest-2025585433 None] Acquiring lock "cinder-quobyte-60ca81b4-00ba-4664-bb77-b89498cbcb04" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:48:14 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-fd859467-3041-439f-9e8d-a1d10bd59c9d tempest-VolumesGetTest-2025585433 None] Lock "cinder-quobyte-60ca81b4-00ba-4664-bb77-b89498cbcb04" acquired by "delete_volume" :: waited 0.024s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:48:14 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc7312a3-a44a-42d9-8502-cc9a6ba8e622]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:48:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-fd859467-3041-439f-9e8d-a1d10bd59c9d tempest-VolumesGetTest-2025585433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-60ca81b4-00ba-4664-bb77-b89498cbcb04 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:14 devstack sudo[102687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-60ca81b4-00ba-4664-bb77-b89498cbcb04 Sep 18 21:48:14 devstack sudo[102687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:14 devstack sudo[102684]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-8cbcc3ef-2017-4852-a34b-832b780557d9 tempest-ProjectReaderTests-1404803890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-59d2fc1a-cce2-4d9f-99f6-469ab16dede2" returned: 0 in 0.329s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:14 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-8cbcc3ef-2017-4852-a34b-832b780557d9 tempest-ProjectReaderTests-1404803890 None] Lock "cinder-quobyte-59d2fc1a-cce2-4d9f-99f6-469ab16dede2" released by "delete_volume" :: held 1.021s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:48:14 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-8cbcc3ef-2017-4852-a34b-832b780557d9 tempest-ProjectReaderTests-1404803890 None] Created reservations ['a53a0a63-6a37-4b9f-a369-9c495a08a695', '11af1ea3-b8e7-453b-8ad3-ec7a685b8582', '43132693-54ae-4791-ad40-50f7fe4a593a', 'bba46d37-6713-4670-9d43-e11ee2be9628'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:48:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-8cbcc3ef-2017-4852-a34b-832b780557d9 tempest-ProjectReaderTests-1404803890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:48:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-8cbcc3ef-2017-4852-a34b-832b780557d9 tempest-ProjectReaderTests-1404803890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:48:14 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-8cbcc3ef-2017-4852-a34b-832b780557d9 tempest-ProjectReaderTests-1404803890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:48:14 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-8cbcc3ef-2017-4852-a34b-832b780557d9 tempest-ProjectReaderTests-1404803890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:48:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-8cbcc3ef-2017-4852-a34b-832b780557d9 tempest-ProjectReaderTests-1404803890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:48:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-8cbcc3ef-2017-4852-a34b-832b780557d9 tempest-ProjectReaderTests-1404803890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:14 devstack sudo[102692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:48:14 devstack sudo[102692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:14 devstack sudo[102687]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-fd859467-3041-439f-9e8d-a1d10bd59c9d tempest-VolumesGetTest-2025585433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-60ca81b4-00ba-4664-bb77-b89498cbcb04" returned: 0 in 0.424s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-fd859467-3041-439f-9e8d-a1d10bd59c9d tempest-VolumesGetTest-2025585433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-60ca81b4-00ba-4664-bb77-b89498cbcb04 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:14 devstack sudo[102695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-60ca81b4-00ba-4664-bb77-b89498cbcb04 Sep 18 21:48:14 devstack sudo[102695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:15 devstack sudo[102692]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-8cbcc3ef-2017-4852-a34b-832b780557d9 tempest-ProjectReaderTests-1404803890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.308s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:15 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-8cbcc3ef-2017-4852-a34b-832b780557d9 tempest-ProjectReaderTests-1404803890 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:48:15 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-8cbcc3ef-2017-4852-a34b-832b780557d9 tempest-ProjectReaderTests-1404803890 None] Deleted volume successfully. Sep 18 21:48:15 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-8cbcc3ef-2017-4852-a34b-832b780557d9 tempest-ProjectReaderTests-1404803890 None] Lock "cinder-59d2fc1a-cce2-4d9f-99f6-469ab16dede2-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:48:15 devstack sudo[102695]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-fd859467-3041-439f-9e8d-a1d10bd59c9d tempest-VolumesGetTest-2025585433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-60ca81b4-00ba-4664-bb77-b89498cbcb04" returned: 0 in 0.297s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:15 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-fd859467-3041-439f-9e8d-a1d10bd59c9d tempest-VolumesGetTest-2025585433 None] Lock "cinder-quobyte-60ca81b4-00ba-4664-bb77-b89498cbcb04" released by "delete_volume" :: held 0.780s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:48:15 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-fd859467-3041-439f-9e8d-a1d10bd59c9d tempest-VolumesGetTest-2025585433 None] Created reservations ['62d401c7-1dcc-493d-bc9f-85f237f4cf88', 'd10ce044-287f-4d36-8f0e-f946abb5adb2', 'd3a42676-681d-47d4-9622-de0183927176', 'c568fdf8-cc40-4ff4-8f72-9ef5bbfb4c92'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:48:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-fd859467-3041-439f-9e8d-a1d10bd59c9d tempest-VolumesGetTest-2025585433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:48:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-fd859467-3041-439f-9e8d-a1d10bd59c9d tempest-VolumesGetTest-2025585433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:48:15 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-fd859467-3041-439f-9e8d-a1d10bd59c9d tempest-VolumesGetTest-2025585433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:48:15 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-fd859467-3041-439f-9e8d-a1d10bd59c9d tempest-VolumesGetTest-2025585433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:48:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-fd859467-3041-439f-9e8d-a1d10bd59c9d tempest-VolumesGetTest-2025585433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:48:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-fd859467-3041-439f-9e8d-a1d10bd59c9d tempest-VolumesGetTest-2025585433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:15 devstack sudo[102701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:48:15 devstack sudo[102701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:15 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-6b952b52-e123-4808-b20c-8624311f10f4 tempest-VolumesGetTest-2025585433 None] Acquiring lock "cinder-effe7413-1350-4242-9944-c9672fd6d9bc-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:48:15 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-6b952b52-e123-4808-b20c-8624311f10f4 tempest-VolumesGetTest-2025585433 None] Lock "cinder-effe7413-1350-4242-9944-c9672fd6d9bc-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:48:15 devstack sudo[102701]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:15 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-6b952b52-e123-4808-b20c-8624311f10f4 tempest-VolumesGetTest-2025585433 None] Acquiring lock "cinder-quobyte-effe7413-1350-4242-9944-c9672fd6d9bc" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:48:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-fd859467-3041-439f-9e8d-a1d10bd59c9d tempest-VolumesGetTest-2025585433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.329s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:15 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-fd859467-3041-439f-9e8d-a1d10bd59c9d tempest-VolumesGetTest-2025585433 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:48:15 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-fd859467-3041-439f-9e8d-a1d10bd59c9d tempest-VolumesGetTest-2025585433 None] Deleted volume successfully. Sep 18 21:48:15 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-6b952b52-e123-4808-b20c-8624311f10f4 tempest-VolumesGetTest-2025585433 None] Lock "cinder-quobyte-effe7413-1350-4242-9944-c9672fd6d9bc" acquired by "delete_volume" :: waited 0.036s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:48:15 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-fd859467-3041-439f-9e8d-a1d10bd59c9d tempest-VolumesGetTest-2025585433 None] Lock "cinder-60ca81b4-00ba-4664-bb77-b89498cbcb04-delete_volume" released by "delete_volume" :: held 1.433s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:48:15 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[212ba2a2-6973-4fd2-ab7b-a8ddd16f42db]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:48:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6b952b52-e123-4808-b20c-8624311f10f4 tempest-VolumesGetTest-2025585433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-effe7413-1350-4242-9944-c9672fd6d9bc {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:15 devstack sudo[102705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-effe7413-1350-4242-9944-c9672fd6d9bc Sep 18 21:48:15 devstack sudo[102705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:16 devstack sudo[102705]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6b952b52-e123-4808-b20c-8624311f10f4 tempest-VolumesGetTest-2025585433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-effe7413-1350-4242-9944-c9672fd6d9bc" returned: 0 in 0.387s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6b952b52-e123-4808-b20c-8624311f10f4 tempest-VolumesGetTest-2025585433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-effe7413-1350-4242-9944-c9672fd6d9bc {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:16 devstack sudo[102710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-effe7413-1350-4242-9944-c9672fd6d9bc Sep 18 21:48:16 devstack sudo[102710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:16 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6951939-b092-40ea-9fd6-df7bcc368c10 tempest-ProjectReaderTests-1404803890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:48:16 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c6951939-b092-40ea-9fd6-df7bcc368c10 tempest-ProjectReaderTests-1404803890 None] Flow 'volume_create_manager' (2ebf04d0-9d53-4cca-96e9-1bccc59732fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:48:16 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c6951939-b092-40ea-9fd6-df7bcc368c10 tempest-ProjectReaderTests-1404803890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ab940fe-3f87-49c9-975c-269632b21152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:16 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c6951939-b092-40ea-9fd6-df7bcc368c10 tempest-ProjectReaderTests-1404803890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ab940fe-3f87-49c9-975c-269632b21152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:48:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-65071896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e52e6c4-9d22-46ee-929d-ff402d541bf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a097af78d4124cd49bb52715285be18b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:48:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:48:16Z,use_quota=True,user_id='1d900393f22747d3a02b32672000a36a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:16 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c6951939-b092-40ea-9fd6-df7bcc368c10 tempest-ProjectReaderTests-1404803890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (754e048f-f9bf-41bf-9434-be28d6a1e8b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:16 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c6951939-b092-40ea-9fd6-df7bcc368c10 tempest-ProjectReaderTests-1404803890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (754e048f-f9bf-41bf-9434-be28d6a1e8b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:16 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c6951939-b092-40ea-9fd6-df7bcc368c10 tempest-ProjectReaderTests-1404803890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f2ea0a0-4df9-4276-8892-78bffb70bb4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:16 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c6951939-b092-40ea-9fd6-df7bcc368c10 tempest-ProjectReaderTests-1404803890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f2ea0a0-4df9-4276-8892-78bffb70bb4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e52e6c4-9d22-46ee-929d-ff402d541bf3', 'volume_name': 'volume-1e52e6c4-9d22-46ee-929d-ff402d541bf3', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:16 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c6951939-b092-40ea-9fd6-df7bcc368c10 tempest-ProjectReaderTests-1404803890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27cdc5e4-52d5-413a-9ee3-ae4d23ef33b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:16 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c6951939-b092-40ea-9fd6-df7bcc368c10 tempest-ProjectReaderTests-1404803890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27cdc5e4-52d5-413a-9ee3-ae4d23ef33b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:16 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c6951939-b092-40ea-9fd6-df7bcc368c10 tempest-ProjectReaderTests-1404803890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (364759de-80be-466d-8736-ecba1fa8c066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:16 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-c6951939-b092-40ea-9fd6-df7bcc368c10 tempest-ProjectReaderTests-1404803890 None] Volume 1e52e6c4-9d22-46ee-929d-ff402d541bf3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e52e6c4-9d22-46ee-929d-ff402d541bf3', 'volume_size': 1} Sep 18 21:48:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c6951939-b092-40ea-9fd6-df7bcc368c10 tempest-ProjectReaderTests-1404803890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:48:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c6951939-b092-40ea-9fd6-df7bcc368c10 tempest-ProjectReaderTests-1404803890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:48:16 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-c6951939-b092-40ea-9fd6-df7bcc368c10 tempest-ProjectReaderTests-1404803890 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:48:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-65071896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e52e6c4-9d22-46ee-929d-ff402d541bf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a097af78d4124cd49bb52715285be18b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:48:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:48:16Z,use_quota=True,user_id='1d900393f22747d3a02b32672000a36a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:48:16 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-c6951939-b092-40ea-9fd6-df7bcc368c10 tempest-ProjectReaderTests-1404803890 None] Creating volume 1e52e6c4-9d22-46ee-929d-ff402d541bf3 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:48:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c6951939-b092-40ea-9fd6-df7bcc368c10 tempest-ProjectReaderTests-1404803890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:48:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c6951939-b092-40ea-9fd6-df7bcc368c10 tempest-ProjectReaderTests-1404803890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:48:16 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-c6951939-b092-40ea-9fd6-df7bcc368c10 tempest-ProjectReaderTests-1404803890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:48:16 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-c6951939-b092-40ea-9fd6-df7bcc368c10 tempest-ProjectReaderTests-1404803890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:48:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c6951939-b092-40ea-9fd6-df7bcc368c10 tempest-ProjectReaderTests-1404803890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:48:16 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-c6951939-b092-40ea-9fd6-df7bcc368c10 tempest-ProjectReaderTests-1404803890 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:48:16 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-c6951939-b092-40ea-9fd6-df7bcc368c10 tempest-ProjectReaderTests-1404803890 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:48:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c6951939-b092-40ea-9fd6-df7bcc368c10 tempest-ProjectReaderTests-1404803890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-1e52e6c4-9d22-46ee-929d-ff402d541bf3 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:16 devstack sudo[102712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-1e52e6c4-9d22-46ee-929d-ff402d541bf3 1073741824 Sep 18 21:48:16 devstack sudo[102712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:16 devstack sudo[102710]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6b952b52-e123-4808-b20c-8624311f10f4 tempest-VolumesGetTest-2025585433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-effe7413-1350-4242-9944-c9672fd6d9bc" returned: 0 in 0.258s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:16 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-6b952b52-e123-4808-b20c-8624311f10f4 tempest-VolumesGetTest-2025585433 None] Lock "cinder-quobyte-effe7413-1350-4242-9944-c9672fd6d9bc" released by "delete_volume" :: held 0.718s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:48:16 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-16e81187-a953-4833-9747-d7db595524ce tempest-TestStampPattern-580697789 None] Acquiring lock "cinder-a6eaf836-5be5-4ea9-a3b4-497ffeaa19df-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:48:16 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-16e81187-a953-4833-9747-d7db595524ce tempest-TestStampPattern-580697789 None] Lock "cinder-a6eaf836-5be5-4ea9-a3b4-497ffeaa19df-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:48:16 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-6b952b52-e123-4808-b20c-8624311f10f4 tempest-VolumesGetTest-2025585433 None] Created reservations ['4242a2ac-71ba-4583-abaf-bbcc4f45640f', '03834c6e-3ed2-470d-9ffa-5271ce5d6f83', '9e72db08-1054-4131-b3a7-94573be433cb', 'e6f7d189-414e-48ae-a5fe-95e2e5943bb8'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:48:16 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-16e81187-a953-4833-9747-d7db595524ce tempest-TestStampPattern-580697789 None] Acquiring lock "cinder-quobyte-a6eaf836-5be5-4ea9-a3b4-497ffeaa19df" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:48:16 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-16e81187-a953-4833-9747-d7db595524ce tempest-TestStampPattern-580697789 None] Lock "cinder-quobyte-a6eaf836-5be5-4ea9-a3b4-497ffeaa19df" acquired by "delete_volume" :: waited 0.019s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:48:16 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[679f1a2a-1094-4970-ac3f-b937ac431c35]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:48:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-16e81187-a953-4833-9747-d7db595524ce tempest-TestStampPattern-580697789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a6eaf836-5be5-4ea9-a3b4-497ffeaa19df {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6b952b52-e123-4808-b20c-8624311f10f4 tempest-VolumesGetTest-2025585433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:48:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6b952b52-e123-4808-b20c-8624311f10f4 tempest-VolumesGetTest-2025585433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:48:16 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-6b952b52-e123-4808-b20c-8624311f10f4 tempest-VolumesGetTest-2025585433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:48:16 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-6b952b52-e123-4808-b20c-8624311f10f4 tempest-VolumesGetTest-2025585433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:48:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6b952b52-e123-4808-b20c-8624311f10f4 tempest-VolumesGetTest-2025585433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:48:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6b952b52-e123-4808-b20c-8624311f10f4 tempest-VolumesGetTest-2025585433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:16 devstack sudo[102719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:48:16 devstack sudo[102719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:16 devstack sudo[102718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a6eaf836-5be5-4ea9-a3b4-497ffeaa19df Sep 18 21:48:16 devstack sudo[102718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:16 devstack sudo[102712]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c6951939-b092-40ea-9fd6-df7bcc368c10 tempest-ProjectReaderTests-1404803890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-1e52e6c4-9d22-46ee-929d-ff402d541bf3 1073741824" returned: 0 in 0.511s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c6951939-b092-40ea-9fd6-df7bcc368c10 tempest-ProjectReaderTests-1404803890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-1e52e6c4-9d22-46ee-929d-ff402d541bf3 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:16 devstack sudo[102723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-1e52e6c4-9d22-46ee-929d-ff402d541bf3 Sep 18 21:48:16 devstack sudo[102723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:16 devstack sudo[102719]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6b952b52-e123-4808-b20c-8624311f10f4 tempest-VolumesGetTest-2025585433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.317s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:17 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-6b952b52-e123-4808-b20c-8624311f10f4 tempest-VolumesGetTest-2025585433 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:48:17 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-6b952b52-e123-4808-b20c-8624311f10f4 tempest-VolumesGetTest-2025585433 None] Deleted volume successfully. Sep 18 21:48:17 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-6b952b52-e123-4808-b20c-8624311f10f4 tempest-VolumesGetTest-2025585433 None] Lock "cinder-effe7413-1350-4242-9944-c9672fd6d9bc-delete_volume" released by "delete_volume" :: held 1.382s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:48:17 devstack sudo[102718]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-16e81187-a953-4833-9747-d7db595524ce tempest-TestStampPattern-580697789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a6eaf836-5be5-4ea9-a3b4-497ffeaa19df" returned: 0 in 0.442s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-16e81187-a953-4833-9747-d7db595524ce tempest-TestStampPattern-580697789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a6eaf836-5be5-4ea9-a3b4-497ffeaa19df {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:17 devstack sudo[102730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a6eaf836-5be5-4ea9-a3b4-497ffeaa19df Sep 18 21:48:17 devstack sudo[102730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:17 devstack sudo[102723]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c6951939-b092-40ea-9fd6-df7bcc368c10 tempest-ProjectReaderTests-1404803890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-1e52e6c4-9d22-46ee-929d-ff402d541bf3" returned: 0 in 0.354s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:17 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-c6951939-b092-40ea-9fd6-df7bcc368c10 tempest-ProjectReaderTests-1404803890 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:48:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c6951939-b092-40ea-9fd6-df7bcc368c10 tempest-ProjectReaderTests-1404803890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:48:17 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c6951939-b092-40ea-9fd6-df7bcc368c10 tempest-ProjectReaderTests-1404803890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (364759de-80be-466d-8736-ecba1fa8c066) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e52e6c4-9d22-46ee-929d-ff402d541bf3', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:17 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c6951939-b092-40ea-9fd6-df7bcc368c10 tempest-ProjectReaderTests-1404803890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9635693e-32c0-4ce0-be4d-f1ed89906283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:17 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-c6951939-b092-40ea-9fd6-df7bcc368c10 tempest-ProjectReaderTests-1404803890 None] Volume volume-1e52e6c4-9d22-46ee-929d-ff402d541bf3 (1e52e6c4-9d22-46ee-929d-ff402d541bf3): created successfully Sep 18 21:48:17 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c6951939-b092-40ea-9fd6-df7bcc368c10 tempest-ProjectReaderTests-1404803890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9635693e-32c0-4ce0-be4d-f1ed89906283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:17 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c6951939-b092-40ea-9fd6-df7bcc368c10 tempest-ProjectReaderTests-1404803890 None] Flow 'volume_create_manager' (2ebf04d0-9d53-4cca-96e9-1bccc59732fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:48:17 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-c6951939-b092-40ea-9fd6-df7bcc368c10 tempest-ProjectReaderTests-1404803890 None] Created volume successfully. Sep 18 21:48:17 devstack sudo[102730]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-16e81187-a953-4833-9747-d7db595524ce tempest-TestStampPattern-580697789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a6eaf836-5be5-4ea9-a3b4-497ffeaa19df" returned: 0 in 0.288s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:17 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-16e81187-a953-4833-9747-d7db595524ce tempest-TestStampPattern-580697789 None] Lock "cinder-quobyte-a6eaf836-5be5-4ea9-a3b4-497ffeaa19df" released by "delete_volume" :: held 0.804s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:48:17 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a5ffb0e-d5b7-4c93-b50d-6d4b0e9a7cac tempest-VolumesGetTest-2025585433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:48:17 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2a5ffb0e-d5b7-4c93-b50d-6d4b0e9a7cac tempest-VolumesGetTest-2025585433 None] Flow 'volume_create_manager' (181933b9-076f-4aeb-a656-8f54eac17011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:48:17 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2a5ffb0e-d5b7-4c93-b50d-6d4b0e9a7cac tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c40de81-0971-4d5d-abe5-ee1e2ecf759f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:17 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2a5ffb0e-d5b7-4c93-b50d-6d4b0e9a7cac tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c40de81-0971-4d5d-abe5-ee1e2ecf759f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:48:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1249738233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baa2eca5-d7f4-4f1f-ae33-3f7865a123a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6cd15df09da425c84d7c465a1bd7b81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:48:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:48:17Z,use_quota=True,user_id='93d906f234b946cea603ec1bfebe96ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:17 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2a5ffb0e-d5b7-4c93-b50d-6d4b0e9a7cac tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a692c59-792f-4115-94eb-71cdc5d076a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:17 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2a5ffb0e-d5b7-4c93-b50d-6d4b0e9a7cac tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a692c59-792f-4115-94eb-71cdc5d076a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:17 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2a5ffb0e-d5b7-4c93-b50d-6d4b0e9a7cac tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef025299-2284-4612-b3f3-ab1e1bf17f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:17 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2a5ffb0e-d5b7-4c93-b50d-6d4b0e9a7cac tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef025299-2284-4612-b3f3-ab1e1bf17f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'baa2eca5-d7f4-4f1f-ae33-3f7865a123a7', 'volume_name': 'volume-baa2eca5-d7f4-4f1f-ae33-3f7865a123a7', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:17 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2a5ffb0e-d5b7-4c93-b50d-6d4b0e9a7cac tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c7f343a-0188-463c-a942-dcc643ddb532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:17 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2a5ffb0e-d5b7-4c93-b50d-6d4b0e9a7cac tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c7f343a-0188-463c-a942-dcc643ddb532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:17 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2a5ffb0e-d5b7-4c93-b50d-6d4b0e9a7cac tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d16cf572-742c-43ba-93fb-fae0b0a4daaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:17 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-2a5ffb0e-d5b7-4c93-b50d-6d4b0e9a7cac tempest-VolumesGetTest-2025585433 None] Volume baa2eca5-d7f4-4f1f-ae33-3f7865a123a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-baa2eca5-d7f4-4f1f-ae33-3f7865a123a7', 'volume_size': 1} Sep 18 21:48:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-2a5ffb0e-d5b7-4c93-b50d-6d4b0e9a7cac tempest-VolumesGetTest-2025585433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:48:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-2a5ffb0e-d5b7-4c93-b50d-6d4b0e9a7cac tempest-VolumesGetTest-2025585433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:48:17 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-2a5ffb0e-d5b7-4c93-b50d-6d4b0e9a7cac tempest-VolumesGetTest-2025585433 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:48:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1249738233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baa2eca5-d7f4-4f1f-ae33-3f7865a123a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6cd15df09da425c84d7c465a1bd7b81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:48:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:48:17Z,use_quota=True,user_id='93d906f234b946cea603ec1bfebe96ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:48:17 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-2a5ffb0e-d5b7-4c93-b50d-6d4b0e9a7cac tempest-VolumesGetTest-2025585433 None] Creating volume baa2eca5-d7f4-4f1f-ae33-3f7865a123a7 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:48:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-2a5ffb0e-d5b7-4c93-b50d-6d4b0e9a7cac tempest-VolumesGetTest-2025585433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:48:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-2a5ffb0e-d5b7-4c93-b50d-6d4b0e9a7cac tempest-VolumesGetTest-2025585433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:48:17 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-2a5ffb0e-d5b7-4c93-b50d-6d4b0e9a7cac tempest-VolumesGetTest-2025585433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:48:17 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-2a5ffb0e-d5b7-4c93-b50d-6d4b0e9a7cac tempest-VolumesGetTest-2025585433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:48:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-2a5ffb0e-d5b7-4c93-b50d-6d4b0e9a7cac tempest-VolumesGetTest-2025585433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:48:17 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-2a5ffb0e-d5b7-4c93-b50d-6d4b0e9a7cac tempest-VolumesGetTest-2025585433 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:48:17 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-2a5ffb0e-d5b7-4c93-b50d-6d4b0e9a7cac tempest-VolumesGetTest-2025585433 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:48:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-2a5ffb0e-d5b7-4c93-b50d-6d4b0e9a7cac tempest-VolumesGetTest-2025585433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-baa2eca5-d7f4-4f1f-ae33-3f7865a123a7 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:17 devstack sudo[102734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-baa2eca5-d7f4-4f1f-ae33-3f7865a123a7 1073741824 Sep 18 21:48:17 devstack sudo[102734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:17 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-16e81187-a953-4833-9747-d7db595524ce tempest-TestStampPattern-580697789 None] Created reservations ['b5474cb5-405b-48e5-8cc3-db671285ace2', '139f472a-219c-4403-b422-f8256ba434be', 'd0fa52a1-2781-41b9-91b5-b194388d1a07', 'ac2dacec-a1b1-47f4-a008-e52609183f48'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:48:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-16e81187-a953-4833-9747-d7db595524ce tempest-TestStampPattern-580697789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:48:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-16e81187-a953-4833-9747-d7db595524ce tempest-TestStampPattern-580697789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:48:17 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-16e81187-a953-4833-9747-d7db595524ce tempest-TestStampPattern-580697789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:48:17 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-16e81187-a953-4833-9747-d7db595524ce tempest-TestStampPattern-580697789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:48:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-16e81187-a953-4833-9747-d7db595524ce tempest-TestStampPattern-580697789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:48:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-16e81187-a953-4833-9747-d7db595524ce tempest-TestStampPattern-580697789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:17 devstack sudo[102736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:48:17 devstack sudo[102736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:17 devstack sudo[102736]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-16e81187-a953-4833-9747-d7db595524ce tempest-TestStampPattern-580697789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.291s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:17 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-16e81187-a953-4833-9747-d7db595524ce tempest-TestStampPattern-580697789 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:48:17 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-16e81187-a953-4833-9747-d7db595524ce tempest-TestStampPattern-580697789 None] Deleted volume successfully. Sep 18 21:48:17 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-16e81187-a953-4833-9747-d7db595524ce tempest-TestStampPattern-580697789 None] Lock "cinder-a6eaf836-5be5-4ea9-a3b4-497ffeaa19df-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:48:18 devstack sudo[102734]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-2a5ffb0e-d5b7-4c93-b50d-6d4b0e9a7cac tempest-VolumesGetTest-2025585433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-baa2eca5-d7f4-4f1f-ae33-3f7865a123a7 1073741824" returned: 0 in 0.525s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-2a5ffb0e-d5b7-4c93-b50d-6d4b0e9a7cac tempest-VolumesGetTest-2025585433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-baa2eca5-d7f4-4f1f-ae33-3f7865a123a7 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:18 devstack sudo[102742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-baa2eca5-d7f4-4f1f-ae33-3f7865a123a7 Sep 18 21:48:18 devstack sudo[102742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:18 devstack sudo[102742]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-2a5ffb0e-d5b7-4c93-b50d-6d4b0e9a7cac tempest-VolumesGetTest-2025585433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-baa2eca5-d7f4-4f1f-ae33-3f7865a123a7" returned: 0 in 0.273s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:18 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-2a5ffb0e-d5b7-4c93-b50d-6d4b0e9a7cac tempest-VolumesGetTest-2025585433 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:48:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-2a5ffb0e-d5b7-4c93-b50d-6d4b0e9a7cac tempest-VolumesGetTest-2025585433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:48:18 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2a5ffb0e-d5b7-4c93-b50d-6d4b0e9a7cac tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d16cf572-742c-43ba-93fb-fae0b0a4daaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-baa2eca5-d7f4-4f1f-ae33-3f7865a123a7', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:18 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2a5ffb0e-d5b7-4c93-b50d-6d4b0e9a7cac tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6f8d5aa-6178-4739-91eb-e145c3b5d190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:18 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-2a5ffb0e-d5b7-4c93-b50d-6d4b0e9a7cac tempest-VolumesGetTest-2025585433 None] Volume volume-baa2eca5-d7f4-4f1f-ae33-3f7865a123a7 (baa2eca5-d7f4-4f1f-ae33-3f7865a123a7): created successfully Sep 18 21:48:18 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2a5ffb0e-d5b7-4c93-b50d-6d4b0e9a7cac tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6f8d5aa-6178-4739-91eb-e145c3b5d190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:18 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-2a5ffb0e-d5b7-4c93-b50d-6d4b0e9a7cac tempest-VolumesGetTest-2025585433 None] Flow 'volume_create_manager' (181933b9-076f-4aeb-a656-8f54eac17011) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:48:18 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-2a5ffb0e-d5b7-4c93-b50d-6d4b0e9a7cac tempest-VolumesGetTest-2025585433 None] Created volume successfully. Sep 18 21:48:18 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d17d3153-bca7-4767-a09d-5ec8db9f4472 tempest-ProjectReaderTests-1404803890 None] Acquiring lock "cinder-1e52e6c4-9d22-46ee-929d-ff402d541bf3-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:48:18 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d17d3153-bca7-4767-a09d-5ec8db9f4472 tempest-ProjectReaderTests-1404803890 None] Lock "cinder-1e52e6c4-9d22-46ee-929d-ff402d541bf3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:48:18 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d17d3153-bca7-4767-a09d-5ec8db9f4472 tempest-ProjectReaderTests-1404803890 None] Acquiring lock "cinder-quobyte-1e52e6c4-9d22-46ee-929d-ff402d541bf3" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:48:18 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d17d3153-bca7-4767-a09d-5ec8db9f4472 tempest-ProjectReaderTests-1404803890 None] Lock "cinder-quobyte-1e52e6c4-9d22-46ee-929d-ff402d541bf3" acquired by "delete_volume" :: waited 0.017s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:48:18 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[c02e22a1-0cf0-4049-9113-066364245e4f]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:48:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d17d3153-bca7-4767-a09d-5ec8db9f4472 tempest-ProjectReaderTests-1404803890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-1e52e6c4-9d22-46ee-929d-ff402d541bf3 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:18 devstack sudo[102745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-1e52e6c4-9d22-46ee-929d-ff402d541bf3 Sep 18 21:48:18 devstack sudo[102745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:19 devstack sudo[102745]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:19 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d17d3153-bca7-4767-a09d-5ec8db9f4472 tempest-ProjectReaderTests-1404803890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-1e52e6c4-9d22-46ee-929d-ff402d541bf3" returned: 0 in 0.401s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:19 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d17d3153-bca7-4767-a09d-5ec8db9f4472 tempest-ProjectReaderTests-1404803890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-1e52e6c4-9d22-46ee-929d-ff402d541bf3 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:19 devstack sudo[102750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-1e52e6c4-9d22-46ee-929d-ff402d541bf3 Sep 18 21:48:19 devstack sudo[102750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:19 devstack sudo[102750]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:19 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d17d3153-bca7-4767-a09d-5ec8db9f4472 tempest-ProjectReaderTests-1404803890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-1e52e6c4-9d22-46ee-929d-ff402d541bf3" returned: 0 in 0.257s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:19 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d17d3153-bca7-4767-a09d-5ec8db9f4472 tempest-ProjectReaderTests-1404803890 None] Lock "cinder-quobyte-1e52e6c4-9d22-46ee-929d-ff402d541bf3" released by "delete_volume" :: held 0.706s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:48:19 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-d17d3153-bca7-4767-a09d-5ec8db9f4472 tempest-ProjectReaderTests-1404803890 None] Created reservations ['573356d0-d632-43ce-a8ec-0fdc6c466485', '4fa4fab4-2cf4-46b2-9e45-1757c3d77294', '5809763b-162f-42b5-b47e-7f93bae8db05', '65352e12-8014-45af-8871-9056deebea49'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:48:19 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-d17d3153-bca7-4767-a09d-5ec8db9f4472 tempest-ProjectReaderTests-1404803890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:48:19 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-d17d3153-bca7-4767-a09d-5ec8db9f4472 tempest-ProjectReaderTests-1404803890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:48:19 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-d17d3153-bca7-4767-a09d-5ec8db9f4472 tempest-ProjectReaderTests-1404803890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:48:19 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-d17d3153-bca7-4767-a09d-5ec8db9f4472 tempest-ProjectReaderTests-1404803890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:48:19 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-d17d3153-bca7-4767-a09d-5ec8db9f4472 tempest-ProjectReaderTests-1404803890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:48:19 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d17d3153-bca7-4767-a09d-5ec8db9f4472 tempest-ProjectReaderTests-1404803890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:19 devstack sudo[102753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:48:19 devstack sudo[102753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:19 devstack sudo[102753]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:19 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d17d3153-bca7-4767-a09d-5ec8db9f4472 tempest-ProjectReaderTests-1404803890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.335s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:19 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-d17d3153-bca7-4767-a09d-5ec8db9f4472 tempest-ProjectReaderTests-1404803890 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:48:19 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-d17d3153-bca7-4767-a09d-5ec8db9f4472 tempest-ProjectReaderTests-1404803890 None] Deleted volume successfully. Sep 18 21:48:19 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d17d3153-bca7-4767-a09d-5ec8db9f4472 tempest-ProjectReaderTests-1404803890 None] Lock "cinder-1e52e6c4-9d22-46ee-929d-ff402d541bf3-delete_volume" released by "delete_volume" :: held 1.304s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:48:20 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e6861bd-29c3-48bf-a85e-b2e3c1ca2d35 tempest-VolumesGetTest-2025585433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:48:20 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9e6861bd-29c3-48bf-a85e-b2e3c1ca2d35 tempest-VolumesGetTest-2025585433 None] Flow 'volume_create_manager' (aff65047-4747-46cb-9b19-0bb807b20543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:48:20 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9e6861bd-29c3-48bf-a85e-b2e3c1ca2d35 tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d30efad-49cc-46fa-a942-41650aba7686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:20 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9e6861bd-29c3-48bf-a85e-b2e3c1ca2d35 tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d30efad-49cc-46fa-a942-41650aba7686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:48:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1333072008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4105f67-ea6f-473b-a2a0-444f78c30eb3,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c6cd15df09da425c84d7c465a1bd7b81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:48:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=baa2eca5-d7f4-4f1f-ae33-3f7865a123a7,status='creating',terminated_at=None,updated_at=2026-09-18T19:48:20Z,use_quota=True,user_id='93d906f234b946cea603ec1bfebe96ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:20 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9e6861bd-29c3-48bf-a85e-b2e3c1ca2d35 tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81a0e543-9b2a-40b7-9564-895568cb6468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:20 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9e6861bd-29c3-48bf-a85e-b2e3c1ca2d35 tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81a0e543-9b2a-40b7-9564-895568cb6468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:20 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9e6861bd-29c3-48bf-a85e-b2e3c1ca2d35 tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bbf71c9-eeb5-4fdb-b774-49626bec2275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:20 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9e6861bd-29c3-48bf-a85e-b2e3c1ca2d35 tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bbf71c9-eeb5-4fdb-b774-49626bec2275) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'e4105f67-ea6f-473b-a2a0-444f78c30eb3', 'volume_name': 'volume-e4105f67-ea6f-473b-a2a0-444f78c30eb3', 'volume_size': 1, 'source_volid': 'baa2eca5-d7f4-4f1f-ae33-3f7865a123a7', 'source_volstatus': 'available'}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:20 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9e6861bd-29c3-48bf-a85e-b2e3c1ca2d35 tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34a52f1e-6fb8-4eaf-acf7-c02617f9d387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:20 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9e6861bd-29c3-48bf-a85e-b2e3c1ca2d35 tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34a52f1e-6fb8-4eaf-acf7-c02617f9d387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:20 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9e6861bd-29c3-48bf-a85e-b2e3c1ca2d35 tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb2d176b-c443-4a71-9c4a-e41b80249a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:20 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-9e6861bd-29c3-48bf-a85e-b2e3c1ca2d35 tempest-VolumesGetTest-2025585433 None] Volume e4105f67-ea6f-473b-a2a0-444f78c30eb3: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-e4105f67-ea6f-473b-a2a0-444f78c30eb3', 'volume_size': 1, 'source_volid': 'baa2eca5-d7f4-4f1f-ae33-3f7865a123a7', 'source_volstatus': 'available'} Sep 18 21:48:20 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-9e6861bd-29c3-48bf-a85e-b2e3c1ca2d35 tempest-VolumesGetTest-2025585433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:48:20 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-9e6861bd-29c3-48bf-a85e-b2e3c1ca2d35 tempest-VolumesGetTest-2025585433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:48:20 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-9e6861bd-29c3-48bf-a85e-b2e3c1ca2d35 tempest-VolumesGetTest-2025585433 None] Cloning volume baa2eca5-d7f4-4f1f-ae33-3f7865a123a7 to volume e4105f67-ea6f-473b-a2a0-444f78c30eb3 Sep 18 21:48:20 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-9e6861bd-29c3-48bf-a85e-b2e3c1ca2d35 tempest-VolumesGetTest-2025585433 None] Creating offline snapshot 64c8c861-056d-44a0-a211-5be6c51a3425 of volume baa2eca5-d7f4-4f1f-ae33-3f7865a123a7 {{(pid=86136) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 21:48:20 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[db9e8aa1-444b-43fc-8a36-24663a6fd607]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:48:20 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9e6861bd-29c3-48bf-a85e-b2e3c1ca2d35 tempest-VolumesGetTest-2025585433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-baa2eca5-d7f4-4f1f-ae33-3f7865a123a7 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:20 devstack sudo[102757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-baa2eca5-d7f4-4f1f-ae33-3f7865a123a7 Sep 18 21:48:20 devstack sudo[102757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:20 devstack sudo[102757]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:20 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9e6861bd-29c3-48bf-a85e-b2e3c1ca2d35 tempest-VolumesGetTest-2025585433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-baa2eca5-d7f4-4f1f-ae33-3f7865a123a7" returned: 0 in 0.408s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:20 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9e6861bd-29c3-48bf-a85e-b2e3c1ca2d35 tempest-VolumesGetTest-2025585433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-baa2eca5-d7f4-4f1f-ae33-3f7865a123a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-baa2eca5-d7f4-4f1f-ae33-3f7865a123a7.64c8c861-056d-44a0-a211-5be6c51a3425 1G {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:20 devstack sudo[102763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-baa2eca5-d7f4-4f1f-ae33-3f7865a123a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-baa2eca5-d7f4-4f1f-ae33-3f7865a123a7.64c8c861-056d-44a0-a211-5be6c51a3425 1G Sep 18 21:48:20 devstack sudo[102763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:21 devstack sudo[102763]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9e6861bd-29c3-48bf-a85e-b2e3c1ca2d35 tempest-VolumesGetTest-2025585433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-baa2eca5-d7f4-4f1f-ae33-3f7865a123a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-baa2eca5-d7f4-4f1f-ae33-3f7865a123a7.64c8c861-056d-44a0-a211-5be6c51a3425 1G" returned: 0 in 0.489s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9e6861bd-29c3-48bf-a85e-b2e3c1ca2d35 tempest-VolumesGetTest-2025585433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-baa2eca5-d7f4-4f1f-ae33-3f7865a123a7 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-baa2eca5-d7f4-4f1f-ae33-3f7865a123a7.64c8c861-056d-44a0-a211-5be6c51a3425 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:21 devstack sudo[102769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-baa2eca5-d7f4-4f1f-ae33-3f7865a123a7 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-baa2eca5-d7f4-4f1f-ae33-3f7865a123a7.64c8c861-056d-44a0-a211-5be6c51a3425 Sep 18 21:48:21 devstack sudo[102769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:21 devstack sudo[102769]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9e6861bd-29c3-48bf-a85e-b2e3c1ca2d35 tempest-VolumesGetTest-2025585433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-baa2eca5-d7f4-4f1f-ae33-3f7865a123a7 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-baa2eca5-d7f4-4f1f-ae33-3f7865a123a7.64c8c861-056d-44a0-a211-5be6c51a3425" returned: 0 in 0.332s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:21 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-9e6861bd-29c3-48bf-a85e-b2e3c1ca2d35 tempest-VolumesGetTest-2025585433 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-baa2eca5-d7f4-4f1f-ae33-3f7865a123a7.64c8c861-056d-44a0-a211-5be6c51a3425 is being set with open permissions: ugo+rw Sep 18 21:48:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9e6861bd-29c3-48bf-a85e-b2e3c1ca2d35 tempest-VolumesGetTest-2025585433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-baa2eca5-d7f4-4f1f-ae33-3f7865a123a7.64c8c861-056d-44a0-a211-5be6c51a3425 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:21 devstack sudo[102775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-baa2eca5-d7f4-4f1f-ae33-3f7865a123a7.64c8c861-056d-44a0-a211-5be6c51a3425 Sep 18 21:48:21 devstack sudo[102775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:21 devstack sudo[102775]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9e6861bd-29c3-48bf-a85e-b2e3c1ca2d35 tempest-VolumesGetTest-2025585433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-baa2eca5-d7f4-4f1f-ae33-3f7865a123a7.64c8c861-056d-44a0-a211-5be6c51a3425" returned: 0 in 0.262s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9e6861bd-29c3-48bf-a85e-b2e3c1ca2d35 tempest-VolumesGetTest-2025585433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-baa2eca5-d7f4-4f1f-ae33-3f7865a123a7.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:21 devstack sudo[102778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-baa2eca5-d7f4-4f1f-ae33-3f7865a123a7.info Sep 18 21:48:21 devstack sudo[102778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:22 devstack sudo[102778]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9e6861bd-29c3-48bf-a85e-b2e3c1ca2d35 tempest-VolumesGetTest-2025585433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-baa2eca5-d7f4-4f1f-ae33-3f7865a123a7.info" returned: 0 in 0.345s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:22 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-9e6861bd-29c3-48bf-a85e-b2e3c1ca2d35 tempest-VolumesGetTest-2025585433 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-baa2eca5-d7f4-4f1f-ae33-3f7865a123a7.info is being set with open permissions: ugo+rw Sep 18 21:48:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9e6861bd-29c3-48bf-a85e-b2e3c1ca2d35 tempest-VolumesGetTest-2025585433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-baa2eca5-d7f4-4f1f-ae33-3f7865a123a7.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:22 devstack sudo[102781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-baa2eca5-d7f4-4f1f-ae33-3f7865a123a7.info Sep 18 21:48:22 devstack sudo[102781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:22 devstack sudo[102781]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9e6861bd-29c3-48bf-a85e-b2e3c1ca2d35 tempest-VolumesGetTest-2025585433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-baa2eca5-d7f4-4f1f-ae33-3f7865a123a7.info" returned: 0 in 0.269s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:22 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-9e6861bd-29c3-48bf-a85e-b2e3c1ca2d35 tempest-VolumesGetTest-2025585433 None] Acquiring lock "cinder-quobyte-e4105f67-ea6f-473b-a2a0-444f78c30eb3" by "_copy_volume_from_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:48:22 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-9e6861bd-29c3-48bf-a85e-b2e3c1ca2d35 tempest-VolumesGetTest-2025585433 None] Lock "cinder-quobyte-e4105f67-ea6f-473b-a2a0-444f78c30eb3" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:48:22 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-9e6861bd-29c3-48bf-a85e-b2e3c1ca2d35 tempest-VolumesGetTest-2025585433 None] snapshot: 64c8c861-056d-44a0-a211-5be6c51a3425, volume: e4105f67-ea6f-473b-a2a0-444f78c30eb3, {{(pid=86136) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 18 21:48:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-9e6861bd-29c3-48bf-a85e-b2e3c1ca2d35 tempest-VolumesGetTest-2025585433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:48:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-9e6861bd-29c3-48bf-a85e-b2e3c1ca2d35 tempest-VolumesGetTest-2025585433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:48:22 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-9e6861bd-29c3-48bf-a85e-b2e3c1ca2d35 tempest-VolumesGetTest-2025585433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:48:22 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-9e6861bd-29c3-48bf-a85e-b2e3c1ca2d35 tempest-VolumesGetTest-2025585433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:48:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-9e6861bd-29c3-48bf-a85e-b2e3c1ca2d35 tempest-VolumesGetTest-2025585433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:48:22 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf9fad1-758a-497c-a5a4-fc5319a0720d]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:48:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9e6861bd-29c3-48bf-a85e-b2e3c1ca2d35 tempest-VolumesGetTest-2025585433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-baa2eca5-d7f4-4f1f-ae33-3f7865a123a7.64c8c861-056d-44a0-a211-5be6c51a3425 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:22 devstack sudo[102784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-baa2eca5-d7f4-4f1f-ae33-3f7865a123a7.64c8c861-056d-44a0-a211-5be6c51a3425 Sep 18 21:48:22 devstack sudo[102784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:22 devstack sudo[102784]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9e6861bd-29c3-48bf-a85e-b2e3c1ca2d35 tempest-VolumesGetTest-2025585433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-baa2eca5-d7f4-4f1f-ae33-3f7865a123a7.64c8c861-056d-44a0-a211-5be6c51a3425" returned: 0 in 0.456s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:22 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-9e6861bd-29c3-48bf-a85e-b2e3c1ca2d35 tempest-VolumesGetTest-2025585433 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-baa2eca5-d7f4-4f1f-ae33-3f7865a123a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86136) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 21:48:22 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a71d98d-51a5-4b1e-acaa-f7327af3ea5c]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:48:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9e6861bd-29c3-48bf-a85e-b2e3c1ca2d35 tempest-VolumesGetTest-2025585433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-baa2eca5-d7f4-4f1f-ae33-3f7865a123a7 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:23 devstack sudo[102790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-baa2eca5-d7f4-4f1f-ae33-3f7865a123a7 Sep 18 21:48:23 devstack sudo[102790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:23 devstack sudo[102790]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9e6861bd-29c3-48bf-a85e-b2e3c1ca2d35 tempest-VolumesGetTest-2025585433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-baa2eca5-d7f4-4f1f-ae33-3f7865a123a7" returned: 0 in 0.383s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:23 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-9e6861bd-29c3-48bf-a85e-b2e3c1ca2d35 tempest-VolumesGetTest-2025585433 None] will copy from snapshot at /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-baa2eca5-d7f4-4f1f-ae33-3f7865a123a7 {{(pid=86136) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 18 21:48:23 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-9e6861bd-29c3-48bf-a85e-b2e3c1ca2d35 tempest-VolumesGetTest-2025585433 None] Creating direct copy from snapshot {{(pid=86136) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 18 21:48:23 devstack cinder-volume[86136]: DEBUG cinder.utils [None req-9e6861bd-29c3-48bf-a85e-b2e3c1ca2d35 tempest-VolumesGetTest-2025585433 None] Path /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e4105f67-ea6f-473b-a2a0-444f78c30eb3 not found in is_blk_device check {{(pid=86136) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 18 21:48:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9e6861bd-29c3-48bf-a85e-b2e3c1ca2d35 tempest-VolumesGetTest-2025585433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-baa2eca5-d7f4-4f1f-ae33-3f7865a123a7 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e4105f67-ea6f-473b-a2a0-444f78c30eb3 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:23 devstack sudo[102795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-baa2eca5-d7f4-4f1f-ae33-3f7865a123a7 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e4105f67-ea6f-473b-a2a0-444f78c30eb3 Sep 18 21:48:23 devstack sudo[102795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:31 devstack sudo[102795]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9e6861bd-29c3-48bf-a85e-b2e3c1ca2d35 tempest-VolumesGetTest-2025585433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-baa2eca5-d7f4-4f1f-ae33-3f7865a123a7 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e4105f67-ea6f-473b-a2a0-444f78c30eb3" returned: 0 in 7.947s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:31 devstack cinder-volume[86136]: DEBUG cinder.image.image_utils [None req-9e6861bd-29c3-48bf-a85e-b2e3c1ca2d35 tempest-VolumesGetTest-2025585433 None] Image conversion details: src /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-baa2eca5-d7f4-4f1f-ae33-3f7865a123a7, size 1024.00 MB, duration 7.95 sec, destination /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e4105f67-ea6f-473b-a2a0-444f78c30eb3 {{(pid=86136) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 18 21:48:31 devstack cinder-volume[86136]: INFO cinder.image.image_utils [None req-9e6861bd-29c3-48bf-a85e-b2e3c1ca2d35 tempest-VolumesGetTest-2025585433 None] Converted 1024.00 MB image at 128.82 MB/s Sep 18 21:48:31 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-9e6861bd-29c3-48bf-a85e-b2e3c1ca2d35 tempest-VolumesGetTest-2025585433 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e4105f67-ea6f-473b-a2a0-444f78c30eb3 is being set with open permissions: ugo+rw Sep 18 21:48:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9e6861bd-29c3-48bf-a85e-b2e3c1ca2d35 tempest-VolumesGetTest-2025585433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e4105f67-ea6f-473b-a2a0-444f78c30eb3 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:31 devstack sudo[102853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e4105f67-ea6f-473b-a2a0-444f78c30eb3 Sep 18 21:48:31 devstack sudo[102853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:31 devstack sudo[102853]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9e6861bd-29c3-48bf-a85e-b2e3c1ca2d35 tempest-VolumesGetTest-2025585433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e4105f67-ea6f-473b-a2a0-444f78c30eb3" returned: 0 in 0.246s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:31 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-9e6861bd-29c3-48bf-a85e-b2e3c1ca2d35 tempest-VolumesGetTest-2025585433 None] Lock "cinder-quobyte-e4105f67-ea6f-473b-a2a0-444f78c30eb3" released by "_copy_volume_from_snapshot" :: held 9.128s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:48:31 devstack cinder-volume[86136]: DEBUG dbcounter [-] [86136] Writing DB stats cinder:SELECT=113,cinder:UPDATE=155,cinder:DELETE=19,cinder:INSERT=42 {{(pid=86136) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 21:48:31 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-9e6861bd-29c3-48bf-a85e-b2e3c1ca2d35 tempest-VolumesGetTest-2025585433 None] Acquiring lock "cinder-quobyte-64c8c861-056d-44a0-a211-5be6c51a3425" by "_delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:48:31 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-9e6861bd-29c3-48bf-a85e-b2e3c1ca2d35 tempest-VolumesGetTest-2025585433 None] Lock "cinder-quobyte-64c8c861-056d-44a0-a211-5be6c51a3425" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:48:31 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-9e6861bd-29c3-48bf-a85e-b2e3c1ca2d35 tempest-VolumesGetTest-2025585433 None] Deleting offline snapshot 64c8c861-056d-44a0-a211-5be6c51a3425 of volume baa2eca5-d7f4-4f1f-ae33-3f7865a123a7 {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 21:48:31 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-9e6861bd-29c3-48bf-a85e-b2e3c1ca2d35 tempest-VolumesGetTest-2025585433 None] snapshot_file for this snap is: volume-baa2eca5-d7f4-4f1f-ae33-3f7865a123a7.64c8c861-056d-44a0-a211-5be6c51a3425 {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 21:48:31 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c848ff-c61f-406f-afdd-51aa4df43888]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:48:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9e6861bd-29c3-48bf-a85e-b2e3c1ca2d35 tempest-VolumesGetTest-2025585433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-baa2eca5-d7f4-4f1f-ae33-3f7865a123a7.64c8c861-056d-44a0-a211-5be6c51a3425 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:31 devstack cinder-volume[86136]: DEBUG dbcounter [-] [86136] Writing DB stats cinder:UPDATE=148,cinder:INSERT=47,cinder:SELECT=125,cinder:DELETE=6 {{(pid=86136) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 21:48:31 devstack sudo[102856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-baa2eca5-d7f4-4f1f-ae33-3f7865a123a7.64c8c861-056d-44a0-a211-5be6c51a3425 Sep 18 21:48:31 devstack sudo[102856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:32 devstack sudo[102856]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9e6861bd-29c3-48bf-a85e-b2e3c1ca2d35 tempest-VolumesGetTest-2025585433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-baa2eca5-d7f4-4f1f-ae33-3f7865a123a7.64c8c861-056d-44a0-a211-5be6c51a3425" returned: 0 in 0.384s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:32 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-9e6861bd-29c3-48bf-a85e-b2e3c1ca2d35 tempest-VolumesGetTest-2025585433 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-baa2eca5-d7f4-4f1f-ae33-3f7865a123a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86136) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 21:48:32 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ba14f5-30a4-4546-83e9-010b0697af7a]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:48:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9e6861bd-29c3-48bf-a85e-b2e3c1ca2d35 tempest-VolumesGetTest-2025585433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-baa2eca5-d7f4-4f1f-ae33-3f7865a123a7 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:32 devstack sudo[102861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-baa2eca5-d7f4-4f1f-ae33-3f7865a123a7 Sep 18 21:48:32 devstack sudo[102861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:32 devstack sudo[102861]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9e6861bd-29c3-48bf-a85e-b2e3c1ca2d35 tempest-VolumesGetTest-2025585433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-baa2eca5-d7f4-4f1f-ae33-3f7865a123a7" returned: 0 in 0.641s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9e6861bd-29c3-48bf-a85e-b2e3c1ca2d35 tempest-VolumesGetTest-2025585433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-baa2eca5-d7f4-4f1f-ae33-3f7865a123a7.64c8c861-056d-44a0-a211-5be6c51a3425 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:32 devstack sudo[102866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-baa2eca5-d7f4-4f1f-ae33-3f7865a123a7.64c8c861-056d-44a0-a211-5be6c51a3425 Sep 18 21:48:32 devstack sudo[102866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:33 devstack sudo[102866]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:33 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9e6861bd-29c3-48bf-a85e-b2e3c1ca2d35 tempest-VolumesGetTest-2025585433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-baa2eca5-d7f4-4f1f-ae33-3f7865a123a7.64c8c861-056d-44a0-a211-5be6c51a3425" returned: 0 in 0.400s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:33 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9e6861bd-29c3-48bf-a85e-b2e3c1ca2d35 tempest-VolumesGetTest-2025585433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-baa2eca5-d7f4-4f1f-ae33-3f7865a123a7.64c8c861-056d-44a0-a211-5be6c51a3425 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:33 devstack sudo[102871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-baa2eca5-d7f4-4f1f-ae33-3f7865a123a7.64c8c861-056d-44a0-a211-5be6c51a3425 Sep 18 21:48:33 devstack sudo[102871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:33 devstack sudo[102871]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:33 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9e6861bd-29c3-48bf-a85e-b2e3c1ca2d35 tempest-VolumesGetTest-2025585433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-baa2eca5-d7f4-4f1f-ae33-3f7865a123a7.64c8c861-056d-44a0-a211-5be6c51a3425" returned: 0 in 0.277s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:33 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-9e6861bd-29c3-48bf-a85e-b2e3c1ca2d35 tempest-VolumesGetTest-2025585433 None] Lock "cinder-quobyte-64c8c861-056d-44a0-a211-5be6c51a3425" released by "_delete_snapshot" :: held 1.828s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:48:33 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-9e6861bd-29c3-48bf-a85e-b2e3c1ca2d35 tempest-VolumesGetTest-2025585433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.319s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:48:33 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9e6861bd-29c3-48bf-a85e-b2e3c1ca2d35 tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb2d176b-c443-4a71-9c4a-e41b80249a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4105f67-ea6f-473b-a2a0-444f78c30eb3', 'volume_size': 1, 'source_volid': 'baa2eca5-d7f4-4f1f-ae33-3f7865a123a7', 'source_volstatus': 'available'}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:33 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9e6861bd-29c3-48bf-a85e-b2e3c1ca2d35 tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f831f157-3fcd-4a4d-aa8c-d4d0c6451cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:33 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-9e6861bd-29c3-48bf-a85e-b2e3c1ca2d35 tempest-VolumesGetTest-2025585433 None] Volume volume-e4105f67-ea6f-473b-a2a0-444f78c30eb3 (e4105f67-ea6f-473b-a2a0-444f78c30eb3): created successfully Sep 18 21:48:33 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9e6861bd-29c3-48bf-a85e-b2e3c1ca2d35 tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f831f157-3fcd-4a4d-aa8c-d4d0c6451cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:33 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9e6861bd-29c3-48bf-a85e-b2e3c1ca2d35 tempest-VolumesGetTest-2025585433 None] Flow 'volume_create_manager' (aff65047-4747-46cb-9b19-0bb807b20543) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:48:33 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-9e6861bd-29c3-48bf-a85e-b2e3c1ca2d35 tempest-VolumesGetTest-2025585433 None] Created volume successfully. Sep 18 21:48:33 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-a32bbfa2-7bd1-45e9-8397-68d8c2f302c6 tempest-ProjectReaderTests-789285419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:48:33 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-a32bbfa2-7bd1-45e9-8397-68d8c2f302c6 tempest-ProjectReaderTests-789285419 None] Flow 'volume_create_manager' (4daed95b-a2e5-4ba6-9715-18c1a2e83ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:48:33 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-a32bbfa2-7bd1-45e9-8397-68d8c2f302c6 tempest-ProjectReaderTests-789285419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ba25ae9-ca7d-489b-866b-ce1eb87e5b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:33 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-a32bbfa2-7bd1-45e9-8397-68d8c2f302c6 tempest-ProjectReaderTests-789285419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ba25ae9-ca7d-489b-866b-ce1eb87e5b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:48:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1886686057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cf368a2-83dc-48bf-92d3-f21bcaf96ea1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e742561c2194d10a762398f87f7ceae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:48:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:48:34Z,use_quota=True,user_id='ffe6de373d4445e3b3cfe01d62bed581',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:33 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-a32bbfa2-7bd1-45e9-8397-68d8c2f302c6 tempest-ProjectReaderTests-789285419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b946b9e-8461-4277-a95d-5cb5a2ff0e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:33 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-a32bbfa2-7bd1-45e9-8397-68d8c2f302c6 tempest-ProjectReaderTests-789285419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b946b9e-8461-4277-a95d-5cb5a2ff0e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:33 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-a32bbfa2-7bd1-45e9-8397-68d8c2f302c6 tempest-ProjectReaderTests-789285419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2b7b810-7d9f-40c1-96e0-28a1df510c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:33 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-a32bbfa2-7bd1-45e9-8397-68d8c2f302c6 tempest-ProjectReaderTests-789285419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2b7b810-7d9f-40c1-96e0-28a1df510c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cf368a2-83dc-48bf-92d3-f21bcaf96ea1', 'volume_name': 'volume-6cf368a2-83dc-48bf-92d3-f21bcaf96ea1', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:33 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-a32bbfa2-7bd1-45e9-8397-68d8c2f302c6 tempest-ProjectReaderTests-789285419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ce76bc9-03f5-4d0a-868d-e544816480e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:33 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-a32bbfa2-7bd1-45e9-8397-68d8c2f302c6 tempest-ProjectReaderTests-789285419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ce76bc9-03f5-4d0a-868d-e544816480e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:33 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-a32bbfa2-7bd1-45e9-8397-68d8c2f302c6 tempest-ProjectReaderTests-789285419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1200525-71a1-4a49-9ada-d6334b3fa3db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:33 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-a32bbfa2-7bd1-45e9-8397-68d8c2f302c6 tempest-ProjectReaderTests-789285419 None] Volume 6cf368a2-83dc-48bf-92d3-f21bcaf96ea1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cf368a2-83dc-48bf-92d3-f21bcaf96ea1', 'volume_size': 1} Sep 18 21:48:33 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-a32bbfa2-7bd1-45e9-8397-68d8c2f302c6 tempest-ProjectReaderTests-789285419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:48:33 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-a32bbfa2-7bd1-45e9-8397-68d8c2f302c6 tempest-ProjectReaderTests-789285419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:48:33 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-a32bbfa2-7bd1-45e9-8397-68d8c2f302c6 tempest-ProjectReaderTests-789285419 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:48:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1886686057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cf368a2-83dc-48bf-92d3-f21bcaf96ea1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e742561c2194d10a762398f87f7ceae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:48:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:48:34Z,use_quota=True,user_id='ffe6de373d4445e3b3cfe01d62bed581',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:48:33 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-a32bbfa2-7bd1-45e9-8397-68d8c2f302c6 tempest-ProjectReaderTests-789285419 None] Creating volume 6cf368a2-83dc-48bf-92d3-f21bcaf96ea1 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:48:33 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-a32bbfa2-7bd1-45e9-8397-68d8c2f302c6 tempest-ProjectReaderTests-789285419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:48:33 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-a32bbfa2-7bd1-45e9-8397-68d8c2f302c6 tempest-ProjectReaderTests-789285419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:48:33 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-a32bbfa2-7bd1-45e9-8397-68d8c2f302c6 tempest-ProjectReaderTests-789285419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:48:33 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-a32bbfa2-7bd1-45e9-8397-68d8c2f302c6 tempest-ProjectReaderTests-789285419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:48:33 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-a32bbfa2-7bd1-45e9-8397-68d8c2f302c6 tempest-ProjectReaderTests-789285419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:48:33 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-a32bbfa2-7bd1-45e9-8397-68d8c2f302c6 tempest-ProjectReaderTests-789285419 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:48:33 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-a32bbfa2-7bd1-45e9-8397-68d8c2f302c6 tempest-ProjectReaderTests-789285419 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:48:33 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-a32bbfa2-7bd1-45e9-8397-68d8c2f302c6 tempest-ProjectReaderTests-789285419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-6cf368a2-83dc-48bf-92d3-f21bcaf96ea1 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:33 devstack sudo[102874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-6cf368a2-83dc-48bf-92d3-f21bcaf96ea1 1073741824 Sep 18 21:48:33 devstack sudo[102874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:34 devstack sudo[102874]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:34 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-a32bbfa2-7bd1-45e9-8397-68d8c2f302c6 tempest-ProjectReaderTests-789285419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-6cf368a2-83dc-48bf-92d3-f21bcaf96ea1 1073741824" returned: 0 in 0.443s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:34 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-a32bbfa2-7bd1-45e9-8397-68d8c2f302c6 tempest-ProjectReaderTests-789285419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-6cf368a2-83dc-48bf-92d3-f21bcaf96ea1 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:34 devstack sudo[102880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-6cf368a2-83dc-48bf-92d3-f21bcaf96ea1 Sep 18 21:48:34 devstack sudo[102880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:34 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-d550527f-0c98-4bd6-91a8-49af84c0bd60 tempest-CreateVolumesFromImageTest-239318328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:48:34 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d550527f-0c98-4bd6-91a8-49af84c0bd60 tempest-CreateVolumesFromImageTest-239318328 None] Flow 'volume_create_manager' (f1b01e8b-4722-4ac0-bef3-90d206d91d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:48:34 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d550527f-0c98-4bd6-91a8-49af84c0bd60 tempest-CreateVolumesFromImageTest-239318328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68452fca-f9b4-4b2c-8f97-99c292b72778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:34 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d550527f-0c98-4bd6-91a8-49af84c0bd60 tempest-CreateVolumesFromImageTest-239318328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68452fca-f9b4-4b2c-8f97-99c292b72778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:48:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-524193909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beed53e8-2a23-4349-a6e2-0ed64eed1f13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77e90140436344d6b20b05613fce2a37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:48:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:48:34Z,use_quota=True,user_id='accc880f8cf347f1b8f6c7ea8448bf01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:34 devstack sudo[102880]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:34 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d550527f-0c98-4bd6-91a8-49af84c0bd60 tempest-CreateVolumesFromImageTest-239318328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aae41a40-b0e1-4c2a-8c45-a6e678858a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:34 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d550527f-0c98-4bd6-91a8-49af84c0bd60 tempest-CreateVolumesFromImageTest-239318328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aae41a40-b0e1-4c2a-8c45-a6e678858a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:34 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d550527f-0c98-4bd6-91a8-49af84c0bd60 tempest-CreateVolumesFromImageTest-239318328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (936683a9-4e00-4c03-811d-b6046055507f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:34 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d550527f-0c98-4bd6-91a8-49af84c0bd60 tempest-CreateVolumesFromImageTest-239318328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (936683a9-4e00-4c03-811d-b6046055507f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'beed53e8-2a23-4349-a6e2-0ed64eed1f13', 'volume_name': 'volume-beed53e8-2a23-4349-a6e2-0ed64eed1f13', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:34 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d550527f-0c98-4bd6-91a8-49af84c0bd60 tempest-CreateVolumesFromImageTest-239318328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9154d38-7048-4219-846f-ab911826e314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:34 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d550527f-0c98-4bd6-91a8-49af84c0bd60 tempest-CreateVolumesFromImageTest-239318328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9154d38-7048-4219-846f-ab911826e314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:34 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d550527f-0c98-4bd6-91a8-49af84c0bd60 tempest-CreateVolumesFromImageTest-239318328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b444311b-2cc4-4371-a504-7e1947723e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:34 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-d550527f-0c98-4bd6-91a8-49af84c0bd60 tempest-CreateVolumesFromImageTest-239318328 None] Volume beed53e8-2a23-4349-a6e2-0ed64eed1f13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-beed53e8-2a23-4349-a6e2-0ed64eed1f13', 'volume_size': 1} Sep 18 21:48:34 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-d550527f-0c98-4bd6-91a8-49af84c0bd60 tempest-CreateVolumesFromImageTest-239318328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:48:34 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-a32bbfa2-7bd1-45e9-8397-68d8c2f302c6 tempest-ProjectReaderTests-789285419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-6cf368a2-83dc-48bf-92d3-f21bcaf96ea1" returned: 0 in 0.307s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:34 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-a32bbfa2-7bd1-45e9-8397-68d8c2f302c6 tempest-ProjectReaderTests-789285419 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:48:34 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-a32bbfa2-7bd1-45e9-8397-68d8c2f302c6 tempest-ProjectReaderTests-789285419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:48:34 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-d550527f-0c98-4bd6-91a8-49af84c0bd60 tempest-CreateVolumesFromImageTest-239318328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:48:34 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-d550527f-0c98-4bd6-91a8-49af84c0bd60 tempest-CreateVolumesFromImageTest-239318328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:48:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-524193909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beed53e8-2a23-4349-a6e2-0ed64eed1f13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77e90140436344d6b20b05613fce2a37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:48:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:48:34Z,use_quota=True,user_id='accc880f8cf347f1b8f6c7ea8448bf01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:48:34 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-d550527f-0c98-4bd6-91a8-49af84c0bd60 tempest-CreateVolumesFromImageTest-239318328 None] Creating volume beed53e8-2a23-4349-a6e2-0ed64eed1f13 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:48:34 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-d550527f-0c98-4bd6-91a8-49af84c0bd60 tempest-CreateVolumesFromImageTest-239318328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:48:34 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-d550527f-0c98-4bd6-91a8-49af84c0bd60 tempest-CreateVolumesFromImageTest-239318328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:48:34 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-d550527f-0c98-4bd6-91a8-49af84c0bd60 tempest-CreateVolumesFromImageTest-239318328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:48:34 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-d550527f-0c98-4bd6-91a8-49af84c0bd60 tempest-CreateVolumesFromImageTest-239318328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:48:34 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-d550527f-0c98-4bd6-91a8-49af84c0bd60 tempest-CreateVolumesFromImageTest-239318328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:48:34 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-d550527f-0c98-4bd6-91a8-49af84c0bd60 tempest-CreateVolumesFromImageTest-239318328 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:48:34 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-d550527f-0c98-4bd6-91a8-49af84c0bd60 tempest-CreateVolumesFromImageTest-239318328 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:48:34 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d550527f-0c98-4bd6-91a8-49af84c0bd60 tempest-CreateVolumesFromImageTest-239318328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-beed53e8-2a23-4349-a6e2-0ed64eed1f13 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:34 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-a32bbfa2-7bd1-45e9-8397-68d8c2f302c6 tempest-ProjectReaderTests-789285419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1200525-71a1-4a49-9ada-d6334b3fa3db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cf368a2-83dc-48bf-92d3-f21bcaf96ea1', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:34 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-a32bbfa2-7bd1-45e9-8397-68d8c2f302c6 tempest-ProjectReaderTests-789285419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3282984d-42fc-4428-930a-9ee9fe05533f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:34 devstack sudo[102883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-beed53e8-2a23-4349-a6e2-0ed64eed1f13 1073741824 Sep 18 21:48:34 devstack sudo[102883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:34 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-a32bbfa2-7bd1-45e9-8397-68d8c2f302c6 tempest-ProjectReaderTests-789285419 None] Volume volume-6cf368a2-83dc-48bf-92d3-f21bcaf96ea1 (6cf368a2-83dc-48bf-92d3-f21bcaf96ea1): created successfully Sep 18 21:48:34 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-a32bbfa2-7bd1-45e9-8397-68d8c2f302c6 tempest-ProjectReaderTests-789285419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3282984d-42fc-4428-930a-9ee9fe05533f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:34 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-a32bbfa2-7bd1-45e9-8397-68d8c2f302c6 tempest-ProjectReaderTests-789285419 None] Flow 'volume_create_manager' (4daed95b-a2e5-4ba6-9715-18c1a2e83ec2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:48:34 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-a32bbfa2-7bd1-45e9-8397-68d8c2f302c6 tempest-ProjectReaderTests-789285419 None] Created volume successfully. Sep 18 21:48:34 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b81de70-697e-45ee-b9da-1f9770f24f9e tempest-CreateVolumesFromImageTest-239318328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:48:34 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-5b81de70-697e-45ee-b9da-1f9770f24f9e tempest-CreateVolumesFromImageTest-239318328 None] Flow 'volume_create_manager' (95146ce0-8d1f-4d6a-8581-36b3fcb3bc7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:48:34 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-5b81de70-697e-45ee-b9da-1f9770f24f9e tempest-CreateVolumesFromImageTest-239318328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce103f16-7033-48e9-a4b5-06c5fb8fc254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:34 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-5b81de70-697e-45ee-b9da-1f9770f24f9e tempest-CreateVolumesFromImageTest-239318328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce103f16-7033-48e9-a4b5-06c5fb8fc254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:48:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-675136652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dd9726b-0ea0-4028-b1f9-e820c1f16894,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77e90140436344d6b20b05613fce2a37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:48:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:48:35Z,use_quota=True,user_id='accc880f8cf347f1b8f6c7ea8448bf01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:34 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-5b81de70-697e-45ee-b9da-1f9770f24f9e tempest-CreateVolumesFromImageTest-239318328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd61586a-b9bb-466f-97ff-adeb0982221e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:34 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-5b81de70-697e-45ee-b9da-1f9770f24f9e tempest-CreateVolumesFromImageTest-239318328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd61586a-b9bb-466f-97ff-adeb0982221e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:34 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-5b81de70-697e-45ee-b9da-1f9770f24f9e tempest-CreateVolumesFromImageTest-239318328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e29349a-8772-4ccb-a922-fa0684f36f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:34 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-5b81de70-697e-45ee-b9da-1f9770f24f9e tempest-CreateVolumesFromImageTest-239318328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e29349a-8772-4ccb-a922-fa0684f36f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7dd9726b-0ea0-4028-b1f9-e820c1f16894', 'volume_name': 'volume-7dd9726b-0ea0-4028-b1f9-e820c1f16894', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:34 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-5b81de70-697e-45ee-b9da-1f9770f24f9e tempest-CreateVolumesFromImageTest-239318328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd35c3f7-818e-475e-ba02-c51814dc67db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:35 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-5b81de70-697e-45ee-b9da-1f9770f24f9e tempest-CreateVolumesFromImageTest-239318328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd35c3f7-818e-475e-ba02-c51814dc67db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:35 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-5b81de70-697e-45ee-b9da-1f9770f24f9e tempest-CreateVolumesFromImageTest-239318328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24ab93fb-8740-463e-8b2b-a4ca89e65dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:35 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-5b81de70-697e-45ee-b9da-1f9770f24f9e tempest-CreateVolumesFromImageTest-239318328 None] Volume 7dd9726b-0ea0-4028-b1f9-e820c1f16894: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7dd9726b-0ea0-4028-b1f9-e820c1f16894', 'volume_size': 1} Sep 18 21:48:35 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-5b81de70-697e-45ee-b9da-1f9770f24f9e tempest-CreateVolumesFromImageTest-239318328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:48:35 devstack sudo[102883]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:35 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d550527f-0c98-4bd6-91a8-49af84c0bd60 tempest-CreateVolumesFromImageTest-239318328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-beed53e8-2a23-4349-a6e2-0ed64eed1f13 1073741824" returned: 0 in 0.579s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:35 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d550527f-0c98-4bd6-91a8-49af84c0bd60 tempest-CreateVolumesFromImageTest-239318328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-beed53e8-2a23-4349-a6e2-0ed64eed1f13 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:35 devstack sudo[102889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-beed53e8-2a23-4349-a6e2-0ed64eed1f13 Sep 18 21:48:35 devstack sudo[102889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:35 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dfc374a-2e52-4877-8bd7-7522ec5ae111 tempest-CreateVolumesFromImageTest-239318328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:48:35 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-1dfc374a-2e52-4877-8bd7-7522ec5ae111 tempest-CreateVolumesFromImageTest-239318328 None] Flow 'volume_create_manager' (5ebc13f7-6a81-4b4c-877f-fabb3be15624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:48:35 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-1dfc374a-2e52-4877-8bd7-7522ec5ae111 tempest-CreateVolumesFromImageTest-239318328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4000257d-e037-4e22-925a-48868286ae3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:35 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-1dfc374a-2e52-4877-8bd7-7522ec5ae111 tempest-CreateVolumesFromImageTest-239318328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4000257d-e037-4e22-925a-48868286ae3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:48:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1980504004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3bae42b-31f7-443b-b940-e3400a5f8569,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77e90140436344d6b20b05613fce2a37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:48:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:48:35Z,use_quota=True,user_id='accc880f8cf347f1b8f6c7ea8448bf01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:35 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-1dfc374a-2e52-4877-8bd7-7522ec5ae111 tempest-CreateVolumesFromImageTest-239318328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15adb274-1820-4a90-83e4-77ada2c8c040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:35 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-1dfc374a-2e52-4877-8bd7-7522ec5ae111 tempest-CreateVolumesFromImageTest-239318328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15adb274-1820-4a90-83e4-77ada2c8c040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:35 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-1dfc374a-2e52-4877-8bd7-7522ec5ae111 tempest-CreateVolumesFromImageTest-239318328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (298e6afe-3feb-4eec-8e64-7af48d48e8f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:35 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-1dfc374a-2e52-4877-8bd7-7522ec5ae111 tempest-CreateVolumesFromImageTest-239318328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (298e6afe-3feb-4eec-8e64-7af48d48e8f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3bae42b-31f7-443b-b940-e3400a5f8569', 'volume_name': 'volume-a3bae42b-31f7-443b-b940-e3400a5f8569', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:35 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-1dfc374a-2e52-4877-8bd7-7522ec5ae111 tempest-CreateVolumesFromImageTest-239318328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ac83bf3-f8d9-4990-b962-980424a48c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:35 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-1dfc374a-2e52-4877-8bd7-7522ec5ae111 tempest-CreateVolumesFromImageTest-239318328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ac83bf3-f8d9-4990-b962-980424a48c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:35 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-1dfc374a-2e52-4877-8bd7-7522ec5ae111 tempest-CreateVolumesFromImageTest-239318328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2b696fd-d484-4831-be57-9fffc938c300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:35 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-1dfc374a-2e52-4877-8bd7-7522ec5ae111 tempest-CreateVolumesFromImageTest-239318328 None] Volume a3bae42b-31f7-443b-b940-e3400a5f8569: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3bae42b-31f7-443b-b940-e3400a5f8569', 'volume_size': 1} Sep 18 21:48:35 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-1dfc374a-2e52-4877-8bd7-7522ec5ae111 tempest-CreateVolumesFromImageTest-239318328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:48:35 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-e456809e-9c86-4646-925e-9d7c42322db4 tempest-VolumesGetTest-2025585433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:48:35 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-e456809e-9c86-4646-925e-9d7c42322db4 tempest-VolumesGetTest-2025585433 None] Flow 'volume_create_manager' (5175a204-eb79-4db6-a42c-42c3fb66a2d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:48:35 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-e456809e-9c86-4646-925e-9d7c42322db4 tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6fb7a57-8cb5-46b2-a22c-37ee9307d610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:35 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-e456809e-9c86-4646-925e-9d7c42322db4 tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6fb7a57-8cb5-46b2-a22c-37ee9307d610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:48:35Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-350779687',display_name='tempest-VolumesGetTest-Volume-1411075116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23fb2203-f0fb-4784-9ae2-271988581a1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6cd15df09da425c84d7c465a1bd7b81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:48:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:48:35Z,use_quota=True,user_id='93d906f234b946cea603ec1bfebe96ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:35 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-e456809e-9c86-4646-925e-9d7c42322db4 tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (672cb7eb-8c9c-4ff4-8941-138fdeebefcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:35 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-e456809e-9c86-4646-925e-9d7c42322db4 tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (672cb7eb-8c9c-4ff4-8941-138fdeebefcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:35 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-e456809e-9c86-4646-925e-9d7c42322db4 tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3a93b9f-3cff-477a-bcb2-327ffbd8eb3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:35 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-e456809e-9c86-4646-925e-9d7c42322db4 tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3a93b9f-3cff-477a-bcb2-327ffbd8eb3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23fb2203-f0fb-4784-9ae2-271988581a1e', 'volume_name': 'volume-23fb2203-f0fb-4784-9ae2-271988581a1e', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:35 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-e456809e-9c86-4646-925e-9d7c42322db4 tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73d3f822-99c2-45fb-b069-75d3212c1176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:35 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-e456809e-9c86-4646-925e-9d7c42322db4 tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73d3f822-99c2-45fb-b069-75d3212c1176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:35 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-e456809e-9c86-4646-925e-9d7c42322db4 tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb3d4d0a-e6f1-48c6-88c1-bd4b25138013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:35 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-e456809e-9c86-4646-925e-9d7c42322db4 tempest-VolumesGetTest-2025585433 None] Volume 23fb2203-f0fb-4784-9ae2-271988581a1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23fb2203-f0fb-4784-9ae2-271988581a1e', 'volume_size': 1} Sep 18 21:48:35 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-e456809e-9c86-4646-925e-9d7c42322db4 tempest-VolumesGetTest-2025585433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:48:35 devstack sudo[102889]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:35 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d550527f-0c98-4bd6-91a8-49af84c0bd60 tempest-CreateVolumesFromImageTest-239318328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-beed53e8-2a23-4349-a6e2-0ed64eed1f13" returned: 0 in 0.399s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:35 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-d550527f-0c98-4bd6-91a8-49af84c0bd60 tempest-CreateVolumesFromImageTest-239318328 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:48:35 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-d550527f-0c98-4bd6-91a8-49af84c0bd60 tempest-CreateVolumesFromImageTest-239318328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:48:35 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-5b81de70-697e-45ee-b9da-1f9770f24f9e tempest-CreateVolumesFromImageTest-239318328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.589s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:48:35 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-5b81de70-697e-45ee-b9da-1f9770f24f9e tempest-CreateVolumesFromImageTest-239318328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:48:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-675136652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dd9726b-0ea0-4028-b1f9-e820c1f16894,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77e90140436344d6b20b05613fce2a37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:48:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:48:35Z,use_quota=True,user_id='accc880f8cf347f1b8f6c7ea8448bf01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:48:35 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-5b81de70-697e-45ee-b9da-1f9770f24f9e tempest-CreateVolumesFromImageTest-239318328 None] Creating volume 7dd9726b-0ea0-4028-b1f9-e820c1f16894 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:48:35 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-5b81de70-697e-45ee-b9da-1f9770f24f9e tempest-CreateVolumesFromImageTest-239318328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:48:35 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-5b81de70-697e-45ee-b9da-1f9770f24f9e tempest-CreateVolumesFromImageTest-239318328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:48:35 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-5b81de70-697e-45ee-b9da-1f9770f24f9e tempest-CreateVolumesFromImageTest-239318328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:48:35 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-5b81de70-697e-45ee-b9da-1f9770f24f9e tempest-CreateVolumesFromImageTest-239318328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:48:35 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-5b81de70-697e-45ee-b9da-1f9770f24f9e tempest-CreateVolumesFromImageTest-239318328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:48:35 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-5b81de70-697e-45ee-b9da-1f9770f24f9e tempest-CreateVolumesFromImageTest-239318328 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:48:35 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-5b81de70-697e-45ee-b9da-1f9770f24f9e tempest-CreateVolumesFromImageTest-239318328 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:48:35 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5b81de70-697e-45ee-b9da-1f9770f24f9e tempest-CreateVolumesFromImageTest-239318328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7dd9726b-0ea0-4028-b1f9-e820c1f16894 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:35 devstack sudo[102892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7dd9726b-0ea0-4028-b1f9-e820c1f16894 1073741824 Sep 18 21:48:35 devstack sudo[102892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:35 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d550527f-0c98-4bd6-91a8-49af84c0bd60 tempest-CreateVolumesFromImageTest-239318328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b444311b-2cc4-4371-a504-7e1947723e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-beed53e8-2a23-4349-a6e2-0ed64eed1f13', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:35 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d550527f-0c98-4bd6-91a8-49af84c0bd60 tempest-CreateVolumesFromImageTest-239318328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d4f22e0-6e3e-4e56-8558-1f3a298903f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:35 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-d550527f-0c98-4bd6-91a8-49af84c0bd60 tempest-CreateVolumesFromImageTest-239318328 None] Volume volume-beed53e8-2a23-4349-a6e2-0ed64eed1f13 (beed53e8-2a23-4349-a6e2-0ed64eed1f13): created successfully Sep 18 21:48:35 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d550527f-0c98-4bd6-91a8-49af84c0bd60 tempest-CreateVolumesFromImageTest-239318328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d4f22e0-6e3e-4e56-8558-1f3a298903f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:35 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d550527f-0c98-4bd6-91a8-49af84c0bd60 tempest-CreateVolumesFromImageTest-239318328 None] Flow 'volume_create_manager' (f1b01e8b-4722-4ac0-bef3-90d206d91d81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:48:35 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-1aefbc92-05bd-4673-97e3-e64486e7c998 tempest-CreateVolumesFromImageTest-239318328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:48:35 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-1aefbc92-05bd-4673-97e3-e64486e7c998 tempest-CreateVolumesFromImageTest-239318328 None] Flow 'volume_create_manager' (3397194b-6885-4526-b529-45cbd33095b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:48:35 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-1aefbc92-05bd-4673-97e3-e64486e7c998 tempest-CreateVolumesFromImageTest-239318328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e0f784d-638f-4c68-a53c-5738aa536ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:35 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-d550527f-0c98-4bd6-91a8-49af84c0bd60 tempest-CreateVolumesFromImageTest-239318328 None] Created volume successfully. Sep 18 21:48:35 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-1aefbc92-05bd-4673-97e3-e64486e7c998 tempest-CreateVolumesFromImageTest-239318328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e0f784d-638f-4c68-a53c-5738aa536ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:48:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-203822434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c49b1201-2e5b-433f-916a-c62cf23344d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77e90140436344d6b20b05613fce2a37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:48:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:48:36Z,use_quota=True,user_id='accc880f8cf347f1b8f6c7ea8448bf01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:35 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-1aefbc92-05bd-4673-97e3-e64486e7c998 tempest-CreateVolumesFromImageTest-239318328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7845fa0a-a423-4f7a-9e5d-2c4efb084d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:35 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-1aefbc92-05bd-4673-97e3-e64486e7c998 tempest-CreateVolumesFromImageTest-239318328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7845fa0a-a423-4f7a-9e5d-2c4efb084d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:35 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-1aefbc92-05bd-4673-97e3-e64486e7c998 tempest-CreateVolumesFromImageTest-239318328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed5099f5-b1aa-4470-9a48-b4c1e91f02be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:35 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-1aefbc92-05bd-4673-97e3-e64486e7c998 tempest-CreateVolumesFromImageTest-239318328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed5099f5-b1aa-4470-9a48-b4c1e91f02be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c49b1201-2e5b-433f-916a-c62cf23344d9', 'volume_name': 'volume-c49b1201-2e5b-433f-916a-c62cf23344d9', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:35 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-1aefbc92-05bd-4673-97e3-e64486e7c998 tempest-CreateVolumesFromImageTest-239318328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cc5cae9-4f6c-4ebb-aec1-d1f31c20dca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:35 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-1aefbc92-05bd-4673-97e3-e64486e7c998 tempest-CreateVolumesFromImageTest-239318328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cc5cae9-4f6c-4ebb-aec1-d1f31c20dca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:35 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-1aefbc92-05bd-4673-97e3-e64486e7c998 tempest-CreateVolumesFromImageTest-239318328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80d84fa6-0ed2-469f-a851-ffe04f68916f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:35 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-1aefbc92-05bd-4673-97e3-e64486e7c998 tempest-CreateVolumesFromImageTest-239318328 None] Volume c49b1201-2e5b-433f-916a-c62cf23344d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c49b1201-2e5b-433f-916a-c62cf23344d9', 'volume_size': 1} Sep 18 21:48:35 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-1aefbc92-05bd-4673-97e3-e64486e7c998 tempest-CreateVolumesFromImageTest-239318328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:48:36 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-a42dddbb-fea3-4486-9e74-5e98fdc71349 tempest-ProjectReaderTests-789285419 None] Acquiring lock "cinder-6cf368a2-83dc-48bf-92d3-f21bcaf96ea1-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:48:36 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-a42dddbb-fea3-4486-9e74-5e98fdc71349 tempest-ProjectReaderTests-789285419 None] Lock "cinder-6cf368a2-83dc-48bf-92d3-f21bcaf96ea1-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:48:36 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-db7a301d-2c76-46df-a6ea-d0225953abcb tempest-CreateVolumesFromImageTest-239318328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:48:36 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-db7a301d-2c76-46df-a6ea-d0225953abcb tempest-CreateVolumesFromImageTest-239318328 None] Flow 'volume_create_manager' (0ca462e0-3a13-4464-82a9-124ae52131b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:48:36 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-db7a301d-2c76-46df-a6ea-d0225953abcb tempest-CreateVolumesFromImageTest-239318328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74578de2-cb96-4efc-93b1-2a143156361a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:36 devstack sudo[102892]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:36 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-db7a301d-2c76-46df-a6ea-d0225953abcb tempest-CreateVolumesFromImageTest-239318328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74578de2-cb96-4efc-93b1-2a143156361a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:48:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1835063831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b49ae956-9743-4892-bcd6-fc71573cb730,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77e90140436344d6b20b05613fce2a37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:48:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:48:36Z,use_quota=True,user_id='accc880f8cf347f1b8f6c7ea8448bf01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:36 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-db7a301d-2c76-46df-a6ea-d0225953abcb tempest-CreateVolumesFromImageTest-239318328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23f70d07-6863-496c-90f7-47f33316b5bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:36 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-db7a301d-2c76-46df-a6ea-d0225953abcb tempest-CreateVolumesFromImageTest-239318328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23f70d07-6863-496c-90f7-47f33316b5bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:36 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-db7a301d-2c76-46df-a6ea-d0225953abcb tempest-CreateVolumesFromImageTest-239318328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f624f20d-170e-4dfd-a334-a1d2cbe7b1db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:36 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-db7a301d-2c76-46df-a6ea-d0225953abcb tempest-CreateVolumesFromImageTest-239318328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f624f20d-170e-4dfd-a334-a1d2cbe7b1db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b49ae956-9743-4892-bcd6-fc71573cb730', 'volume_name': 'volume-b49ae956-9743-4892-bcd6-fc71573cb730', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:36 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-db7a301d-2c76-46df-a6ea-d0225953abcb tempest-CreateVolumesFromImageTest-239318328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4939b3a-544e-4a7b-a499-566474d4ac01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:36 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-db7a301d-2c76-46df-a6ea-d0225953abcb tempest-CreateVolumesFromImageTest-239318328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4939b3a-544e-4a7b-a499-566474d4ac01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:36 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-db7a301d-2c76-46df-a6ea-d0225953abcb tempest-CreateVolumesFromImageTest-239318328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdbf40fc-8026-48ea-915b-46674bfa27a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:36 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-db7a301d-2c76-46df-a6ea-d0225953abcb tempest-CreateVolumesFromImageTest-239318328 None] Volume b49ae956-9743-4892-bcd6-fc71573cb730: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b49ae956-9743-4892-bcd6-fc71573cb730', 'volume_size': 1} Sep 18 21:48:36 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-db7a301d-2c76-46df-a6ea-d0225953abcb tempest-CreateVolumesFromImageTest-239318328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:48:36 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5b81de70-697e-45ee-b9da-1f9770f24f9e tempest-CreateVolumesFromImageTest-239318328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7dd9726b-0ea0-4028-b1f9-e820c1f16894 1073741824" returned: 0 in 0.653s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:36 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-a42dddbb-fea3-4486-9e74-5e98fdc71349 tempest-ProjectReaderTests-789285419 None] Acquiring lock "cinder-quobyte-6cf368a2-83dc-48bf-92d3-f21bcaf96ea1" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:48:36 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-a42dddbb-fea3-4486-9e74-5e98fdc71349 tempest-ProjectReaderTests-789285419 None] Lock "cinder-quobyte-6cf368a2-83dc-48bf-92d3-f21bcaf96ea1" acquired by "delete_volume" :: waited 0.017s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:48:36 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5b81de70-697e-45ee-b9da-1f9770f24f9e tempest-CreateVolumesFromImageTest-239318328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7dd9726b-0ea0-4028-b1f9-e820c1f16894 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:36 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe8c0ac-df8c-4c2a-945c-7591f851b966]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:48:36 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-a42dddbb-fea3-4486-9e74-5e98fdc71349 tempest-ProjectReaderTests-789285419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-6cf368a2-83dc-48bf-92d3-f21bcaf96ea1 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:36 devstack sudo[102898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7dd9726b-0ea0-4028-b1f9-e820c1f16894 Sep 18 21:48:36 devstack sudo[102898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:36 devstack sudo[102899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-6cf368a2-83dc-48bf-92d3-f21bcaf96ea1 Sep 18 21:48:36 devstack sudo[102899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:36 devstack sudo[102898]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:36 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5b81de70-697e-45ee-b9da-1f9770f24f9e tempest-CreateVolumesFromImageTest-239318328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7dd9726b-0ea0-4028-b1f9-e820c1f16894" returned: 0 in 0.240s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:36 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-5b81de70-697e-45ee-b9da-1f9770f24f9e tempest-CreateVolumesFromImageTest-239318328 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:48:36 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-5b81de70-697e-45ee-b9da-1f9770f24f9e tempest-CreateVolumesFromImageTest-239318328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:48:36 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-1dfc374a-2e52-4877-8bd7-7522ec5ae111 tempest-CreateVolumesFromImageTest-239318328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.211s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:48:36 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-1dfc374a-2e52-4877-8bd7-7522ec5ae111 tempest-CreateVolumesFromImageTest-239318328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:48:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1980504004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3bae42b-31f7-443b-b940-e3400a5f8569,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77e90140436344d6b20b05613fce2a37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:48:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:48:35Z,use_quota=True,user_id='accc880f8cf347f1b8f6c7ea8448bf01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:48:36 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-1dfc374a-2e52-4877-8bd7-7522ec5ae111 tempest-CreateVolumesFromImageTest-239318328 None] Creating volume a3bae42b-31f7-443b-b940-e3400a5f8569 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:48:36 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-1dfc374a-2e52-4877-8bd7-7522ec5ae111 tempest-CreateVolumesFromImageTest-239318328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:48:36 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-1dfc374a-2e52-4877-8bd7-7522ec5ae111 tempest-CreateVolumesFromImageTest-239318328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:48:36 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-1dfc374a-2e52-4877-8bd7-7522ec5ae111 tempest-CreateVolumesFromImageTest-239318328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:48:36 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-1dfc374a-2e52-4877-8bd7-7522ec5ae111 tempest-CreateVolumesFromImageTest-239318328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:48:36 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-1dfc374a-2e52-4877-8bd7-7522ec5ae111 tempest-CreateVolumesFromImageTest-239318328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:48:36 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-1dfc374a-2e52-4877-8bd7-7522ec5ae111 tempest-CreateVolumesFromImageTest-239318328 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:48:36 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-1dfc374a-2e52-4877-8bd7-7522ec5ae111 tempest-CreateVolumesFromImageTest-239318328 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:48:36 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1dfc374a-2e52-4877-8bd7-7522ec5ae111 tempest-CreateVolumesFromImageTest-239318328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a3bae42b-31f7-443b-b940-e3400a5f8569 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:36 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-5b81de70-697e-45ee-b9da-1f9770f24f9e tempest-CreateVolumesFromImageTest-239318328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24ab93fb-8740-463e-8b2b-a4ca89e65dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7dd9726b-0ea0-4028-b1f9-e820c1f16894', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:36 devstack sudo[102903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a3bae42b-31f7-443b-b940-e3400a5f8569 1073741824 Sep 18 21:48:36 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-5b81de70-697e-45ee-b9da-1f9770f24f9e tempest-CreateVolumesFromImageTest-239318328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45fbabb2-5d13-4221-a2a8-bd2eb7e57895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:36 devstack sudo[102903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:36 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-5b81de70-697e-45ee-b9da-1f9770f24f9e tempest-CreateVolumesFromImageTest-239318328 None] Volume volume-7dd9726b-0ea0-4028-b1f9-e820c1f16894 (7dd9726b-0ea0-4028-b1f9-e820c1f16894): created successfully Sep 18 21:48:36 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-5b81de70-697e-45ee-b9da-1f9770f24f9e tempest-CreateVolumesFromImageTest-239318328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45fbabb2-5d13-4221-a2a8-bd2eb7e57895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:36 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-5b81de70-697e-45ee-b9da-1f9770f24f9e tempest-CreateVolumesFromImageTest-239318328 None] Flow 'volume_create_manager' (95146ce0-8d1f-4d6a-8581-36b3fcb3bc7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:48:36 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-5b81de70-697e-45ee-b9da-1f9770f24f9e tempest-CreateVolumesFromImageTest-239318328 None] Created volume successfully. Sep 18 21:48:36 devstack sudo[102899]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:36 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-a42dddbb-fea3-4486-9e74-5e98fdc71349 tempest-ProjectReaderTests-789285419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-6cf368a2-83dc-48bf-92d3-f21bcaf96ea1" returned: 0 in 0.389s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:36 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-a42dddbb-fea3-4486-9e74-5e98fdc71349 tempest-ProjectReaderTests-789285419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-6cf368a2-83dc-48bf-92d3-f21bcaf96ea1 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:36 devstack sudo[102908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-6cf368a2-83dc-48bf-92d3-f21bcaf96ea1 Sep 18 21:48:36 devstack sudo[102908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:36 devstack sudo[102908]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:36 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-a42dddbb-fea3-4486-9e74-5e98fdc71349 tempest-ProjectReaderTests-789285419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-6cf368a2-83dc-48bf-92d3-f21bcaf96ea1" returned: 0 in 0.258s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:36 devstack sudo[102903]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:37 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1dfc374a-2e52-4877-8bd7-7522ec5ae111 tempest-CreateVolumesFromImageTest-239318328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a3bae42b-31f7-443b-b940-e3400a5f8569 1073741824" returned: 0 in 0.418s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:37 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-a42dddbb-fea3-4486-9e74-5e98fdc71349 tempest-ProjectReaderTests-789285419 None] Lock "cinder-quobyte-6cf368a2-83dc-48bf-92d3-f21bcaf96ea1" released by "delete_volume" :: held 0.701s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:48:37 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1dfc374a-2e52-4877-8bd7-7522ec5ae111 tempest-CreateVolumesFromImageTest-239318328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a3bae42b-31f7-443b-b940-e3400a5f8569 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:37 devstack sudo[102914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a3bae42b-31f7-443b-b940-e3400a5f8569 Sep 18 21:48:37 devstack sudo[102914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:37 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-a42dddbb-fea3-4486-9e74-5e98fdc71349 tempest-ProjectReaderTests-789285419 None] Created reservations ['aa475371-afd3-4cb5-a0cb-1ebb6ee6e08b', '7fa87d7b-c7d9-429c-a96d-d85cd15adfaf', 'c922b200-1dac-4973-bf62-7aacdaeb081d', 'db8930b3-35cd-4349-b38f-d1e347bcf473'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:48:37 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-a42dddbb-fea3-4486-9e74-5e98fdc71349 tempest-ProjectReaderTests-789285419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:48:37 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-a42dddbb-fea3-4486-9e74-5e98fdc71349 tempest-ProjectReaderTests-789285419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:48:37 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-a42dddbb-fea3-4486-9e74-5e98fdc71349 tempest-ProjectReaderTests-789285419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:48:37 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-a42dddbb-fea3-4486-9e74-5e98fdc71349 tempest-ProjectReaderTests-789285419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:48:37 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-a42dddbb-fea3-4486-9e74-5e98fdc71349 tempest-ProjectReaderTests-789285419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:48:37 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-a42dddbb-fea3-4486-9e74-5e98fdc71349 tempest-ProjectReaderTests-789285419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:37 devstack sudo[102916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:48:37 devstack sudo[102916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:37 devstack sudo[102914]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:37 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1dfc374a-2e52-4877-8bd7-7522ec5ae111 tempest-CreateVolumesFromImageTest-239318328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a3bae42b-31f7-443b-b940-e3400a5f8569" returned: 0 in 0.268s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:37 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-1dfc374a-2e52-4877-8bd7-7522ec5ae111 tempest-CreateVolumesFromImageTest-239318328 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:48:37 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-1dfc374a-2e52-4877-8bd7-7522ec5ae111 tempest-CreateVolumesFromImageTest-239318328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:48:37 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-e456809e-9c86-4646-925e-9d7c42322db4 tempest-VolumesGetTest-2025585433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.744s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:48:37 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-e456809e-9c86-4646-925e-9d7c42322db4 tempest-VolumesGetTest-2025585433 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:48:35Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-350779687',display_name='tempest-VolumesGetTest-Volume-1411075116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23fb2203-f0fb-4784-9ae2-271988581a1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6cd15df09da425c84d7c465a1bd7b81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:48:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:48:35Z,use_quota=True,user_id='93d906f234b946cea603ec1bfebe96ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:48:37 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-e456809e-9c86-4646-925e-9d7c42322db4 tempest-VolumesGetTest-2025585433 None] Creating volume 23fb2203-f0fb-4784-9ae2-271988581a1e {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:48:37 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-e456809e-9c86-4646-925e-9d7c42322db4 tempest-VolumesGetTest-2025585433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:48:37 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-e456809e-9c86-4646-925e-9d7c42322db4 tempest-VolumesGetTest-2025585433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:48:37 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-e456809e-9c86-4646-925e-9d7c42322db4 tempest-VolumesGetTest-2025585433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:48:37 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-e456809e-9c86-4646-925e-9d7c42322db4 tempest-VolumesGetTest-2025585433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:48:37 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-e456809e-9c86-4646-925e-9d7c42322db4 tempest-VolumesGetTest-2025585433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:48:37 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-e456809e-9c86-4646-925e-9d7c42322db4 tempest-VolumesGetTest-2025585433 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:48:37 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-e456809e-9c86-4646-925e-9d7c42322db4 tempest-VolumesGetTest-2025585433 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:48:37 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e456809e-9c86-4646-925e-9d7c42322db4 tempest-VolumesGetTest-2025585433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-23fb2203-f0fb-4784-9ae2-271988581a1e 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:37 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-1dfc374a-2e52-4877-8bd7-7522ec5ae111 tempest-CreateVolumesFromImageTest-239318328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2b696fd-d484-4831-be57-9fffc938c300) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3bae42b-31f7-443b-b940-e3400a5f8569', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:37 devstack sudo[102919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-23fb2203-f0fb-4784-9ae2-271988581a1e 1073741824 Sep 18 21:48:37 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-1dfc374a-2e52-4877-8bd7-7522ec5ae111 tempest-CreateVolumesFromImageTest-239318328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a615bf4-adea-4f8a-8a23-a2d0deeb5045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:37 devstack sudo[102919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:37 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-1dfc374a-2e52-4877-8bd7-7522ec5ae111 tempest-CreateVolumesFromImageTest-239318328 None] Volume volume-a3bae42b-31f7-443b-b940-e3400a5f8569 (a3bae42b-31f7-443b-b940-e3400a5f8569): created successfully Sep 18 21:48:37 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-1dfc374a-2e52-4877-8bd7-7522ec5ae111 tempest-CreateVolumesFromImageTest-239318328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a615bf4-adea-4f8a-8a23-a2d0deeb5045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:37 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-1dfc374a-2e52-4877-8bd7-7522ec5ae111 tempest-CreateVolumesFromImageTest-239318328 None] Flow 'volume_create_manager' (5ebc13f7-6a81-4b4c-877f-fabb3be15624) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:48:37 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-1dfc374a-2e52-4877-8bd7-7522ec5ae111 tempest-CreateVolumesFromImageTest-239318328 None] Created volume successfully. Sep 18 21:48:37 devstack sudo[102916]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:37 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-a42dddbb-fea3-4486-9e74-5e98fdc71349 tempest-ProjectReaderTests-789285419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.282s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:37 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-a42dddbb-fea3-4486-9e74-5e98fdc71349 tempest-ProjectReaderTests-789285419 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:48:37 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-a42dddbb-fea3-4486-9e74-5e98fdc71349 tempest-ProjectReaderTests-789285419 None] Deleted volume successfully. Sep 18 21:48:37 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-a42dddbb-fea3-4486-9e74-5e98fdc71349 tempest-ProjectReaderTests-789285419 None] Lock "cinder-6cf368a2-83dc-48bf-92d3-f21bcaf96ea1-delete_volume" released by "delete_volume" :: held 1.316s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:48:37 devstack sudo[102919]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:37 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e456809e-9c86-4646-925e-9d7c42322db4 tempest-VolumesGetTest-2025585433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-23fb2203-f0fb-4784-9ae2-271988581a1e 1073741824" returned: 0 in 0.520s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:37 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-33b9c51a-71a9-4b30-946b-1596893e8954 tempest-ProjectReaderTests-789285419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:48:37 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-33b9c51a-71a9-4b30-946b-1596893e8954 tempest-ProjectReaderTests-789285419 None] Flow 'volume_create_manager' (b025141a-cacc-4c71-b1c3-9e9e878a52cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:48:37 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-33b9c51a-71a9-4b30-946b-1596893e8954 tempest-ProjectReaderTests-789285419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e9663d1-ca3e-4893-8aed-bca945eb47e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:37 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e456809e-9c86-4646-925e-9d7c42322db4 tempest-VolumesGetTest-2025585433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-23fb2203-f0fb-4784-9ae2-271988581a1e {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:37 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-33b9c51a-71a9-4b30-946b-1596893e8954 tempest-ProjectReaderTests-789285419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e9663d1-ca3e-4893-8aed-bca945eb47e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:48:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-384962531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1363dca6-7ab8-4b7f-9fa0-691f5673e004,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e742561c2194d10a762398f87f7ceae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:48:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:48:38Z,use_quota=True,user_id='ffe6de373d4445e3b3cfe01d62bed581',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:37 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-33b9c51a-71a9-4b30-946b-1596893e8954 tempest-ProjectReaderTests-789285419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b8a5c60-4442-4c5a-a699-e092aa090433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:37 devstack sudo[102926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-23fb2203-f0fb-4784-9ae2-271988581a1e Sep 18 21:48:37 devstack sudo[102926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:37 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-33b9c51a-71a9-4b30-946b-1596893e8954 tempest-ProjectReaderTests-789285419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b8a5c60-4442-4c5a-a699-e092aa090433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:37 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-33b9c51a-71a9-4b30-946b-1596893e8954 tempest-ProjectReaderTests-789285419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b172ad0c-63dc-4f35-9fa2-b0c183206565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:37 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-33b9c51a-71a9-4b30-946b-1596893e8954 tempest-ProjectReaderTests-789285419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b172ad0c-63dc-4f35-9fa2-b0c183206565) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1363dca6-7ab8-4b7f-9fa0-691f5673e004', 'volume_name': 'volume-1363dca6-7ab8-4b7f-9fa0-691f5673e004', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:37 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-33b9c51a-71a9-4b30-946b-1596893e8954 tempest-ProjectReaderTests-789285419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2d50d99-9451-4336-9e4f-41e2c9758d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:37 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-33b9c51a-71a9-4b30-946b-1596893e8954 tempest-ProjectReaderTests-789285419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2d50d99-9451-4336-9e4f-41e2c9758d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:37 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-33b9c51a-71a9-4b30-946b-1596893e8954 tempest-ProjectReaderTests-789285419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b9c54b1-66bb-4d03-9545-cf55a03f2224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:37 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-33b9c51a-71a9-4b30-946b-1596893e8954 tempest-ProjectReaderTests-789285419 None] Volume 1363dca6-7ab8-4b7f-9fa0-691f5673e004: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1363dca6-7ab8-4b7f-9fa0-691f5673e004', 'volume_size': 1} Sep 18 21:48:37 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-33b9c51a-71a9-4b30-946b-1596893e8954 tempest-ProjectReaderTests-789285419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:48:38 devstack sudo[102926]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:38 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e456809e-9c86-4646-925e-9d7c42322db4 tempest-VolumesGetTest-2025585433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-23fb2203-f0fb-4784-9ae2-271988581a1e" returned: 0 in 0.241s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:38 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-e456809e-9c86-4646-925e-9d7c42322db4 tempest-VolumesGetTest-2025585433 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:48:38 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-e456809e-9c86-4646-925e-9d7c42322db4 tempest-VolumesGetTest-2025585433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:48:38 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-1aefbc92-05bd-4673-97e3-e64486e7c998 tempest-CreateVolumesFromImageTest-239318328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.256s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:48:38 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-1aefbc92-05bd-4673-97e3-e64486e7c998 tempest-CreateVolumesFromImageTest-239318328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:48:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-203822434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c49b1201-2e5b-433f-916a-c62cf23344d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77e90140436344d6b20b05613fce2a37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:48:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:48:36Z,use_quota=True,user_id='accc880f8cf347f1b8f6c7ea8448bf01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:48:38 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-1aefbc92-05bd-4673-97e3-e64486e7c998 tempest-CreateVolumesFromImageTest-239318328 None] Creating volume c49b1201-2e5b-433f-916a-c62cf23344d9 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:48:38 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-1aefbc92-05bd-4673-97e3-e64486e7c998 tempest-CreateVolumesFromImageTest-239318328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:48:38 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-1aefbc92-05bd-4673-97e3-e64486e7c998 tempest-CreateVolumesFromImageTest-239318328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:48:38 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-1aefbc92-05bd-4673-97e3-e64486e7c998 tempest-CreateVolumesFromImageTest-239318328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:48:38 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-1aefbc92-05bd-4673-97e3-e64486e7c998 tempest-CreateVolumesFromImageTest-239318328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:48:38 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-1aefbc92-05bd-4673-97e3-e64486e7c998 tempest-CreateVolumesFromImageTest-239318328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:48:38 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-1aefbc92-05bd-4673-97e3-e64486e7c998 tempest-CreateVolumesFromImageTest-239318328 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:48:38 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-1aefbc92-05bd-4673-97e3-e64486e7c998 tempest-CreateVolumesFromImageTest-239318328 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:48:38 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1aefbc92-05bd-4673-97e3-e64486e7c998 tempest-CreateVolumesFromImageTest-239318328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c49b1201-2e5b-433f-916a-c62cf23344d9 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:38 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-e456809e-9c86-4646-925e-9d7c42322db4 tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb3d4d0a-e6f1-48c6-88c1-bd4b25138013) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23fb2203-f0fb-4784-9ae2-271988581a1e', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:38 devstack sudo[102929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c49b1201-2e5b-433f-916a-c62cf23344d9 1073741824 Sep 18 21:48:38 devstack sudo[102929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:38 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-e456809e-9c86-4646-925e-9d7c42322db4 tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80392734-a192-4bc3-81ad-9a3d33806983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:38 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-e456809e-9c86-4646-925e-9d7c42322db4 tempest-VolumesGetTest-2025585433 None] Volume volume-23fb2203-f0fb-4784-9ae2-271988581a1e (23fb2203-f0fb-4784-9ae2-271988581a1e): created successfully Sep 18 21:48:38 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-e456809e-9c86-4646-925e-9d7c42322db4 tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80392734-a192-4bc3-81ad-9a3d33806983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:38 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-e456809e-9c86-4646-925e-9d7c42322db4 tempest-VolumesGetTest-2025585433 None] Flow 'volume_create_manager' (5175a204-eb79-4db6-a42c-42c3fb66a2d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:48:38 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-e456809e-9c86-4646-925e-9d7c42322db4 tempest-VolumesGetTest-2025585433 None] Created volume successfully. Sep 18 21:48:38 devstack sudo[102929]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:38 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1aefbc92-05bd-4673-97e3-e64486e7c998 tempest-CreateVolumesFromImageTest-239318328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c49b1201-2e5b-433f-916a-c62cf23344d9 1073741824" returned: 0 in 0.429s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:38 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1aefbc92-05bd-4673-97e3-e64486e7c998 tempest-CreateVolumesFromImageTest-239318328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c49b1201-2e5b-433f-916a-c62cf23344d9 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:38 devstack sudo[102935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c49b1201-2e5b-433f-916a-c62cf23344d9 Sep 18 21:48:38 devstack sudo[102935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:38 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-44842b3e-0167-42f5-af7d-c81b2e43b394 tempest-VolumesGetTest-2025585433 None] Acquiring lock "cinder-23fb2203-f0fb-4784-9ae2-271988581a1e-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:48:38 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-44842b3e-0167-42f5-af7d-c81b2e43b394 tempest-VolumesGetTest-2025585433 None] Lock "cinder-23fb2203-f0fb-4784-9ae2-271988581a1e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:48:38 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-44842b3e-0167-42f5-af7d-c81b2e43b394 tempest-VolumesGetTest-2025585433 None] Acquiring lock "cinder-quobyte-23fb2203-f0fb-4784-9ae2-271988581a1e" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:48:38 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-44842b3e-0167-42f5-af7d-c81b2e43b394 tempest-VolumesGetTest-2025585433 None] Lock "cinder-quobyte-23fb2203-f0fb-4784-9ae2-271988581a1e" acquired by "delete_volume" :: waited 0.018s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:48:38 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c4df1a7-cac5-41c2-8578-b9fa01efc2c6]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:48:38 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-44842b3e-0167-42f5-af7d-c81b2e43b394 tempest-VolumesGetTest-2025585433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-23fb2203-f0fb-4784-9ae2-271988581a1e {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:38 devstack sudo[102935]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:38 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1aefbc92-05bd-4673-97e3-e64486e7c998 tempest-CreateVolumesFromImageTest-239318328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c49b1201-2e5b-433f-916a-c62cf23344d9" returned: 0 in 0.273s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:38 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-1aefbc92-05bd-4673-97e3-e64486e7c998 tempest-CreateVolumesFromImageTest-239318328 None] <== create_volume: return (747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:48:38 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-1aefbc92-05bd-4673-97e3-e64486e7c998 tempest-CreateVolumesFromImageTest-239318328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:48:38 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-db7a301d-2c76-46df-a6ea-d0225953abcb tempest-CreateVolumesFromImageTest-239318328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.664s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:48:38 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-db7a301d-2c76-46df-a6ea-d0225953abcb tempest-CreateVolumesFromImageTest-239318328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:48:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1835063831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b49ae956-9743-4892-bcd6-fc71573cb730,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77e90140436344d6b20b05613fce2a37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:48:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:48:36Z,use_quota=True,user_id='accc880f8cf347f1b8f6c7ea8448bf01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:48:38 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-db7a301d-2c76-46df-a6ea-d0225953abcb tempest-CreateVolumesFromImageTest-239318328 None] Creating volume b49ae956-9743-4892-bcd6-fc71573cb730 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:48:38 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-db7a301d-2c76-46df-a6ea-d0225953abcb tempest-CreateVolumesFromImageTest-239318328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:48:38 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-db7a301d-2c76-46df-a6ea-d0225953abcb tempest-CreateVolumesFromImageTest-239318328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:48:38 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-db7a301d-2c76-46df-a6ea-d0225953abcb tempest-CreateVolumesFromImageTest-239318328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:48:38 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-db7a301d-2c76-46df-a6ea-d0225953abcb tempest-CreateVolumesFromImageTest-239318328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:48:38 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-db7a301d-2c76-46df-a6ea-d0225953abcb tempest-CreateVolumesFromImageTest-239318328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:48:38 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-db7a301d-2c76-46df-a6ea-d0225953abcb tempest-CreateVolumesFromImageTest-239318328 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:48:38 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-db7a301d-2c76-46df-a6ea-d0225953abcb tempest-CreateVolumesFromImageTest-239318328 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:48:38 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-db7a301d-2c76-46df-a6ea-d0225953abcb tempest-CreateVolumesFromImageTest-239318328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b49ae956-9743-4892-bcd6-fc71573cb730 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:38 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-1aefbc92-05bd-4673-97e3-e64486e7c998 tempest-CreateVolumesFromImageTest-239318328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80d84fa6-0ed2-469f-a851-ffe04f68916f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c49b1201-2e5b-433f-916a-c62cf23344d9', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:38 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-1aefbc92-05bd-4673-97e3-e64486e7c998 tempest-CreateVolumesFromImageTest-239318328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17695855-d844-476f-ae6f-e6272e95064a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:38 devstack sudo[102939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b49ae956-9743-4892-bcd6-fc71573cb730 1073741824 Sep 18 21:48:38 devstack sudo[102939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:38 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-1aefbc92-05bd-4673-97e3-e64486e7c998 tempest-CreateVolumesFromImageTest-239318328 None] Volume volume-c49b1201-2e5b-433f-916a-c62cf23344d9 (c49b1201-2e5b-433f-916a-c62cf23344d9): created successfully Sep 18 21:48:38 devstack sudo[102937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-23fb2203-f0fb-4784-9ae2-271988581a1e Sep 18 21:48:38 devstack sudo[102937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:38 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-1aefbc92-05bd-4673-97e3-e64486e7c998 tempest-CreateVolumesFromImageTest-239318328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17695855-d844-476f-ae6f-e6272e95064a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:38 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-1aefbc92-05bd-4673-97e3-e64486e7c998 tempest-CreateVolumesFromImageTest-239318328 None] Flow 'volume_create_manager' (3397194b-6885-4526-b529-45cbd33095b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:48:39 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-1aefbc92-05bd-4673-97e3-e64486e7c998 tempest-CreateVolumesFromImageTest-239318328 None] Created volume successfully. Sep 18 21:48:39 devstack sudo[102937]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:39 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-44842b3e-0167-42f5-af7d-c81b2e43b394 tempest-VolumesGetTest-2025585433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-23fb2203-f0fb-4784-9ae2-271988581a1e" returned: 0 in 0.386s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:39 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-44842b3e-0167-42f5-af7d-c81b2e43b394 tempest-VolumesGetTest-2025585433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-23fb2203-f0fb-4784-9ae2-271988581a1e {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:39 devstack sudo[102949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-23fb2203-f0fb-4784-9ae2-271988581a1e Sep 18 21:48:39 devstack sudo[102949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:39 devstack sudo[102939]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:39 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-db7a301d-2c76-46df-a6ea-d0225953abcb tempest-CreateVolumesFromImageTest-239318328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b49ae956-9743-4892-bcd6-fc71573cb730 1073741824" returned: 0 in 0.462s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:39 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-db7a301d-2c76-46df-a6ea-d0225953abcb tempest-CreateVolumesFromImageTest-239318328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b49ae956-9743-4892-bcd6-fc71573cb730 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:39 devstack sudo[102951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b49ae956-9743-4892-bcd6-fc71573cb730 Sep 18 21:48:39 devstack sudo[102951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:39 devstack sudo[102949]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:39 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-44842b3e-0167-42f5-af7d-c81b2e43b394 tempest-VolumesGetTest-2025585433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-23fb2203-f0fb-4784-9ae2-271988581a1e" returned: 0 in 0.264s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:39 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-44842b3e-0167-42f5-af7d-c81b2e43b394 tempest-VolumesGetTest-2025585433 None] Lock "cinder-quobyte-23fb2203-f0fb-4784-9ae2-271988581a1e" released by "delete_volume" :: held 0.699s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:48:39 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-44842b3e-0167-42f5-af7d-c81b2e43b394 tempest-VolumesGetTest-2025585433 None] Created reservations ['f22c3fd5-e70f-4159-bf7c-5ecb53c6bd4f', '590ee83a-f0ac-41b5-a52d-e9e32239f8a7', 'c6f859d1-da68-4175-a291-f9c1b2e25c74', 'fef9129a-3e90-44a5-984c-bbff7dd58cdf'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:48:39 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-44842b3e-0167-42f5-af7d-c81b2e43b394 tempest-VolumesGetTest-2025585433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:48:39 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-44842b3e-0167-42f5-af7d-c81b2e43b394 tempest-VolumesGetTest-2025585433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:48:39 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-44842b3e-0167-42f5-af7d-c81b2e43b394 tempest-VolumesGetTest-2025585433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:48:39 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-44842b3e-0167-42f5-af7d-c81b2e43b394 tempest-VolumesGetTest-2025585433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:48:39 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-44842b3e-0167-42f5-af7d-c81b2e43b394 tempest-VolumesGetTest-2025585433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:48:39 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-44842b3e-0167-42f5-af7d-c81b2e43b394 tempest-VolumesGetTest-2025585433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:39 devstack sudo[102954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:48:39 devstack sudo[102954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:39 devstack sudo[102951]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:39 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-db7a301d-2c76-46df-a6ea-d0225953abcb tempest-CreateVolumesFromImageTest-239318328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b49ae956-9743-4892-bcd6-fc71573cb730" returned: 0 in 0.273s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:39 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-db7a301d-2c76-46df-a6ea-d0225953abcb tempest-CreateVolumesFromImageTest-239318328 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:48:39 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-db7a301d-2c76-46df-a6ea-d0225953abcb tempest-CreateVolumesFromImageTest-239318328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:48:39 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-33b9c51a-71a9-4b30-946b-1596893e8954 tempest-ProjectReaderTests-789285419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.740s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:48:39 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-33b9c51a-71a9-4b30-946b-1596893e8954 tempest-ProjectReaderTests-789285419 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:48:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-384962531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1363dca6-7ab8-4b7f-9fa0-691f5673e004,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e742561c2194d10a762398f87f7ceae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:48:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:48:38Z,use_quota=True,user_id='ffe6de373d4445e3b3cfe01d62bed581',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:48:39 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-33b9c51a-71a9-4b30-946b-1596893e8954 tempest-ProjectReaderTests-789285419 None] Creating volume 1363dca6-7ab8-4b7f-9fa0-691f5673e004 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:48:39 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-33b9c51a-71a9-4b30-946b-1596893e8954 tempest-ProjectReaderTests-789285419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:48:39 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-33b9c51a-71a9-4b30-946b-1596893e8954 tempest-ProjectReaderTests-789285419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:48:39 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-33b9c51a-71a9-4b30-946b-1596893e8954 tempest-ProjectReaderTests-789285419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:48:39 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-33b9c51a-71a9-4b30-946b-1596893e8954 tempest-ProjectReaderTests-789285419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:48:39 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-33b9c51a-71a9-4b30-946b-1596893e8954 tempest-ProjectReaderTests-789285419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:48:39 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-33b9c51a-71a9-4b30-946b-1596893e8954 tempest-ProjectReaderTests-789285419 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:48:39 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-33b9c51a-71a9-4b30-946b-1596893e8954 tempest-ProjectReaderTests-789285419 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:48:39 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-33b9c51a-71a9-4b30-946b-1596893e8954 tempest-ProjectReaderTests-789285419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-1363dca6-7ab8-4b7f-9fa0-691f5673e004 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:39 devstack sudo[102957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-1363dca6-7ab8-4b7f-9fa0-691f5673e004 1073741824 Sep 18 21:48:39 devstack sudo[102957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:39 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-db7a301d-2c76-46df-a6ea-d0225953abcb tempest-CreateVolumesFromImageTest-239318328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdbf40fc-8026-48ea-915b-46674bfa27a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b49ae956-9743-4892-bcd6-fc71573cb730', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:39 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-db7a301d-2c76-46df-a6ea-d0225953abcb tempest-CreateVolumesFromImageTest-239318328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fdb2ff9-6200-4211-a127-eadd80625fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:39 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-db7a301d-2c76-46df-a6ea-d0225953abcb tempest-CreateVolumesFromImageTest-239318328 None] Volume volume-b49ae956-9743-4892-bcd6-fc71573cb730 (b49ae956-9743-4892-bcd6-fc71573cb730): created successfully Sep 18 21:48:39 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-db7a301d-2c76-46df-a6ea-d0225953abcb tempest-CreateVolumesFromImageTest-239318328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fdb2ff9-6200-4211-a127-eadd80625fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:39 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-db7a301d-2c76-46df-a6ea-d0225953abcb tempest-CreateVolumesFromImageTest-239318328 None] Flow 'volume_create_manager' (0ca462e0-3a13-4464-82a9-124ae52131b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:48:39 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-db7a301d-2c76-46df-a6ea-d0225953abcb tempest-CreateVolumesFromImageTest-239318328 None] Created volume successfully. Sep 18 21:48:39 devstack sudo[102954]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:39 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-44842b3e-0167-42f5-af7d-c81b2e43b394 tempest-VolumesGetTest-2025585433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.295s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:39 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-44842b3e-0167-42f5-af7d-c81b2e43b394 tempest-VolumesGetTest-2025585433 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:48:39 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-44842b3e-0167-42f5-af7d-c81b2e43b394 tempest-VolumesGetTest-2025585433 None] Deleted volume successfully. Sep 18 21:48:39 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-44842b3e-0167-42f5-af7d-c81b2e43b394 tempest-VolumesGetTest-2025585433 None] Lock "cinder-23fb2203-f0fb-4784-9ae2-271988581a1e-delete_volume" released by "delete_volume" :: held 1.212s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:48:40 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-0809350b-6ace-4625-b274-1ff6ee9c895e tempest-VolumesGetTest-2025585433 None] Acquiring lock "cinder-e4105f67-ea6f-473b-a2a0-444f78c30eb3-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:48:40 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-0809350b-6ace-4625-b274-1ff6ee9c895e tempest-VolumesGetTest-2025585433 None] Lock "cinder-e4105f67-ea6f-473b-a2a0-444f78c30eb3-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:48:40 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-0809350b-6ace-4625-b274-1ff6ee9c895e tempest-VolumesGetTest-2025585433 None] Acquiring lock "cinder-quobyte-e4105f67-ea6f-473b-a2a0-444f78c30eb3" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:48:40 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-0809350b-6ace-4625-b274-1ff6ee9c895e tempest-VolumesGetTest-2025585433 None] Lock "cinder-quobyte-e4105f67-ea6f-473b-a2a0-444f78c30eb3" acquired by "delete_volume" :: waited 0.016s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:48:40 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb449f7-a438-488f-984a-2d9dbd76c3cc]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:48:40 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0809350b-6ace-4625-b274-1ff6ee9c895e tempest-VolumesGetTest-2025585433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e4105f67-ea6f-473b-a2a0-444f78c30eb3 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:40 devstack sudo[102957]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:40 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-33b9c51a-71a9-4b30-946b-1596893e8954 tempest-ProjectReaderTests-789285419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-1363dca6-7ab8-4b7f-9fa0-691f5673e004 1073741824" returned: 0 in 0.493s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:40 devstack sudo[102963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e4105f67-ea6f-473b-a2a0-444f78c30eb3 Sep 18 21:48:40 devstack sudo[102963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:40 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-33b9c51a-71a9-4b30-946b-1596893e8954 tempest-ProjectReaderTests-789285419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-1363dca6-7ab8-4b7f-9fa0-691f5673e004 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:40 devstack sudo[102966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-1363dca6-7ab8-4b7f-9fa0-691f5673e004 Sep 18 21:48:40 devstack sudo[102966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:40 devstack sudo[102963]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:40 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0809350b-6ace-4625-b274-1ff6ee9c895e tempest-VolumesGetTest-2025585433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e4105f67-ea6f-473b-a2a0-444f78c30eb3" returned: 0 in 0.387s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:40 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0809350b-6ace-4625-b274-1ff6ee9c895e tempest-VolumesGetTest-2025585433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e4105f67-ea6f-473b-a2a0-444f78c30eb3 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:40 devstack sudo[102972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e4105f67-ea6f-473b-a2a0-444f78c30eb3 Sep 18 21:48:40 devstack sudo[102972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:40 devstack sudo[102966]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:40 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-33b9c51a-71a9-4b30-946b-1596893e8954 tempest-ProjectReaderTests-789285419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-1363dca6-7ab8-4b7f-9fa0-691f5673e004" returned: 0 in 0.273s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:40 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-33b9c51a-71a9-4b30-946b-1596893e8954 tempest-ProjectReaderTests-789285419 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:48:40 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-33b9c51a-71a9-4b30-946b-1596893e8954 tempest-ProjectReaderTests-789285419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:48:40 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-33b9c51a-71a9-4b30-946b-1596893e8954 tempest-ProjectReaderTests-789285419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b9c54b1-66bb-4d03-9545-cf55a03f2224) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1363dca6-7ab8-4b7f-9fa0-691f5673e004', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:40 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-33b9c51a-71a9-4b30-946b-1596893e8954 tempest-ProjectReaderTests-789285419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c574e57-1b36-482a-8d64-c86818085758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:40 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-33b9c51a-71a9-4b30-946b-1596893e8954 tempest-ProjectReaderTests-789285419 None] Volume volume-1363dca6-7ab8-4b7f-9fa0-691f5673e004 (1363dca6-7ab8-4b7f-9fa0-691f5673e004): created successfully Sep 18 21:48:40 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-33b9c51a-71a9-4b30-946b-1596893e8954 tempest-ProjectReaderTests-789285419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c574e57-1b36-482a-8d64-c86818085758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:40 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-33b9c51a-71a9-4b30-946b-1596893e8954 tempest-ProjectReaderTests-789285419 None] Flow 'volume_create_manager' (b025141a-cacc-4c71-b1c3-9e9e878a52cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:48:40 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-33b9c51a-71a9-4b30-946b-1596893e8954 tempest-ProjectReaderTests-789285419 None] Created volume successfully. Sep 18 21:48:40 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-7b1bb1d3-1ec5-44ab-8a74-2f01b83419b2 tempest-CreateVolumesFromImageTest-239318328 None] Acquiring lock "cinder-b49ae956-9743-4892-bcd6-fc71573cb730-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:48:40 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-7b1bb1d3-1ec5-44ab-8a74-2f01b83419b2 tempest-CreateVolumesFromImageTest-239318328 None] Lock "cinder-b49ae956-9743-4892-bcd6-fc71573cb730-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:48:40 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-7b1bb1d3-1ec5-44ab-8a74-2f01b83419b2 tempest-CreateVolumesFromImageTest-239318328 None] Acquiring lock "cinder-quobyte-b49ae956-9743-4892-bcd6-fc71573cb730" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:48:40 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-7b1bb1d3-1ec5-44ab-8a74-2f01b83419b2 tempest-CreateVolumesFromImageTest-239318328 None] Lock "cinder-quobyte-b49ae956-9743-4892-bcd6-fc71573cb730" acquired by "delete_volume" :: waited 0.028s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:48:40 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5abebc6-464b-465d-b44c-280ae5d0e01e]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:48:40 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-7b1bb1d3-1ec5-44ab-8a74-2f01b83419b2 tempest-CreateVolumesFromImageTest-239318328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b49ae956-9743-4892-bcd6-fc71573cb730 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:40 devstack sudo[102972]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:40 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0809350b-6ace-4625-b274-1ff6ee9c895e tempest-VolumesGetTest-2025585433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e4105f67-ea6f-473b-a2a0-444f78c30eb3" returned: 0 in 0.263s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:40 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-0809350b-6ace-4625-b274-1ff6ee9c895e tempest-VolumesGetTest-2025585433 None] Lock "cinder-quobyte-e4105f67-ea6f-473b-a2a0-444f78c30eb3" released by "delete_volume" :: held 0.696s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:48:40 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-0809350b-6ace-4625-b274-1ff6ee9c895e tempest-VolumesGetTest-2025585433 None] Created reservations ['f3688e3d-9686-4243-810a-4c65eb090027', '1d8219a0-10ad-41f4-87f7-411e60947b45', 'd2f14ad5-6f33-4185-89c9-90599d4d0666', '65278871-11c5-4344-9151-4233d39799a6'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:48:40 devstack sudo[102976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b49ae956-9743-4892-bcd6-fc71573cb730 Sep 18 21:48:40 devstack sudo[102976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:40 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-0809350b-6ace-4625-b274-1ff6ee9c895e tempest-VolumesGetTest-2025585433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:48:40 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-0809350b-6ace-4625-b274-1ff6ee9c895e tempest-VolumesGetTest-2025585433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:48:40 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-0809350b-6ace-4625-b274-1ff6ee9c895e tempest-VolumesGetTest-2025585433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:48:40 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-0809350b-6ace-4625-b274-1ff6ee9c895e tempest-VolumesGetTest-2025585433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:48:40 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-0809350b-6ace-4625-b274-1ff6ee9c895e tempest-VolumesGetTest-2025585433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:48:40 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0809350b-6ace-4625-b274-1ff6ee9c895e tempest-VolumesGetTest-2025585433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:40 devstack sudo[102978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:48:40 devstack sudo[102978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:41 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-40175f2e-64ab-4289-8433-1267c75688e2 tempest-ProjectReaderTests-789285419 None] Acquiring lock "cinder-1363dca6-7ab8-4b7f-9fa0-691f5673e004-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:48:41 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-40175f2e-64ab-4289-8433-1267c75688e2 tempest-ProjectReaderTests-789285419 None] Lock "cinder-1363dca6-7ab8-4b7f-9fa0-691f5673e004-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:48:41 devstack sudo[102978]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:41 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0809350b-6ace-4625-b274-1ff6ee9c895e tempest-VolumesGetTest-2025585433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.269s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:41 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-0809350b-6ace-4625-b274-1ff6ee9c895e tempest-VolumesGetTest-2025585433 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:48:41 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-0809350b-6ace-4625-b274-1ff6ee9c895e tempest-VolumesGetTest-2025585433 None] Deleted volume successfully. Sep 18 21:48:41 devstack sudo[102976]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:41 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-7b1bb1d3-1ec5-44ab-8a74-2f01b83419b2 tempest-CreateVolumesFromImageTest-239318328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b49ae956-9743-4892-bcd6-fc71573cb730" returned: 0 in 0.471s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:41 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-7b1bb1d3-1ec5-44ab-8a74-2f01b83419b2 tempest-CreateVolumesFromImageTest-239318328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b49ae956-9743-4892-bcd6-fc71573cb730 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:41 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-40175f2e-64ab-4289-8433-1267c75688e2 tempest-ProjectReaderTests-789285419 None] Acquiring lock "cinder-quobyte-1363dca6-7ab8-4b7f-9fa0-691f5673e004" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:48:41 devstack sudo[102984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b49ae956-9743-4892-bcd6-fc71573cb730 Sep 18 21:48:41 devstack sudo[102984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:41 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-0809350b-6ace-4625-b274-1ff6ee9c895e tempest-VolumesGetTest-2025585433 None] Lock "cinder-e4105f67-ea6f-473b-a2a0-444f78c30eb3-delete_volume" released by "delete_volume" :: held 1.222s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:48:41 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-40175f2e-64ab-4289-8433-1267c75688e2 tempest-ProjectReaderTests-789285419 None] Lock "cinder-quobyte-1363dca6-7ab8-4b7f-9fa0-691f5673e004" acquired by "delete_volume" :: waited 0.027s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:48:41 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-50acc956-84b5-44da-8800-2c13212eb74a tempest-VolumesGetTest-2025585433 None] Acquiring lock "cinder-baa2eca5-d7f4-4f1f-ae33-3f7865a123a7-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:48:41 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-50acc956-84b5-44da-8800-2c13212eb74a tempest-VolumesGetTest-2025585433 None] Lock "cinder-baa2eca5-d7f4-4f1f-ae33-3f7865a123a7-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:48:41 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecaa244b-7135-4987-a95f-066071672f07]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:48:41 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-40175f2e-64ab-4289-8433-1267c75688e2 tempest-ProjectReaderTests-789285419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-1363dca6-7ab8-4b7f-9fa0-691f5673e004 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:41 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-50acc956-84b5-44da-8800-2c13212eb74a tempest-VolumesGetTest-2025585433 None] Acquiring lock "cinder-quobyte-baa2eca5-d7f4-4f1f-ae33-3f7865a123a7" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:48:41 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-50acc956-84b5-44da-8800-2c13212eb74a tempest-VolumesGetTest-2025585433 None] Lock "cinder-quobyte-baa2eca5-d7f4-4f1f-ae33-3f7865a123a7" acquired by "delete_volume" :: waited 0.015s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:48:41 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca2e5030-1899-403b-bbfd-0a1da4864b27]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:48:41 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-50acc956-84b5-44da-8800-2c13212eb74a tempest-VolumesGetTest-2025585433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-baa2eca5-d7f4-4f1f-ae33-3f7865a123a7 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:41 devstack sudo[102986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-1363dca6-7ab8-4b7f-9fa0-691f5673e004 Sep 18 21:48:41 devstack sudo[102986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:41 devstack sudo[102984]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:41 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-7b1bb1d3-1ec5-44ab-8a74-2f01b83419b2 tempest-CreateVolumesFromImageTest-239318328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b49ae956-9743-4892-bcd6-fc71573cb730" returned: 0 in 0.285s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:41 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-7b1bb1d3-1ec5-44ab-8a74-2f01b83419b2 tempest-CreateVolumesFromImageTest-239318328 None] Lock "cinder-quobyte-b49ae956-9743-4892-bcd6-fc71573cb730" released by "delete_volume" :: held 0.807s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:48:41 devstack sudo[102987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-baa2eca5-d7f4-4f1f-ae33-3f7865a123a7 Sep 18 21:48:41 devstack sudo[102987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:41 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-7b1bb1d3-1ec5-44ab-8a74-2f01b83419b2 tempest-CreateVolumesFromImageTest-239318328 None] Created reservations ['4ca18912-7076-4aaa-af86-aa5424c00346', '52a0b4f7-6901-40f1-bad4-dcdc7a91b969', 'e7223d46-4157-451e-86c6-ed8c010e176c', 'fafd07b5-1e72-414d-98c8-9fec85d236a9'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:48:41 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-7b1bb1d3-1ec5-44ab-8a74-2f01b83419b2 tempest-CreateVolumesFromImageTest-239318328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:48:41 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-7b1bb1d3-1ec5-44ab-8a74-2f01b83419b2 tempest-CreateVolumesFromImageTest-239318328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:48:41 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-7b1bb1d3-1ec5-44ab-8a74-2f01b83419b2 tempest-CreateVolumesFromImageTest-239318328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:48:41 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-7b1bb1d3-1ec5-44ab-8a74-2f01b83419b2 tempest-CreateVolumesFromImageTest-239318328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:48:41 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-7b1bb1d3-1ec5-44ab-8a74-2f01b83419b2 tempest-CreateVolumesFromImageTest-239318328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:48:41 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-7b1bb1d3-1ec5-44ab-8a74-2f01b83419b2 tempest-CreateVolumesFromImageTest-239318328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:41 devstack sudo[102994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:48:41 devstack sudo[102994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:41 devstack sudo[102986]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:41 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-40175f2e-64ab-4289-8433-1267c75688e2 tempest-ProjectReaderTests-789285419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-1363dca6-7ab8-4b7f-9fa0-691f5673e004" returned: 0 in 0.402s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:41 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-40175f2e-64ab-4289-8433-1267c75688e2 tempest-ProjectReaderTests-789285419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-1363dca6-7ab8-4b7f-9fa0-691f5673e004 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:41 devstack sudo[102996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-1363dca6-7ab8-4b7f-9fa0-691f5673e004 Sep 18 21:48:41 devstack sudo[102996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:41 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-62da8a5f-cfde-46d6-8a3c-964291483130 tempest-CreateVolumesFromImageTest-239318328 None] Acquiring lock "cinder-c49b1201-2e5b-433f-916a-c62cf23344d9-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:48:41 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-62da8a5f-cfde-46d6-8a3c-964291483130 tempest-CreateVolumesFromImageTest-239318328 None] Lock "cinder-c49b1201-2e5b-433f-916a-c62cf23344d9-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:48:41 devstack sudo[102987]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:41 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-50acc956-84b5-44da-8800-2c13212eb74a tempest-VolumesGetTest-2025585433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-baa2eca5-d7f4-4f1f-ae33-3f7865a123a7" returned: 0 in 0.464s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:41 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-50acc956-84b5-44da-8800-2c13212eb74a tempest-VolumesGetTest-2025585433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-baa2eca5-d7f4-4f1f-ae33-3f7865a123a7 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:41 devstack sudo[103001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-baa2eca5-d7f4-4f1f-ae33-3f7865a123a7 Sep 18 21:48:41 devstack sudo[103001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:41 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-62da8a5f-cfde-46d6-8a3c-964291483130 tempest-CreateVolumesFromImageTest-239318328 None] Acquiring lock "cinder-quobyte-c49b1201-2e5b-433f-916a-c62cf23344d9" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:48:41 devstack sudo[102994]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:41 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-7b1bb1d3-1ec5-44ab-8a74-2f01b83419b2 tempest-CreateVolumesFromImageTest-239318328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.304s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:41 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-7b1bb1d3-1ec5-44ab-8a74-2f01b83419b2 tempest-CreateVolumesFromImageTest-239318328 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:48:41 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-62da8a5f-cfde-46d6-8a3c-964291483130 tempest-CreateVolumesFromImageTest-239318328 None] Lock "cinder-quobyte-c49b1201-2e5b-433f-916a-c62cf23344d9" acquired by "delete_volume" :: waited 0.023s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:48:41 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-7b1bb1d3-1ec5-44ab-8a74-2f01b83419b2 tempest-CreateVolumesFromImageTest-239318328 None] Deleted volume successfully. Sep 18 21:48:42 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[a281e8e7-38ed-4880-82dd-ff751d265982]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:48:42 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-62da8a5f-cfde-46d6-8a3c-964291483130 tempest-CreateVolumesFromImageTest-239318328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c49b1201-2e5b-433f-916a-c62cf23344d9 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:42 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-7b1bb1d3-1ec5-44ab-8a74-2f01b83419b2 tempest-CreateVolumesFromImageTest-239318328 None] Lock "cinder-b49ae956-9743-4892-bcd6-fc71573cb730-delete_volume" released by "delete_volume" :: held 1.374s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:48:42 devstack sudo[102996]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:42 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-40175f2e-64ab-4289-8433-1267c75688e2 tempest-ProjectReaderTests-789285419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-1363dca6-7ab8-4b7f-9fa0-691f5673e004" returned: 0 in 0.345s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:42 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-40175f2e-64ab-4289-8433-1267c75688e2 tempest-ProjectReaderTests-789285419 None] Lock "cinder-quobyte-1363dca6-7ab8-4b7f-9fa0-691f5673e004" released by "delete_volume" :: held 0.815s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:48:42 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-40175f2e-64ab-4289-8433-1267c75688e2 tempest-ProjectReaderTests-789285419 None] Created reservations ['f0e3ca84-f74f-4fcf-a002-d0cbd4319d1d', '0abe6937-df0c-4d07-a672-287ec1a612ca', '1550eeb9-f524-45d0-ae5f-4b7445587b0c', 'd3dd9b95-d0b4-40e6-b8ff-768a576119a3'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:48:42 devstack sudo[103005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c49b1201-2e5b-433f-916a-c62cf23344d9 Sep 18 21:48:42 devstack sudo[103005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:42 devstack sudo[103001]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:42 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-50acc956-84b5-44da-8800-2c13212eb74a tempest-VolumesGetTest-2025585433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-baa2eca5-d7f4-4f1f-ae33-3f7865a123a7" returned: 0 in 0.303s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:42 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-50acc956-84b5-44da-8800-2c13212eb74a tempest-VolumesGetTest-2025585433 None] Lock "cinder-quobyte-baa2eca5-d7f4-4f1f-ae33-3f7865a123a7" released by "delete_volume" :: held 0.835s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:48:42 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-40175f2e-64ab-4289-8433-1267c75688e2 tempest-ProjectReaderTests-789285419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:48:42 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-40175f2e-64ab-4289-8433-1267c75688e2 tempest-ProjectReaderTests-789285419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:48:42 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-40175f2e-64ab-4289-8433-1267c75688e2 tempest-ProjectReaderTests-789285419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:48:42 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-40175f2e-64ab-4289-8433-1267c75688e2 tempest-ProjectReaderTests-789285419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:48:42 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-40175f2e-64ab-4289-8433-1267c75688e2 tempest-ProjectReaderTests-789285419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:48:42 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-40175f2e-64ab-4289-8433-1267c75688e2 tempest-ProjectReaderTests-789285419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:42 devstack sudo[103008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:48:42 devstack sudo[103008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:42 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-50acc956-84b5-44da-8800-2c13212eb74a tempest-VolumesGetTest-2025585433 None] Created reservations ['dd0a688f-e2dc-4c13-8f67-de283fc1d65c', 'ae874d80-1034-4440-b82c-3e8e1091a5f8', '4cc304aa-8001-4f54-a1df-676bbd4cc99a', '298c6d9f-0ecb-4bee-92c4-3c5217c60dce'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:48:42 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-50acc956-84b5-44da-8800-2c13212eb74a tempest-VolumesGetTest-2025585433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:48:42 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-50acc956-84b5-44da-8800-2c13212eb74a tempest-VolumesGetTest-2025585433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:48:42 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-50acc956-84b5-44da-8800-2c13212eb74a tempest-VolumesGetTest-2025585433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:48:42 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-50acc956-84b5-44da-8800-2c13212eb74a tempest-VolumesGetTest-2025585433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:48:42 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-50acc956-84b5-44da-8800-2c13212eb74a tempest-VolumesGetTest-2025585433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:48:42 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-50acc956-84b5-44da-8800-2c13212eb74a tempest-VolumesGetTest-2025585433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:42 devstack sudo[103012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:48:42 devstack sudo[103012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:42 devstack sudo[103005]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:42 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-62da8a5f-cfde-46d6-8a3c-964291483130 tempest-CreateVolumesFromImageTest-239318328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c49b1201-2e5b-433f-916a-c62cf23344d9" returned: 0 in 0.474s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:42 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-62da8a5f-cfde-46d6-8a3c-964291483130 tempest-CreateVolumesFromImageTest-239318328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c49b1201-2e5b-433f-916a-c62cf23344d9 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:42 devstack sudo[103015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c49b1201-2e5b-433f-916a-c62cf23344d9 Sep 18 21:48:42 devstack sudo[103015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:42 devstack sudo[103008]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:42 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-40175f2e-64ab-4289-8433-1267c75688e2 tempest-ProjectReaderTests-789285419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.351s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:42 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-40175f2e-64ab-4289-8433-1267c75688e2 tempest-ProjectReaderTests-789285419 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:48:42 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-40175f2e-64ab-4289-8433-1267c75688e2 tempest-ProjectReaderTests-789285419 None] Deleted volume successfully. Sep 18 21:48:42 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-40175f2e-64ab-4289-8433-1267c75688e2 tempest-ProjectReaderTests-789285419 None] Lock "cinder-1363dca6-7ab8-4b7f-9fa0-691f5673e004-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:48:42 devstack sudo[103012]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:42 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-50acc956-84b5-44da-8800-2c13212eb74a tempest-VolumesGetTest-2025585433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.392s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:42 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-50acc956-84b5-44da-8800-2c13212eb74a tempest-VolumesGetTest-2025585433 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:48:42 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-50acc956-84b5-44da-8800-2c13212eb74a tempest-VolumesGetTest-2025585433 None] Deleted volume successfully. Sep 18 21:48:42 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-50acc956-84b5-44da-8800-2c13212eb74a tempest-VolumesGetTest-2025585433 None] Lock "cinder-baa2eca5-d7f4-4f1f-ae33-3f7865a123a7-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:48:42 devstack sudo[103015]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:42 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-62da8a5f-cfde-46d6-8a3c-964291483130 tempest-CreateVolumesFromImageTest-239318328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c49b1201-2e5b-433f-916a-c62cf23344d9" returned: 0 in 0.427s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:42 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-62da8a5f-cfde-46d6-8a3c-964291483130 tempest-CreateVolumesFromImageTest-239318328 None] Lock "cinder-quobyte-c49b1201-2e5b-433f-916a-c62cf23344d9" released by "delete_volume" :: held 0.977s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:48:42 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-75d6fa2f-93bf-4eb4-9558-b4bd8e599782 tempest-ProjectReaderTests-789285419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:48:42 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-75d6fa2f-93bf-4eb4-9558-b4bd8e599782 tempest-ProjectReaderTests-789285419 None] Flow 'volume_create_manager' (06407c92-a382-4af3-a694-ccdb68063ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:48:43 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-75d6fa2f-93bf-4eb4-9558-b4bd8e599782 tempest-ProjectReaderTests-789285419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4845c9d-755e-4efe-8641-067ed07d9c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:43 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-75d6fa2f-93bf-4eb4-9558-b4bd8e599782 tempest-ProjectReaderTests-789285419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4845c9d-755e-4efe-8641-067ed07d9c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:48:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1113260771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2226e88-3dd4-4b70-9f65-d7300a002bbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e742561c2194d10a762398f87f7ceae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:48:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:48:43Z,use_quota=True,user_id='ffe6de373d4445e3b3cfe01d62bed581',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:43 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-75d6fa2f-93bf-4eb4-9558-b4bd8e599782 tempest-ProjectReaderTests-789285419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad38768c-75c5-4d69-9eda-c98c54c9d356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:43 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-75d6fa2f-93bf-4eb4-9558-b4bd8e599782 tempest-ProjectReaderTests-789285419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad38768c-75c5-4d69-9eda-c98c54c9d356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:43 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-75d6fa2f-93bf-4eb4-9558-b4bd8e599782 tempest-ProjectReaderTests-789285419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc6089d7-c4ab-4acf-bf7f-cdfbb82f5bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:43 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-75d6fa2f-93bf-4eb4-9558-b4bd8e599782 tempest-ProjectReaderTests-789285419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc6089d7-c4ab-4acf-bf7f-cdfbb82f5bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2226e88-3dd4-4b70-9f65-d7300a002bbe', 'volume_name': 'volume-a2226e88-3dd4-4b70-9f65-d7300a002bbe', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:43 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-75d6fa2f-93bf-4eb4-9558-b4bd8e599782 tempest-ProjectReaderTests-789285419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21441310-e259-4622-8037-1eeb193d8f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:43 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-75d6fa2f-93bf-4eb4-9558-b4bd8e599782 tempest-ProjectReaderTests-789285419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21441310-e259-4622-8037-1eeb193d8f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:43 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-75d6fa2f-93bf-4eb4-9558-b4bd8e599782 tempest-ProjectReaderTests-789285419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9485336f-9d5f-4273-8606-41a4633ee321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:43 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-75d6fa2f-93bf-4eb4-9558-b4bd8e599782 tempest-ProjectReaderTests-789285419 None] Volume a2226e88-3dd4-4b70-9f65-d7300a002bbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2226e88-3dd4-4b70-9f65-d7300a002bbe', 'volume_size': 1} Sep 18 21:48:43 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-75d6fa2f-93bf-4eb4-9558-b4bd8e599782 tempest-ProjectReaderTests-789285419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:48:43 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-75d6fa2f-93bf-4eb4-9558-b4bd8e599782 tempest-ProjectReaderTests-789285419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:48:43 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-75d6fa2f-93bf-4eb4-9558-b4bd8e599782 tempest-ProjectReaderTests-789285419 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:48:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1113260771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2226e88-3dd4-4b70-9f65-d7300a002bbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e742561c2194d10a762398f87f7ceae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:48:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:48:43Z,use_quota=True,user_id='ffe6de373d4445e3b3cfe01d62bed581',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:48:43 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-75d6fa2f-93bf-4eb4-9558-b4bd8e599782 tempest-ProjectReaderTests-789285419 None] Creating volume a2226e88-3dd4-4b70-9f65-d7300a002bbe {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:48:43 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-75d6fa2f-93bf-4eb4-9558-b4bd8e599782 tempest-ProjectReaderTests-789285419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:48:43 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-75d6fa2f-93bf-4eb4-9558-b4bd8e599782 tempest-ProjectReaderTests-789285419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:48:43 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-75d6fa2f-93bf-4eb4-9558-b4bd8e599782 tempest-ProjectReaderTests-789285419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:48:43 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-75d6fa2f-93bf-4eb4-9558-b4bd8e599782 tempest-ProjectReaderTests-789285419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:48:43 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-75d6fa2f-93bf-4eb4-9558-b4bd8e599782 tempest-ProjectReaderTests-789285419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:48:43 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-75d6fa2f-93bf-4eb4-9558-b4bd8e599782 tempest-ProjectReaderTests-789285419 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:48:43 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-75d6fa2f-93bf-4eb4-9558-b4bd8e599782 tempest-ProjectReaderTests-789285419 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:48:43 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-75d6fa2f-93bf-4eb4-9558-b4bd8e599782 tempest-ProjectReaderTests-789285419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a2226e88-3dd4-4b70-9f65-d7300a002bbe 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:43 devstack sudo[103020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a2226e88-3dd4-4b70-9f65-d7300a002bbe 1073741824 Sep 18 21:48:43 devstack sudo[103020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:43 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-62da8a5f-cfde-46d6-8a3c-964291483130 tempest-CreateVolumesFromImageTest-239318328 None] Created reservations ['10a1fd7a-c372-492a-acb8-0e3273941edb', 'f2590655-3fbd-4198-a5c6-43e5625b32b8', 'ad73ebea-1ce0-492e-8abc-180c2c93fd27', 'b65e8778-008b-475c-88da-d2af28fad233'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:48:43 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-62da8a5f-cfde-46d6-8a3c-964291483130 tempest-CreateVolumesFromImageTest-239318328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:48:43 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-62da8a5f-cfde-46d6-8a3c-964291483130 tempest-CreateVolumesFromImageTest-239318328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:48:43 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-62da8a5f-cfde-46d6-8a3c-964291483130 tempest-CreateVolumesFromImageTest-239318328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:48:43 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-62da8a5f-cfde-46d6-8a3c-964291483130 tempest-CreateVolumesFromImageTest-239318328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:48:43 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-62da8a5f-cfde-46d6-8a3c-964291483130 tempest-CreateVolumesFromImageTest-239318328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:48:43 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-62da8a5f-cfde-46d6-8a3c-964291483130 tempest-CreateVolumesFromImageTest-239318328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:43 devstack sudo[103022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:48:43 devstack sudo[103022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:43 devstack sudo[103022]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:43 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-62da8a5f-cfde-46d6-8a3c-964291483130 tempest-CreateVolumesFromImageTest-239318328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.287s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:43 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-62da8a5f-cfde-46d6-8a3c-964291483130 tempest-CreateVolumesFromImageTest-239318328 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:48:43 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-62da8a5f-cfde-46d6-8a3c-964291483130 tempest-CreateVolumesFromImageTest-239318328 None] Deleted volume successfully. Sep 18 21:48:43 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-62da8a5f-cfde-46d6-8a3c-964291483130 tempest-CreateVolumesFromImageTest-239318328 None] Lock "cinder-c49b1201-2e5b-433f-916a-c62cf23344d9-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:48:43 devstack sudo[103020]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:43 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-75d6fa2f-93bf-4eb4-9558-b4bd8e599782 tempest-ProjectReaderTests-789285419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a2226e88-3dd4-4b70-9f65-d7300a002bbe 1073741824" returned: 0 in 0.472s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:43 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-75d6fa2f-93bf-4eb4-9558-b4bd8e599782 tempest-ProjectReaderTests-789285419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a2226e88-3dd4-4b70-9f65-d7300a002bbe {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:43 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b2c7e4f-c22f-4515-8212-5b360a6c231c tempest-VolumesGetTest-2025585433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:48:43 devstack sudo[103029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a2226e88-3dd4-4b70-9f65-d7300a002bbe Sep 18 21:48:43 devstack sudo[103029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:43 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-8b2c7e4f-c22f-4515-8212-5b360a6c231c tempest-VolumesGetTest-2025585433 None] Flow 'volume_create_manager' (611b8a22-425e-474a-aa5c-0c9ef012ddf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:48:43 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-8b2c7e4f-c22f-4515-8212-5b360a6c231c tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d209ebde-36f9-4581-82e2-615e67044763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:43 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-8b2c7e4f-c22f-4515-8212-5b360a6c231c tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d209ebde-36f9-4581-82e2-615e67044763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:48:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1999294667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a3ab1e8-e275-4a10-b289-b68ffad05ec2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c6cd15df09da425c84d7c465a1bd7b81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:48:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:48:44Z,use_quota=True,user_id='93d906f234b946cea603ec1bfebe96ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:43 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-8b2c7e4f-c22f-4515-8212-5b360a6c231c tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8399291b-7671-4a66-a51d-4af38496c9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:43 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-8b2c7e4f-c22f-4515-8212-5b360a6c231c tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8399291b-7671-4a66-a51d-4af38496c9fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:43 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-8b2c7e4f-c22f-4515-8212-5b360a6c231c tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02db3acb-4ef4-4852-9aab-ae3acd018420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:43 devstack cinder-volume[86136]: DEBUG cinder.image.glance [None req-8b2c7e4f-c22f-4515-8212-5b360a6c231c tempest-VolumesGetTest-2025585433 None] Creating Keystone auth plugin from conf {{(pid=86136) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 18 21:48:43 devstack sudo[103029]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:43 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-75d6fa2f-93bf-4eb4-9558-b4bd8e599782 tempest-ProjectReaderTests-789285419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a2226e88-3dd4-4b70-9f65-d7300a002bbe" returned: 0 in 0.272s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:43 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-75d6fa2f-93bf-4eb4-9558-b4bd8e599782 tempest-ProjectReaderTests-789285419 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:48:43 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-75d6fa2f-93bf-4eb4-9558-b4bd8e599782 tempest-ProjectReaderTests-789285419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:48:43 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-75d6fa2f-93bf-4eb4-9558-b4bd8e599782 tempest-ProjectReaderTests-789285419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9485336f-9d5f-4273-8606-41a4633ee321) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2226e88-3dd4-4b70-9f65-d7300a002bbe', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:43 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-75d6fa2f-93bf-4eb4-9558-b4bd8e599782 tempest-ProjectReaderTests-789285419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3720620a-2f05-4255-9aee-a402f0ba9427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:43 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-75d6fa2f-93bf-4eb4-9558-b4bd8e599782 tempest-ProjectReaderTests-789285419 None] Volume volume-a2226e88-3dd4-4b70-9f65-d7300a002bbe (a2226e88-3dd4-4b70-9f65-d7300a002bbe): created successfully Sep 18 21:48:43 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-75d6fa2f-93bf-4eb4-9558-b4bd8e599782 tempest-ProjectReaderTests-789285419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3720620a-2f05-4255-9aee-a402f0ba9427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:43 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-75d6fa2f-93bf-4eb4-9558-b4bd8e599782 tempest-ProjectReaderTests-789285419 None] Flow 'volume_create_manager' (06407c92-a382-4af3-a694-ccdb68063ee0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:48:43 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-8b2c7e4f-c22f-4515-8212-5b360a6c231c tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02db3acb-4ef4-4852-9aab-ae3acd018420) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5a3ab1e8-e275-4a10-b289-b68ffad05ec2', 'volume_name': 'volume-5a3ab1e8-e275-4a10-b289-b68ffad05ec2', 'volume_size': 1, 'image_id': 'a7adbe6d-c72a-4ef2-82c6-e788c5101a2c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a7adbe6d-c72a-4ef2-82c6-e788c5101a2c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'eae9b2cfe4f146fb9d7ac38006d73cd9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a7adbe6d-c72a-4ef2-82c6-e788c5101a2c', 'created_at': datetime.datetime(2026, 9, 18, 19, 27, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 18, 19, 27, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a7adbe6d-c72a-4ef2-82c6-e788c5101a2c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:43 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-8b2c7e4f-c22f-4515-8212-5b360a6c231c tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc776c26-3135-4da6-b3f9-a146f4b2b7aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:43 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-8b2c7e4f-c22f-4515-8212-5b360a6c231c tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc776c26-3135-4da6-b3f9-a146f4b2b7aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:43 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-8b2c7e4f-c22f-4515-8212-5b360a6c231c tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16ddd425-dd0a-439c-85bd-34cd9569e69c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:43 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-8b2c7e4f-c22f-4515-8212-5b360a6c231c tempest-VolumesGetTest-2025585433 None] Volume 5a3ab1e8-e275-4a10-b289-b68ffad05ec2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5a3ab1e8-e275-4a10-b289-b68ffad05ec2', 'volume_size': 1, 'image_id': 'a7adbe6d-c72a-4ef2-82c6-e788c5101a2c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a7adbe6d-c72a-4ef2-82c6-e788c5101a2c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'eae9b2cfe4f146fb9d7ac38006d73cd9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a7adbe6d-c72a-4ef2-82c6-e788c5101a2c', 'created_at': datetime.datetime(2026, 9, 18, 19, 27, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 18, 19, 27, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a7adbe6d-c72a-4ef2-82c6-e788c5101a2c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 18 21:48:43 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b2c7e4f-c22f-4515-8212-5b360a6c231c tempest-VolumesGetTest-2025585433 None] Trying to clone 5a3ab1e8-e275-4a10-b289-b68ffad05ec2 from image a7adbe6d-c72a-4ef2-82c6-e788c5101a2c at location (None, [{'url': 'file:///opt/stack/data/glance/images/a7adbe6d-c72a-4ef2-82c6-e788c5101a2c', 'metadata': {}}]). {{(pid=86136) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 18 21:48:43 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-75d6fa2f-93bf-4eb4-9558-b4bd8e599782 tempest-ProjectReaderTests-789285419 None] Created volume successfully. Sep 18 21:48:44 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-1cfd29e0-b0d5-4be5-92de-296aa04d8f83 tempest-CreateVolumesFromImageTest-239318328 None] Acquiring lock "cinder-a3bae42b-31f7-443b-b940-e3400a5f8569-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:48:44 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-1cfd29e0-b0d5-4be5-92de-296aa04d8f83 tempest-CreateVolumesFromImageTest-239318328 None] Lock "cinder-a3bae42b-31f7-443b-b940-e3400a5f8569-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:48:44 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-1cfd29e0-b0d5-4be5-92de-296aa04d8f83 tempest-CreateVolumesFromImageTest-239318328 None] Acquiring lock "cinder-quobyte-a3bae42b-31f7-443b-b940-e3400a5f8569" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:48:44 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-1cfd29e0-b0d5-4be5-92de-296aa04d8f83 tempest-CreateVolumesFromImageTest-239318328 None] Lock "cinder-quobyte-a3bae42b-31f7-443b-b940-e3400a5f8569" acquired by "delete_volume" :: waited 0.031s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:48:44 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[28760af2-d0bf-4868-84a7-6ed38b5adae3]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:48:44 devstack cinder-volume[86136]: DEBUG cinder.image.image_utils [None req-8b2c7e4f-c22f-4515-8212-5b360a6c231c tempest-VolumesGetTest-2025585433 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_czvoxumedevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86136) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 18 21:48:44 devstack cinder-volume[86136]: INFO cinder.image.image_utils [None req-8b2c7e4f-c22f-4515-8212-5b360a6c231c tempest-VolumesGetTest-2025585433 None] Image download 20.69 MB at 20.69 MB/s Sep 18 21:48:44 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1cfd29e0-b0d5-4be5-92de-296aa04d8f83 tempest-CreateVolumesFromImageTest-239318328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a3bae42b-31f7-443b-b940-e3400a5f8569 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:44 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[f27b617c-61a7-459f-9637-951a06340935]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:48:44 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-8b2c7e4f-c22f-4515-8212-5b360a6c231c tempest-VolumesGetTest-2025585433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_czvoxumedevstack@QuobyteHD {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:44 devstack sudo[103033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a3bae42b-31f7-443b-b940-e3400a5f8569 Sep 18 21:48:44 devstack sudo[103033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:44 devstack sudo[103034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_czvoxumedevstack@QuobyteHD Sep 18 21:48:44 devstack sudo[103034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:44 devstack sudo[103033]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:44 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1cfd29e0-b0d5-4be5-92de-296aa04d8f83 tempest-CreateVolumesFromImageTest-239318328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a3bae42b-31f7-443b-b940-e3400a5f8569" returned: 0 in 0.379s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:44 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1cfd29e0-b0d5-4be5-92de-296aa04d8f83 tempest-CreateVolumesFromImageTest-239318328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a3bae42b-31f7-443b-b940-e3400a5f8569 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:44 devstack sudo[103034]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:44 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-8b2c7e4f-c22f-4515-8212-5b360a6c231c tempest-VolumesGetTest-2025585433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_czvoxumedevstack@QuobyteHD" returned: 0 in 0.340s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:44 devstack cinder-volume[86136]: DEBUG cinder.image.image_utils [None req-8b2c7e4f-c22f-4515-8212-5b360a6c231c tempest-VolumesGetTest-2025585433 None] Temporary image a7adbe6d-c72a-4ef2-82c6-e788c5101a2c is fetched for user 93d906f234b946cea603ec1bfebe96ad. {{(pid=86136) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 18 21:48:44 devstack sudo[103043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a3bae42b-31f7-443b-b940-e3400a5f8569 Sep 18 21:48:44 devstack sudo[103043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:44 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca54d42e-b2cf-456f-ab67-10df55a510a1]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:48:44 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-8b2c7e4f-c22f-4515-8212-5b360a6c231c tempest-VolumesGetTest-2025585433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_czvoxumedevstack@QuobyteHD {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:44 devstack sudo[103045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_czvoxumedevstack@QuobyteHD Sep 18 21:48:44 devstack sudo[103045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:44 devstack sudo[103043]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:44 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1cfd29e0-b0d5-4be5-92de-296aa04d8f83 tempest-CreateVolumesFromImageTest-239318328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a3bae42b-31f7-443b-b940-e3400a5f8569" returned: 0 in 0.268s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:44 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-1cfd29e0-b0d5-4be5-92de-296aa04d8f83 tempest-CreateVolumesFromImageTest-239318328 None] Lock "cinder-quobyte-a3bae42b-31f7-443b-b940-e3400a5f8569" released by "delete_volume" :: held 0.709s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:48:45 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-1cfd29e0-b0d5-4be5-92de-296aa04d8f83 tempest-CreateVolumesFromImageTest-239318328 None] Created reservations ['cc003fbd-aacb-496b-a8c6-4d2d561670c2', '01b82763-c6e9-4ee3-90ae-7814e510fda4', '8b9ed16f-b25b-467e-8e3b-de773d2c49e0', '66245b16-0d6e-443f-b9f1-85ab002b5f2b'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:48:45 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-3f2a609d-8bd1-43f9-b3f2-cb644acbda0c tempest-ProjectReaderTests-789285419 None] Acquiring lock "cinder-a2226e88-3dd4-4b70-9f65-d7300a002bbe-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:48:45 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-1cfd29e0-b0d5-4be5-92de-296aa04d8f83 tempest-CreateVolumesFromImageTest-239318328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:48:45 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-1cfd29e0-b0d5-4be5-92de-296aa04d8f83 tempest-CreateVolumesFromImageTest-239318328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:48:45 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-1cfd29e0-b0d5-4be5-92de-296aa04d8f83 tempest-CreateVolumesFromImageTest-239318328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:48:45 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-1cfd29e0-b0d5-4be5-92de-296aa04d8f83 tempest-CreateVolumesFromImageTest-239318328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:48:45 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-1cfd29e0-b0d5-4be5-92de-296aa04d8f83 tempest-CreateVolumesFromImageTest-239318328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:48:45 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1cfd29e0-b0d5-4be5-92de-296aa04d8f83 tempest-CreateVolumesFromImageTest-239318328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:45 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-3f2a609d-8bd1-43f9-b3f2-cb644acbda0c tempest-ProjectReaderTests-789285419 None] Lock "cinder-a2226e88-3dd4-4b70-9f65-d7300a002bbe-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:48:45 devstack sudo[103045]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:45 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-8b2c7e4f-c22f-4515-8212-5b360a6c231c tempest-VolumesGetTest-2025585433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_czvoxumedevstack@QuobyteHD" returned: 0 in 0.368s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:45 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-8b2c7e4f-c22f-4515-8212-5b360a6c231c tempest-VolumesGetTest-2025585433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:48:45 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-8b2c7e4f-c22f-4515-8212-5b360a6c231c tempest-VolumesGetTest-2025585433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:48:45 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-8b2c7e4f-c22f-4515-8212-5b360a6c231c tempest-VolumesGetTest-2025585433 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:48:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1999294667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a3ab1e8-e275-4a10-b289-b68ffad05ec2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c6cd15df09da425c84d7c465a1bd7b81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:48:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:48:44Z,use_quota=True,user_id='93d906f234b946cea603ec1bfebe96ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:48:45 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-8b2c7e4f-c22f-4515-8212-5b360a6c231c tempest-VolumesGetTest-2025585433 None] Creating volume 5a3ab1e8-e275-4a10-b289-b68ffad05ec2 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:48:45 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-8b2c7e4f-c22f-4515-8212-5b360a6c231c tempest-VolumesGetTest-2025585433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:48:45 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-8b2c7e4f-c22f-4515-8212-5b360a6c231c tempest-VolumesGetTest-2025585433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:48:45 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-8b2c7e4f-c22f-4515-8212-5b360a6c231c tempest-VolumesGetTest-2025585433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:48:45 devstack sudo[103051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:48:45 devstack sudo[103051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:45 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-8b2c7e4f-c22f-4515-8212-5b360a6c231c tempest-VolumesGetTest-2025585433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:48:45 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-8b2c7e4f-c22f-4515-8212-5b360a6c231c tempest-VolumesGetTest-2025585433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:48:45 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-8b2c7e4f-c22f-4515-8212-5b360a6c231c tempest-VolumesGetTest-2025585433 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:48:45 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-8b2c7e4f-c22f-4515-8212-5b360a6c231c tempest-VolumesGetTest-2025585433 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:48:45 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-8b2c7e4f-c22f-4515-8212-5b360a6c231c tempest-VolumesGetTest-2025585433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-5a3ab1e8-e275-4a10-b289-b68ffad05ec2 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:45 devstack sudo[103053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-5a3ab1e8-e275-4a10-b289-b68ffad05ec2 1073741824 Sep 18 21:48:45 devstack sudo[103053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:45 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-3f2a609d-8bd1-43f9-b3f2-cb644acbda0c tempest-ProjectReaderTests-789285419 None] Acquiring lock "cinder-quobyte-a2226e88-3dd4-4b70-9f65-d7300a002bbe" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:48:45 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-3f2a609d-8bd1-43f9-b3f2-cb644acbda0c tempest-ProjectReaderTests-789285419 None] Lock "cinder-quobyte-a2226e88-3dd4-4b70-9f65-d7300a002bbe" acquired by "delete_volume" :: waited 0.024s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:48:45 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[034cc583-6bbb-41cb-80f4-37ea7323cce8]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:48:45 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3f2a609d-8bd1-43f9-b3f2-cb644acbda0c tempest-ProjectReaderTests-789285419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a2226e88-3dd4-4b70-9f65-d7300a002bbe {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:45 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-9c387b43-a479-4057-b239-8b6aa9f630b9 tempest-CreateVolumesFromImageTest-239318328 None] Acquiring lock "cinder-7dd9726b-0ea0-4028-b1f9-e820c1f16894-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:48:45 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-9c387b43-a479-4057-b239-8b6aa9f630b9 tempest-CreateVolumesFromImageTest-239318328 None] Lock "cinder-7dd9726b-0ea0-4028-b1f9-e820c1f16894-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:48:45 devstack sudo[103051]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:45 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1cfd29e0-b0d5-4be5-92de-296aa04d8f83 tempest-CreateVolumesFromImageTest-239318328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.309s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:45 devstack sudo[103055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a2226e88-3dd4-4b70-9f65-d7300a002bbe Sep 18 21:48:45 devstack sudo[103055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:45 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-1cfd29e0-b0d5-4be5-92de-296aa04d8f83 tempest-CreateVolumesFromImageTest-239318328 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:48:45 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-1cfd29e0-b0d5-4be5-92de-296aa04d8f83 tempest-CreateVolumesFromImageTest-239318328 None] Deleted volume successfully. Sep 18 21:48:45 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-9c387b43-a479-4057-b239-8b6aa9f630b9 tempest-CreateVolumesFromImageTest-239318328 None] Acquiring lock "cinder-quobyte-7dd9726b-0ea0-4028-b1f9-e820c1f16894" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:48:45 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-1cfd29e0-b0d5-4be5-92de-296aa04d8f83 tempest-CreateVolumesFromImageTest-239318328 None] Lock "cinder-a3bae42b-31f7-443b-b940-e3400a5f8569-delete_volume" released by "delete_volume" :: held 1.315s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:48:45 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-9c387b43-a479-4057-b239-8b6aa9f630b9 tempest-CreateVolumesFromImageTest-239318328 None] Lock "cinder-quobyte-7dd9726b-0ea0-4028-b1f9-e820c1f16894" acquired by "delete_volume" :: waited 0.033s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:48:45 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[128a6203-05c7-4f11-bd2d-2f1802324cab]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:48:45 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9c387b43-a479-4057-b239-8b6aa9f630b9 tempest-CreateVolumesFromImageTest-239318328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7dd9726b-0ea0-4028-b1f9-e820c1f16894 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:45 devstack sudo[103062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7dd9726b-0ea0-4028-b1f9-e820c1f16894 Sep 18 21:48:45 devstack sudo[103062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:45 devstack sudo[103053]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:45 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-8b2c7e4f-c22f-4515-8212-5b360a6c231c tempest-VolumesGetTest-2025585433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-5a3ab1e8-e275-4a10-b289-b68ffad05ec2 1073741824" returned: 0 in 0.532s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:45 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-8b2c7e4f-c22f-4515-8212-5b360a6c231c tempest-VolumesGetTest-2025585433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-5a3ab1e8-e275-4a10-b289-b68ffad05ec2 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:45 devstack sudo[103067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-5a3ab1e8-e275-4a10-b289-b68ffad05ec2 Sep 18 21:48:45 devstack sudo[103067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:45 devstack sudo[103055]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:45 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3f2a609d-8bd1-43f9-b3f2-cb644acbda0c tempest-ProjectReaderTests-789285419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a2226e88-3dd4-4b70-9f65-d7300a002bbe" returned: 0 in 0.534s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:45 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3f2a609d-8bd1-43f9-b3f2-cb644acbda0c tempest-ProjectReaderTests-789285419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a2226e88-3dd4-4b70-9f65-d7300a002bbe {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:45 devstack sudo[103069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a2226e88-3dd4-4b70-9f65-d7300a002bbe Sep 18 21:48:45 devstack sudo[103069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:45 devstack sudo[103062]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:45 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9c387b43-a479-4057-b239-8b6aa9f630b9 tempest-CreateVolumesFromImageTest-239318328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7dd9726b-0ea0-4028-b1f9-e820c1f16894" returned: 0 in 0.401s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:45 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9c387b43-a479-4057-b239-8b6aa9f630b9 tempest-CreateVolumesFromImageTest-239318328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7dd9726b-0ea0-4028-b1f9-e820c1f16894 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:45 devstack sudo[103074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7dd9726b-0ea0-4028-b1f9-e820c1f16894 Sep 18 21:48:45 devstack sudo[103074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:45 devstack sudo[103067]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:45 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-8b2c7e4f-c22f-4515-8212-5b360a6c231c tempest-VolumesGetTest-2025585433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-5a3ab1e8-e275-4a10-b289-b68ffad05ec2" returned: 0 in 0.277s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:45 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-8b2c7e4f-c22f-4515-8212-5b360a6c231c tempest-VolumesGetTest-2025585433 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:48:45 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-8b2c7e4f-c22f-4515-8212-5b360a6c231c tempest-VolumesGetTest-2025585433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:48:46 devstack cinder-volume[86136]: DEBUG cinder.volume.volume_utils [None req-8b2c7e4f-c22f-4515-8212-5b360a6c231c tempest-VolumesGetTest-2025585433 None] Attempting download of a7adbe6d-c72a-4ef2-82c6-e788c5101a2c ((None, [{'url': 'file:///opt/stack/data/glance/images/a7adbe6d-c72a-4ef2-82c6-e788c5101a2c', 'metadata': {}}])) to volume 5a3ab1e8-e275-4a10-b289-b68ffad05ec2. {{(pid=86136) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 18 21:48:46 devstack sudo[103069]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3f2a609d-8bd1-43f9-b3f2-cb644acbda0c tempest-ProjectReaderTests-789285419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a2226e88-3dd4-4b70-9f65-d7300a002bbe" returned: 0 in 0.263s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:46 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-3f2a609d-8bd1-43f9-b3f2-cb644acbda0c tempest-ProjectReaderTests-789285419 None] Lock "cinder-quobyte-a2226e88-3dd4-4b70-9f65-d7300a002bbe" released by "delete_volume" :: held 0.848s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:48:46 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb1616f-a123-4aa2-80a3-9298d65b6e3b]: (4, 'raw') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:48:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-8b2c7e4f-c22f-4515-8212-5b360a6c231c tempest-VolumesGetTest-2025585433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_1lhwvta4 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:46 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-3f2a609d-8bd1-43f9-b3f2-cb644acbda0c tempest-ProjectReaderTests-789285419 None] Created reservations ['968ea4a5-0aa3-4748-92a3-71277166d1d4', '3b1fb919-d828-4976-8fae-cd76e3911769', 'f19abf20-2a6c-4e2c-8995-1c6d51fa0be5', '67184239-bd70-4c5d-9a81-48730fa8ab51'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:48:46 devstack sudo[103074]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9c387b43-a479-4057-b239-8b6aa9f630b9 tempest-CreateVolumesFromImageTest-239318328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7dd9726b-0ea0-4028-b1f9-e820c1f16894" returned: 0 in 0.288s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:46 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-9c387b43-a479-4057-b239-8b6aa9f630b9 tempest-CreateVolumesFromImageTest-239318328 None] Lock "cinder-quobyte-7dd9726b-0ea0-4028-b1f9-e820c1f16894" released by "delete_volume" :: held 0.744s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:48:46 devstack sudo[103078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_1lhwvta4 Sep 18 21:48:46 devstack sudo[103078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-3f2a609d-8bd1-43f9-b3f2-cb644acbda0c tempest-ProjectReaderTests-789285419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:48:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-3f2a609d-8bd1-43f9-b3f2-cb644acbda0c tempest-ProjectReaderTests-789285419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:48:46 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-3f2a609d-8bd1-43f9-b3f2-cb644acbda0c tempest-ProjectReaderTests-789285419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:48:46 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-3f2a609d-8bd1-43f9-b3f2-cb644acbda0c tempest-ProjectReaderTests-789285419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:48:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-3f2a609d-8bd1-43f9-b3f2-cb644acbda0c tempest-ProjectReaderTests-789285419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:48:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3f2a609d-8bd1-43f9-b3f2-cb644acbda0c tempest-ProjectReaderTests-789285419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:46 devstack sudo[103081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:48:46 devstack sudo[103081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:46 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-9c387b43-a479-4057-b239-8b6aa9f630b9 tempest-CreateVolumesFromImageTest-239318328 None] Created reservations ['570f035d-4434-4666-be65-4cf2300d20ab', 'f3c7cdd4-3f3a-4afa-bb44-b4398c5d6af6', '42231d62-172c-4b3f-a5eb-8b85e1472527', '99c1e333-e68b-40a8-bc67-73033d7bfa4a'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:48:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-9c387b43-a479-4057-b239-8b6aa9f630b9 tempest-CreateVolumesFromImageTest-239318328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:48:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-9c387b43-a479-4057-b239-8b6aa9f630b9 tempest-CreateVolumesFromImageTest-239318328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:48:46 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-9c387b43-a479-4057-b239-8b6aa9f630b9 tempest-CreateVolumesFromImageTest-239318328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:48:46 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-9c387b43-a479-4057-b239-8b6aa9f630b9 tempest-CreateVolumesFromImageTest-239318328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:48:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-9c387b43-a479-4057-b239-8b6aa9f630b9 tempest-CreateVolumesFromImageTest-239318328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:48:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9c387b43-a479-4057-b239-8b6aa9f630b9 tempest-CreateVolumesFromImageTest-239318328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:46 devstack sudo[103083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:48:46 devstack sudo[103083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:46 devstack sudo[103078]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-8b2c7e4f-c22f-4515-8212-5b360a6c231c tempest-VolumesGetTest-2025585433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_1lhwvta4" returned: 0 in 0.426s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-8b2c7e4f-c22f-4515-8212-5b360a6c231c tempest-VolumesGetTest-2025585433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_1lhwvta4 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:46 devstack sudo[103081]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:46 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-1e96c197-99d6-489d-9ee2-3a3fe309f450 tempest-CreateVolumesFromImageTest-239318328 None] Acquiring lock "cinder-beed53e8-2a23-4349-a6e2-0ed64eed1f13-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:48:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3f2a609d-8bd1-43f9-b3f2-cb644acbda0c tempest-ProjectReaderTests-789285419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.364s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:46 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-3f2a609d-8bd1-43f9-b3f2-cb644acbda0c tempest-ProjectReaderTests-789285419 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:48:46 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-3f2a609d-8bd1-43f9-b3f2-cb644acbda0c tempest-ProjectReaderTests-789285419 None] Deleted volume successfully. Sep 18 21:48:46 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-1e96c197-99d6-489d-9ee2-3a3fe309f450 tempest-CreateVolumesFromImageTest-239318328 None] Lock "cinder-beed53e8-2a23-4349-a6e2-0ed64eed1f13-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:48:46 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-3f2a609d-8bd1-43f9-b3f2-cb644acbda0c tempest-ProjectReaderTests-789285419 None] Lock "cinder-a2226e88-3dd4-4b70-9f65-d7300a002bbe-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:48:46 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-1e96c197-99d6-489d-9ee2-3a3fe309f450 tempest-CreateVolumesFromImageTest-239318328 None] Acquiring lock "cinder-quobyte-beed53e8-2a23-4349-a6e2-0ed64eed1f13" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:48:46 devstack sudo[103088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_1lhwvta4 Sep 18 21:48:46 devstack sudo[103088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:46 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-1e96c197-99d6-489d-9ee2-3a3fe309f450 tempest-CreateVolumesFromImageTest-239318328 None] Lock "cinder-quobyte-beed53e8-2a23-4349-a6e2-0ed64eed1f13" acquired by "delete_volume" :: waited 0.018s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:48:46 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73f2e11-1075-48ac-a95c-794d7f5ab5aa]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:48:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1e96c197-99d6-489d-9ee2-3a3fe309f450 tempest-CreateVolumesFromImageTest-239318328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-beed53e8-2a23-4349-a6e2-0ed64eed1f13 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:46 devstack sudo[103083]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9c387b43-a479-4057-b239-8b6aa9f630b9 tempest-CreateVolumesFromImageTest-239318328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.476s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:46 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-9c387b43-a479-4057-b239-8b6aa9f630b9 tempest-CreateVolumesFromImageTest-239318328 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:48:46 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-9c387b43-a479-4057-b239-8b6aa9f630b9 tempest-CreateVolumesFromImageTest-239318328 None] Deleted volume successfully. Sep 18 21:48:46 devstack sudo[103090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-beed53e8-2a23-4349-a6e2-0ed64eed1f13 Sep 18 21:48:46 devstack sudo[103090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:46 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0a27d21-7fe8-4f54-8a7e-f48e42b16d03 tempest-ProjectReaderTests-789285419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:48:46 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-e0a27d21-7fe8-4f54-8a7e-f48e42b16d03 tempest-ProjectReaderTests-789285419 None] Flow 'volume_create_manager' (04772a02-56e7-4af6-acac-ed37ba105430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:48:46 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-e0a27d21-7fe8-4f54-8a7e-f48e42b16d03 tempest-ProjectReaderTests-789285419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16614b7f-caef-4e39-a59f-1b2925acba8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:46 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-9c387b43-a479-4057-b239-8b6aa9f630b9 tempest-CreateVolumesFromImageTest-239318328 None] Lock "cinder-7dd9726b-0ea0-4028-b1f9-e820c1f16894-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:48:46 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-e0a27d21-7fe8-4f54-8a7e-f48e42b16d03 tempest-ProjectReaderTests-789285419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16614b7f-caef-4e39-a59f-1b2925acba8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:48:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1081927049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42b5c2e9-f95b-47cc-88ee-345b0bc978cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e742561c2194d10a762398f87f7ceae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:48:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:48:47Z,use_quota=True,user_id='ffe6de373d4445e3b3cfe01d62bed581',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:46 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-e0a27d21-7fe8-4f54-8a7e-f48e42b16d03 tempest-ProjectReaderTests-789285419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (240f0aff-b543-4bf6-acae-fb249bd99b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:46 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-e0a27d21-7fe8-4f54-8a7e-f48e42b16d03 tempest-ProjectReaderTests-789285419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (240f0aff-b543-4bf6-acae-fb249bd99b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:46 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-e0a27d21-7fe8-4f54-8a7e-f48e42b16d03 tempest-ProjectReaderTests-789285419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0202bb84-e78d-4557-a32e-50e15fc9742a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:46 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-e0a27d21-7fe8-4f54-8a7e-f48e42b16d03 tempest-ProjectReaderTests-789285419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0202bb84-e78d-4557-a32e-50e15fc9742a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42b5c2e9-f95b-47cc-88ee-345b0bc978cb', 'volume_name': 'volume-42b5c2e9-f95b-47cc-88ee-345b0bc978cb', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:46 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-e0a27d21-7fe8-4f54-8a7e-f48e42b16d03 tempest-ProjectReaderTests-789285419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa44e147-404e-452e-aae2-e47cb84dc676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:46 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-e0a27d21-7fe8-4f54-8a7e-f48e42b16d03 tempest-ProjectReaderTests-789285419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa44e147-404e-452e-aae2-e47cb84dc676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:46 devstack sudo[103088]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:46 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-e0a27d21-7fe8-4f54-8a7e-f48e42b16d03 tempest-ProjectReaderTests-789285419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50178d43-b37a-4510-a373-10559e98a62c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:46 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-e0a27d21-7fe8-4f54-8a7e-f48e42b16d03 tempest-ProjectReaderTests-789285419 None] Volume 42b5c2e9-f95b-47cc-88ee-345b0bc978cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42b5c2e9-f95b-47cc-88ee-345b0bc978cb', 'volume_size': 1} Sep 18 21:48:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-e0a27d21-7fe8-4f54-8a7e-f48e42b16d03 tempest-ProjectReaderTests-789285419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:48:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-e0a27d21-7fe8-4f54-8a7e-f48e42b16d03 tempest-ProjectReaderTests-789285419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:48:46 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-e0a27d21-7fe8-4f54-8a7e-f48e42b16d03 tempest-ProjectReaderTests-789285419 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:48:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1081927049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42b5c2e9-f95b-47cc-88ee-345b0bc978cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e742561c2194d10a762398f87f7ceae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:48:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:48:47Z,use_quota=True,user_id='ffe6de373d4445e3b3cfe01d62bed581',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:48:46 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-e0a27d21-7fe8-4f54-8a7e-f48e42b16d03 tempest-ProjectReaderTests-789285419 None] Creating volume 42b5c2e9-f95b-47cc-88ee-345b0bc978cb {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:48:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-e0a27d21-7fe8-4f54-8a7e-f48e42b16d03 tempest-ProjectReaderTests-789285419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:48:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-e0a27d21-7fe8-4f54-8a7e-f48e42b16d03 tempest-ProjectReaderTests-789285419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:48:46 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-e0a27d21-7fe8-4f54-8a7e-f48e42b16d03 tempest-ProjectReaderTests-789285419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:48:46 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-e0a27d21-7fe8-4f54-8a7e-f48e42b16d03 tempest-ProjectReaderTests-789285419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:48:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-e0a27d21-7fe8-4f54-8a7e-f48e42b16d03 tempest-ProjectReaderTests-789285419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:48:46 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-e0a27d21-7fe8-4f54-8a7e-f48e42b16d03 tempest-ProjectReaderTests-789285419 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:48:46 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-e0a27d21-7fe8-4f54-8a7e-f48e42b16d03 tempest-ProjectReaderTests-789285419 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:48:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e0a27d21-7fe8-4f54-8a7e-f48e42b16d03 tempest-ProjectReaderTests-789285419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-42b5c2e9-f95b-47cc-88ee-345b0bc978cb 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-8b2c7e4f-c22f-4515-8212-5b360a6c231c tempest-VolumesGetTest-2025585433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_1lhwvta4" returned: 1 in 0.484s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-8b2c7e4f-c22f-4515-8212-5b360a6c231c tempest-VolumesGetTest-2025585433 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_1lhwvta4' failed. Not Retrying. {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 18 21:48:46 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6923ef2-f765-44f7-8c1d-2cd76568cd38]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:48:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-8b2c7e4f-c22f-4515-8212-5b360a6c231c tempest-VolumesGetTest-2025585433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_czvoxumedevstack@QuobyteHD {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:47 devstack sudo[103096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-42b5c2e9-f95b-47cc-88ee-345b0bc978cb 1073741824 Sep 18 21:48:47 devstack sudo[103096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:47 devstack sudo[103097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_czvoxumedevstack@QuobyteHD Sep 18 21:48:47 devstack sudo[103097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:47 devstack sudo[103090]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:47 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1e96c197-99d6-489d-9ee2-3a3fe309f450 tempest-CreateVolumesFromImageTest-239318328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-beed53e8-2a23-4349-a6e2-0ed64eed1f13" returned: 0 in 0.450s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:47 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1e96c197-99d6-489d-9ee2-3a3fe309f450 tempest-CreateVolumesFromImageTest-239318328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-beed53e8-2a23-4349-a6e2-0ed64eed1f13 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:47 devstack sudo[103103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-beed53e8-2a23-4349-a6e2-0ed64eed1f13 Sep 18 21:48:47 devstack sudo[103103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:47 devstack sudo[103097]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:47 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-8b2c7e4f-c22f-4515-8212-5b360a6c231c tempest-VolumesGetTest-2025585433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_czvoxumedevstack@QuobyteHD" returned: 0 in 0.378s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:47 devstack cinder-volume[86136]: DEBUG cinder.image.image_utils [None req-8b2c7e4f-c22f-4515-8212-5b360a6c231c tempest-VolumesGetTest-2025585433 None] a7adbe6d-c72a-4ef2-82c6-e788c5101a2c was qcow2, converting to qcow2 {{(pid=86136) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 18 21:48:47 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-8b2c7e4f-c22f-4515-8212-5b360a6c231c tempest-VolumesGetTest-2025585433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_czvoxumedevstack@QuobyteHD /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-5a3ab1e8-e275-4a10-b289-b68ffad05ec2 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:47 devstack sudo[103113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_czvoxumedevstack@QuobyteHD /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-5a3ab1e8-e275-4a10-b289-b68ffad05ec2 Sep 18 21:48:47 devstack sudo[103113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:47 devstack sudo[103103]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:47 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1e96c197-99d6-489d-9ee2-3a3fe309f450 tempest-CreateVolumesFromImageTest-239318328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-beed53e8-2a23-4349-a6e2-0ed64eed1f13" returned: 0 in 0.255s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:47 devstack sudo[103096]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:47 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e0a27d21-7fe8-4f54-8a7e-f48e42b16d03 tempest-ProjectReaderTests-789285419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-42b5c2e9-f95b-47cc-88ee-345b0bc978cb 1073741824" returned: 0 in 0.462s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:47 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-1e96c197-99d6-489d-9ee2-3a3fe309f450 tempest-CreateVolumesFromImageTest-239318328 None] Lock "cinder-quobyte-beed53e8-2a23-4349-a6e2-0ed64eed1f13" released by "delete_volume" :: held 0.766s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:48:47 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e0a27d21-7fe8-4f54-8a7e-f48e42b16d03 tempest-ProjectReaderTests-789285419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-42b5c2e9-f95b-47cc-88ee-345b0bc978cb {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:47 devstack sudo[103115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-42b5c2e9-f95b-47cc-88ee-345b0bc978cb Sep 18 21:48:47 devstack sudo[103115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:47 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-1e96c197-99d6-489d-9ee2-3a3fe309f450 tempest-CreateVolumesFromImageTest-239318328 None] Created reservations ['692e628c-9afb-4c6a-ba66-5e538ac215fd', '11db519f-40fb-4f28-8c33-0e975d68e731', '8c93243b-1c63-4b02-9b41-0290f5743547', 'e9deb376-9dd2-4f8c-b704-31336d33e922'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:48:47 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-1e96c197-99d6-489d-9ee2-3a3fe309f450 tempest-CreateVolumesFromImageTest-239318328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:48:47 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-1e96c197-99d6-489d-9ee2-3a3fe309f450 tempest-CreateVolumesFromImageTest-239318328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:48:47 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-1e96c197-99d6-489d-9ee2-3a3fe309f450 tempest-CreateVolumesFromImageTest-239318328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:48:47 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-1e96c197-99d6-489d-9ee2-3a3fe309f450 tempest-CreateVolumesFromImageTest-239318328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:48:47 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-1e96c197-99d6-489d-9ee2-3a3fe309f450 tempest-CreateVolumesFromImageTest-239318328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:48:47 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1e96c197-99d6-489d-9ee2-3a3fe309f450 tempest-CreateVolumesFromImageTest-239318328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:47 devstack sudo[103120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:48:47 devstack sudo[103120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:47 devstack sudo[103115]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:47 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e0a27d21-7fe8-4f54-8a7e-f48e42b16d03 tempest-ProjectReaderTests-789285419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-42b5c2e9-f95b-47cc-88ee-345b0bc978cb" returned: 0 in 0.336s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:47 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-e0a27d21-7fe8-4f54-8a7e-f48e42b16d03 tempest-ProjectReaderTests-789285419 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:48:47 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-e0a27d21-7fe8-4f54-8a7e-f48e42b16d03 tempest-ProjectReaderTests-789285419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:48:47 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-e0a27d21-7fe8-4f54-8a7e-f48e42b16d03 tempest-ProjectReaderTests-789285419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50178d43-b37a-4510-a373-10559e98a62c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42b5c2e9-f95b-47cc-88ee-345b0bc978cb', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:47 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-e0a27d21-7fe8-4f54-8a7e-f48e42b16d03 tempest-ProjectReaderTests-789285419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (340191b1-087a-47c1-9730-0916826b18ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:47 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-e0a27d21-7fe8-4f54-8a7e-f48e42b16d03 tempest-ProjectReaderTests-789285419 None] Volume volume-42b5c2e9-f95b-47cc-88ee-345b0bc978cb (42b5c2e9-f95b-47cc-88ee-345b0bc978cb): created successfully Sep 18 21:48:47 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-e0a27d21-7fe8-4f54-8a7e-f48e42b16d03 tempest-ProjectReaderTests-789285419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (340191b1-087a-47c1-9730-0916826b18ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:47 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-e0a27d21-7fe8-4f54-8a7e-f48e42b16d03 tempest-ProjectReaderTests-789285419 None] Flow 'volume_create_manager' (04772a02-56e7-4af6-acac-ed37ba105430) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:48:47 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-e0a27d21-7fe8-4f54-8a7e-f48e42b16d03 tempest-ProjectReaderTests-789285419 None] Created volume successfully. Sep 18 21:48:47 devstack sudo[103120]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:47 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1e96c197-99d6-489d-9ee2-3a3fe309f450 tempest-CreateVolumesFromImageTest-239318328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.300s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:47 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-1e96c197-99d6-489d-9ee2-3a3fe309f450 tempest-CreateVolumesFromImageTest-239318328 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:48:47 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-1e96c197-99d6-489d-9ee2-3a3fe309f450 tempest-CreateVolumesFromImageTest-239318328 None] Deleted volume successfully. Sep 18 21:48:47 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-1e96c197-99d6-489d-9ee2-3a3fe309f450 tempest-CreateVolumesFromImageTest-239318328 None] Lock "cinder-beed53e8-2a23-4349-a6e2-0ed64eed1f13-delete_volume" released by "delete_volume" :: held 1.370s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:48:49 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-9db2a9b9-534d-43d6-80f8-d124519da796 tempest-ProjectReaderTests-789285419 None] Acquiring lock "cinder-42b5c2e9-f95b-47cc-88ee-345b0bc978cb-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:48:49 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-9db2a9b9-534d-43d6-80f8-d124519da796 tempest-ProjectReaderTests-789285419 None] Lock "cinder-42b5c2e9-f95b-47cc-88ee-345b0bc978cb-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:48:49 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-9db2a9b9-534d-43d6-80f8-d124519da796 tempest-ProjectReaderTests-789285419 None] Acquiring lock "cinder-quobyte-42b5c2e9-f95b-47cc-88ee-345b0bc978cb" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:48:49 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-9db2a9b9-534d-43d6-80f8-d124519da796 tempest-ProjectReaderTests-789285419 None] Lock "cinder-quobyte-42b5c2e9-f95b-47cc-88ee-345b0bc978cb" acquired by "delete_volume" :: waited 0.016s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:48:49 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[557b40d7-ae6e-48db-88d2-46e385c5b954]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:48:49 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9db2a9b9-534d-43d6-80f8-d124519da796 tempest-ProjectReaderTests-789285419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-42b5c2e9-f95b-47cc-88ee-345b0bc978cb {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:49 devstack sudo[103129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-42b5c2e9-f95b-47cc-88ee-345b0bc978cb Sep 18 21:48:49 devstack sudo[103129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:49 devstack sudo[103129]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:49 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9db2a9b9-534d-43d6-80f8-d124519da796 tempest-ProjectReaderTests-789285419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-42b5c2e9-f95b-47cc-88ee-345b0bc978cb" returned: 0 in 0.401s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:49 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9db2a9b9-534d-43d6-80f8-d124519da796 tempest-ProjectReaderTests-789285419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-42b5c2e9-f95b-47cc-88ee-345b0bc978cb {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:49 devstack sudo[103136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-42b5c2e9-f95b-47cc-88ee-345b0bc978cb Sep 18 21:48:49 devstack sudo[103136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:49 devstack sudo[103113]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:49 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-8b2c7e4f-c22f-4515-8212-5b360a6c231c tempest-VolumesGetTest-2025585433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_czvoxumedevstack@QuobyteHD /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-5a3ab1e8-e275-4a10-b289-b68ffad05ec2" returned: 0 in 2.241s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:49 devstack cinder-volume[86136]: DEBUG cinder.image.image_utils [None req-8b2c7e4f-c22f-4515-8212-5b360a6c231c tempest-VolumesGetTest-2025585433 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a7adbe6d-c72a-4ef2-82c6-e788c5101a2c_czvoxumedevstack@QuobyteHD, size 112.00 MB, duration 2.24 sec, destination /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-5a3ab1e8-e275-4a10-b289-b68ffad05ec2 {{(pid=86136) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 18 21:48:49 devstack cinder-volume[86136]: INFO cinder.image.image_utils [None req-8b2c7e4f-c22f-4515-8212-5b360a6c231c tempest-VolumesGetTest-2025585433 None] Converted 112.00 MB image at 49.95 MB/s Sep 18 21:48:49 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-8b2c7e4f-c22f-4515-8212-5b360a6c231c tempest-VolumesGetTest-2025585433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-5a3ab1e8-e275-4a10-b289-b68ffad05ec2 1G {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:49 devstack sudo[103138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-5a3ab1e8-e275-4a10-b289-b68ffad05ec2 1G Sep 18 21:48:49 devstack sudo[103138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:49 devstack sudo[103136]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:49 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9db2a9b9-534d-43d6-80f8-d124519da796 tempest-ProjectReaderTests-789285419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-42b5c2e9-f95b-47cc-88ee-345b0bc978cb" returned: 0 in 0.268s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:49 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-9db2a9b9-534d-43d6-80f8-d124519da796 tempest-ProjectReaderTests-789285419 None] Lock "cinder-quobyte-42b5c2e9-f95b-47cc-88ee-345b0bc978cb" released by "delete_volume" :: held 0.729s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:48:49 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-9db2a9b9-534d-43d6-80f8-d124519da796 tempest-ProjectReaderTests-789285419 None] Created reservations ['c40dea70-cd7c-4789-a368-41086b81f360', '3e2be110-1c87-41ed-aad1-c42957716f92', '4d3e3ddd-078e-4880-8374-d8dc0e57b6af', '1650db53-344f-4007-b8c3-9de0d8a37141'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:48:49 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-9db2a9b9-534d-43d6-80f8-d124519da796 tempest-ProjectReaderTests-789285419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:48:49 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-9db2a9b9-534d-43d6-80f8-d124519da796 tempest-ProjectReaderTests-789285419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:48:49 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-9db2a9b9-534d-43d6-80f8-d124519da796 tempest-ProjectReaderTests-789285419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:48:49 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-9db2a9b9-534d-43d6-80f8-d124519da796 tempest-ProjectReaderTests-789285419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:48:49 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-9db2a9b9-534d-43d6-80f8-d124519da796 tempest-ProjectReaderTests-789285419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:48:49 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9db2a9b9-534d-43d6-80f8-d124519da796 tempest-ProjectReaderTests-789285419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:49 devstack sudo[103144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:48:49 devstack sudo[103138]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:49 devstack sudo[103144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:50 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-8b2c7e4f-c22f-4515-8212-5b360a6c231c tempest-VolumesGetTest-2025585433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-5a3ab1e8-e275-4a10-b289-b68ffad05ec2 1G" returned: 0 in 0.375s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:50 devstack cinder-volume[86136]: DEBUG cinder.volume.volume_utils [None req-8b2c7e4f-c22f-4515-8212-5b360a6c231c tempest-VolumesGetTest-2025585433 None] Downloaded image a7adbe6d-c72a-4ef2-82c6-e788c5101a2c ((None, [{'url': 'file:///opt/stack/data/glance/images/a7adbe6d-c72a-4ef2-82c6-e788c5101a2c', 'metadata': {}}])) to volume 5a3ab1e8-e275-4a10-b289-b68ffad05ec2 successfully. {{(pid=86136) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 18 21:48:50 devstack cinder-volume[86136]: DEBUG cinder.image.image_utils [None req-8b2c7e4f-c22f-4515-8212-5b360a6c231c tempest-VolumesGetTest-2025585433 None] Temporary image a7adbe6d-c72a-4ef2-82c6-e788c5101a2c for user 93d906f234b946cea603ec1bfebe96ad is deleted. {{(pid=86136) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 18 21:48:50 devstack cinder-volume[86136]: DEBUG cinder.volume.volume_utils [None req-8b2c7e4f-c22f-4515-8212-5b360a6c231c tempest-VolumesGetTest-2025585433 None] Marking volume 5a3ab1e8-e275-4a10-b289-b68ffad05ec2 as bootable. {{(pid=86136) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 18 21:48:50 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b2c7e4f-c22f-4515-8212-5b360a6c231c tempest-VolumesGetTest-2025585433 None] Copying metadata from image a7adbe6d-c72a-4ef2-82c6-e788c5101a2c to 5a3ab1e8-e275-4a10-b289-b68ffad05ec2. {{(pid=86136) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 18 21:48:50 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b2c7e4f-c22f-4515-8212-5b360a6c231c tempest-VolumesGetTest-2025585433 None] Creating volume glance metadata for volume 5a3ab1e8-e275-4a10-b289-b68ffad05ec2 backed by image a7adbe6d-c72a-4ef2-82c6-e788c5101a2c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a7adbe6d-c72a-4ef2-82c6-e788c5101a2c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86136) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 18 21:48:50 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-8b2c7e4f-c22f-4515-8212-5b360a6c231c tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16ddd425-dd0a-439c-85bd-34cd9569e69c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a3ab1e8-e275-4a10-b289-b68ffad05ec2', 'volume_size': 1, 'image_id': 'a7adbe6d-c72a-4ef2-82c6-e788c5101a2c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a7adbe6d-c72a-4ef2-82c6-e788c5101a2c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'eae9b2cfe4f146fb9d7ac38006d73cd9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a7adbe6d-c72a-4ef2-82c6-e788c5101a2c', 'created_at': datetime.datetime(2026, 9, 18, 19, 27, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 18, 19, 27, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a7adbe6d-c72a-4ef2-82c6-e788c5101a2c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:50 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-8b2c7e4f-c22f-4515-8212-5b360a6c231c tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0a16433-aa20-4685-9aa8-28d4a66d8e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:50 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-8b2c7e4f-c22f-4515-8212-5b360a6c231c tempest-VolumesGetTest-2025585433 None] Volume volume-5a3ab1e8-e275-4a10-b289-b68ffad05ec2 (5a3ab1e8-e275-4a10-b289-b68ffad05ec2): created successfully Sep 18 21:48:50 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-8b2c7e4f-c22f-4515-8212-5b360a6c231c tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0a16433-aa20-4685-9aa8-28d4a66d8e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:50 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-8b2c7e4f-c22f-4515-8212-5b360a6c231c tempest-VolumesGetTest-2025585433 None] Flow 'volume_create_manager' (611b8a22-425e-474a-aa5c-0c9ef012ddf1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:48:50 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-8b2c7e4f-c22f-4515-8212-5b360a6c231c tempest-VolumesGetTest-2025585433 None] Created volume successfully. Sep 18 21:48:50 devstack sudo[103144]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:50 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9db2a9b9-534d-43d6-80f8-d124519da796 tempest-ProjectReaderTests-789285419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.317s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:50 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-9db2a9b9-534d-43d6-80f8-d124519da796 tempest-ProjectReaderTests-789285419 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:48:50 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-9db2a9b9-534d-43d6-80f8-d124519da796 tempest-ProjectReaderTests-789285419 None] Deleted volume successfully. Sep 18 21:48:50 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-9db2a9b9-534d-43d6-80f8-d124519da796 tempest-ProjectReaderTests-789285419 None] Lock "cinder-42b5c2e9-f95b-47cc-88ee-345b0bc978cb-delete_volume" released by "delete_volume" :: held 1.262s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:48:51 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb4b6eea-b04c-488c-a16b-9de83a3ed935 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:48:51 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-fb4b6eea-b04c-488c-a16b-9de83a3ed935 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Flow 'volume_create_manager' (0451baf9-b268-45bd-a06a-a8eb4734ab41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:48:51 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-fb4b6eea-b04c-488c-a16b-9de83a3ed935 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (727991ba-8149-4e69-a9bb-7f90cb663357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:51 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-fb4b6eea-b04c-488c-a16b-9de83a3ed935 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (727991ba-8149-4e69-a9bb-7f90cb663357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:48:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2099719588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54810e41-a8e7-4f07-8d4f-5f4ffad7d39e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d776d50f4f94679a1e5eaaade3384d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:48:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:48:52Z,use_quota=True,user_id='6a5b5a5aba114bf48088fc7e9f23c301',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:51 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-fb4b6eea-b04c-488c-a16b-9de83a3ed935 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a15cb47a-5e65-4a4e-b4c6-41a0710e4b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:51 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-fb4b6eea-b04c-488c-a16b-9de83a3ed935 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a15cb47a-5e65-4a4e-b4c6-41a0710e4b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:51 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-fb4b6eea-b04c-488c-a16b-9de83a3ed935 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14a0a3cc-8e76-4ab7-a491-818f5292fb08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:51 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-fb4b6eea-b04c-488c-a16b-9de83a3ed935 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14a0a3cc-8e76-4ab7-a491-818f5292fb08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54810e41-a8e7-4f07-8d4f-5f4ffad7d39e', 'volume_name': 'volume-54810e41-a8e7-4f07-8d4f-5f4ffad7d39e', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:51 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-fb4b6eea-b04c-488c-a16b-9de83a3ed935 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bf5ee1b-5290-486a-9e92-83b275c66c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:51 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-fb4b6eea-b04c-488c-a16b-9de83a3ed935 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bf5ee1b-5290-486a-9e92-83b275c66c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:51 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-fb4b6eea-b04c-488c-a16b-9de83a3ed935 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3781ff8-a88a-4e87-ba61-e0c4f86d1b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:51 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-fb4b6eea-b04c-488c-a16b-9de83a3ed935 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Volume 54810e41-a8e7-4f07-8d4f-5f4ffad7d39e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54810e41-a8e7-4f07-8d4f-5f4ffad7d39e', 'volume_size': 1} Sep 18 21:48:51 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-fb4b6eea-b04c-488c-a16b-9de83a3ed935 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:48:51 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-fb4b6eea-b04c-488c-a16b-9de83a3ed935 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:48:51 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-fb4b6eea-b04c-488c-a16b-9de83a3ed935 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:48:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2099719588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54810e41-a8e7-4f07-8d4f-5f4ffad7d39e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d776d50f4f94679a1e5eaaade3384d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:48:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:48:52Z,use_quota=True,user_id='6a5b5a5aba114bf48088fc7e9f23c301',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:48:51 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-fb4b6eea-b04c-488c-a16b-9de83a3ed935 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Creating volume 54810e41-a8e7-4f07-8d4f-5f4ffad7d39e {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:48:51 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-fb4b6eea-b04c-488c-a16b-9de83a3ed935 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:48:51 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-fb4b6eea-b04c-488c-a16b-9de83a3ed935 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:48:51 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-fb4b6eea-b04c-488c-a16b-9de83a3ed935 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:48:51 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-fb4b6eea-b04c-488c-a16b-9de83a3ed935 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:48:51 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-fb4b6eea-b04c-488c-a16b-9de83a3ed935 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:48:51 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-fb4b6eea-b04c-488c-a16b-9de83a3ed935 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:48:51 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-fb4b6eea-b04c-488c-a16b-9de83a3ed935 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:48:51 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-fb4b6eea-b04c-488c-a16b-9de83a3ed935 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-54810e41-a8e7-4f07-8d4f-5f4ffad7d39e 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:51 devstack sudo[103148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-54810e41-a8e7-4f07-8d4f-5f4ffad7d39e 1073741824 Sep 18 21:48:51 devstack sudo[103148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:52 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-e52bad86-e67b-4404-87be-7ff50e4343ca tempest-VolumesGetTest-2025585433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:48:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-e52bad86-e67b-4404-87be-7ff50e4343ca tempest-VolumesGetTest-2025585433 None] Flow 'volume_create_manager' (8ee78ae6-5b31-48ef-9568-5c461ce7168b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:48:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-e52bad86-e67b-4404-87be-7ff50e4343ca tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa2f260c-c6e6-4dd0-a2df-0e8f590aecda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-e52bad86-e67b-4404-87be-7ff50e4343ca tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa2f260c-c6e6-4dd0-a2df-0e8f590aecda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:48:52Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1544081909',display_name='tempest-VolumesGetTest-Volume-1643072593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3044b7b0-4662-4e88-b7b4-2b3b88434174,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6cd15df09da425c84d7c465a1bd7b81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:48:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:48:52Z,use_quota=True,user_id='93d906f234b946cea603ec1bfebe96ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-e52bad86-e67b-4404-87be-7ff50e4343ca tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2952a68d-8180-4dab-b8ee-a8d19aa7501f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-e52bad86-e67b-4404-87be-7ff50e4343ca tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2952a68d-8180-4dab-b8ee-a8d19aa7501f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-e52bad86-e67b-4404-87be-7ff50e4343ca tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (901443bc-559c-4e96-9d3a-050f8613953b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-e52bad86-e67b-4404-87be-7ff50e4343ca tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (901443bc-559c-4e96-9d3a-050f8613953b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3044b7b0-4662-4e88-b7b4-2b3b88434174', 'volume_name': 'volume-3044b7b0-4662-4e88-b7b4-2b3b88434174', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-e52bad86-e67b-4404-87be-7ff50e4343ca tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8b8b1e1-3596-4255-893e-6d9c969cb37a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-e52bad86-e67b-4404-87be-7ff50e4343ca tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8b8b1e1-3596-4255-893e-6d9c969cb37a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-e52bad86-e67b-4404-87be-7ff50e4343ca tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02553e3b-c581-4a20-a61a-852ba2f8bbc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:52 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-e52bad86-e67b-4404-87be-7ff50e4343ca tempest-VolumesGetTest-2025585433 None] Volume 3044b7b0-4662-4e88-b7b4-2b3b88434174: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3044b7b0-4662-4e88-b7b4-2b3b88434174', 'volume_size': 1} Sep 18 21:48:52 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-e52bad86-e67b-4404-87be-7ff50e4343ca tempest-VolumesGetTest-2025585433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:48:52 devstack sudo[103148]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:52 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-fb4b6eea-b04c-488c-a16b-9de83a3ed935 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-54810e41-a8e7-4f07-8d4f-5f4ffad7d39e 1073741824" returned: 0 in 0.452s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:52 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-fb4b6eea-b04c-488c-a16b-9de83a3ed935 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-54810e41-a8e7-4f07-8d4f-5f4ffad7d39e {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:52 devstack sudo[103153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-54810e41-a8e7-4f07-8d4f-5f4ffad7d39e Sep 18 21:48:52 devstack sudo[103153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:52 devstack sudo[103153]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:52 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-fb4b6eea-b04c-488c-a16b-9de83a3ed935 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-54810e41-a8e7-4f07-8d4f-5f4ffad7d39e" returned: 0 in 0.259s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:52 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-fb4b6eea-b04c-488c-a16b-9de83a3ed935 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:48:52 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-fb4b6eea-b04c-488c-a16b-9de83a3ed935 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.770s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:48:52 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-e52bad86-e67b-4404-87be-7ff50e4343ca tempest-VolumesGetTest-2025585433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.456s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:48:52 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-e52bad86-e67b-4404-87be-7ff50e4343ca tempest-VolumesGetTest-2025585433 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:48:52Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1544081909',display_name='tempest-VolumesGetTest-Volume-1643072593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3044b7b0-4662-4e88-b7b4-2b3b88434174,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6cd15df09da425c84d7c465a1bd7b81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:48:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:48:52Z,use_quota=True,user_id='93d906f234b946cea603ec1bfebe96ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:48:52 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-e52bad86-e67b-4404-87be-7ff50e4343ca tempest-VolumesGetTest-2025585433 None] Creating volume 3044b7b0-4662-4e88-b7b4-2b3b88434174 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:48:52 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-e52bad86-e67b-4404-87be-7ff50e4343ca tempest-VolumesGetTest-2025585433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:48:52 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-e52bad86-e67b-4404-87be-7ff50e4343ca tempest-VolumesGetTest-2025585433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:48:52 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-e52bad86-e67b-4404-87be-7ff50e4343ca tempest-VolumesGetTest-2025585433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:48:52 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-e52bad86-e67b-4404-87be-7ff50e4343ca tempest-VolumesGetTest-2025585433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:48:52 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-e52bad86-e67b-4404-87be-7ff50e4343ca tempest-VolumesGetTest-2025585433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:48:52 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-e52bad86-e67b-4404-87be-7ff50e4343ca tempest-VolumesGetTest-2025585433 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:48:52 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-e52bad86-e67b-4404-87be-7ff50e4343ca tempest-VolumesGetTest-2025585433 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:48:52 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e52bad86-e67b-4404-87be-7ff50e4343ca tempest-VolumesGetTest-2025585433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3044b7b0-4662-4e88-b7b4-2b3b88434174 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:52 devstack sudo[103156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3044b7b0-4662-4e88-b7b4-2b3b88434174 1073741824 Sep 18 21:48:52 devstack sudo[103156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-fb4b6eea-b04c-488c-a16b-9de83a3ed935 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3781ff8-a88a-4e87-ba61-e0c4f86d1b24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54810e41-a8e7-4f07-8d4f-5f4ffad7d39e', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-fb4b6eea-b04c-488c-a16b-9de83a3ed935 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec17f3e9-6268-47a0-829d-cb49a733bd00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:52 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-fb4b6eea-b04c-488c-a16b-9de83a3ed935 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Volume volume-54810e41-a8e7-4f07-8d4f-5f4ffad7d39e (54810e41-a8e7-4f07-8d4f-5f4ffad7d39e): created successfully Sep 18 21:48:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-fb4b6eea-b04c-488c-a16b-9de83a3ed935 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec17f3e9-6268-47a0-829d-cb49a733bd00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-fb4b6eea-b04c-488c-a16b-9de83a3ed935 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Flow 'volume_create_manager' (0451baf9-b268-45bd-a06a-a8eb4734ab41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:48:52 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-fb4b6eea-b04c-488c-a16b-9de83a3ed935 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Created volume successfully. Sep 18 21:48:53 devstack sudo[103156]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:53 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e52bad86-e67b-4404-87be-7ff50e4343ca tempest-VolumesGetTest-2025585433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3044b7b0-4662-4e88-b7b4-2b3b88434174 1073741824" returned: 0 in 0.412s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:53 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e52bad86-e67b-4404-87be-7ff50e4343ca tempest-VolumesGetTest-2025585433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3044b7b0-4662-4e88-b7b4-2b3b88434174 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:53 devstack sudo[103162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3044b7b0-4662-4e88-b7b4-2b3b88434174 Sep 18 21:48:53 devstack sudo[103162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:53 devstack sudo[103162]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:53 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e52bad86-e67b-4404-87be-7ff50e4343ca tempest-VolumesGetTest-2025585433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3044b7b0-4662-4e88-b7b4-2b3b88434174" returned: 0 in 0.250s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:53 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-e52bad86-e67b-4404-87be-7ff50e4343ca tempest-VolumesGetTest-2025585433 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:48:53 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-e52bad86-e67b-4404-87be-7ff50e4343ca tempest-VolumesGetTest-2025585433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:48:53 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-e52bad86-e67b-4404-87be-7ff50e4343ca tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02553e3b-c581-4a20-a61a-852ba2f8bbc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3044b7b0-4662-4e88-b7b4-2b3b88434174', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:53 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-e52bad86-e67b-4404-87be-7ff50e4343ca tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2687a9e-2f23-4f63-87c1-5b156ed0ad3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:53 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-e52bad86-e67b-4404-87be-7ff50e4343ca tempest-VolumesGetTest-2025585433 None] Volume volume-3044b7b0-4662-4e88-b7b4-2b3b88434174 (3044b7b0-4662-4e88-b7b4-2b3b88434174): created successfully Sep 18 21:48:53 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-e52bad86-e67b-4404-87be-7ff50e4343ca tempest-VolumesGetTest-2025585433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2687a9e-2f23-4f63-87c1-5b156ed0ad3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:53 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-e52bad86-e67b-4404-87be-7ff50e4343ca tempest-VolumesGetTest-2025585433 None] Flow 'volume_create_manager' (8ee78ae6-5b31-48ef-9568-5c461ce7168b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:48:53 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-e52bad86-e67b-4404-87be-7ff50e4343ca tempest-VolumesGetTest-2025585433 None] Created volume successfully. Sep 18 21:48:53 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-25c02bdf-4b3f-4a74-a66a-4080ca784d0c tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:48:54 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-25c02bdf-4b3f-4a74-a66a-4080ca784d0c tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Flow 'volume_create_manager' (3c2f96e4-5ee7-4b15-959a-a207def6576b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:48:54 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-25c02bdf-4b3f-4a74-a66a-4080ca784d0c tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eadaf7f-7a24-485d-bffe-2ce85ddea97a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:54 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-25c02bdf-4b3f-4a74-a66a-4080ca784d0c tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eadaf7f-7a24-485d-bffe-2ce85ddea97a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:48:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1801190822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ded39399-c478-4dd1-9409-d7ca639fba02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d776d50f4f94679a1e5eaaade3384d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:48:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:48:54Z,use_quota=True,user_id='6a5b5a5aba114bf48088fc7e9f23c301',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:54 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-25c02bdf-4b3f-4a74-a66a-4080ca784d0c tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35422263-25b6-4d7e-8c56-05e575ed8e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:54 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-25c02bdf-4b3f-4a74-a66a-4080ca784d0c tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35422263-25b6-4d7e-8c56-05e575ed8e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:54 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-25c02bdf-4b3f-4a74-a66a-4080ca784d0c tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42755483-3d0f-442b-9131-7b7a213688a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:54 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-25c02bdf-4b3f-4a74-a66a-4080ca784d0c tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42755483-3d0f-442b-9131-7b7a213688a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ded39399-c478-4dd1-9409-d7ca639fba02', 'volume_name': 'volume-ded39399-c478-4dd1-9409-d7ca639fba02', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:54 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-25c02bdf-4b3f-4a74-a66a-4080ca784d0c tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ccac9ed-74f4-4696-b448-656d89222055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:54 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-25c02bdf-4b3f-4a74-a66a-4080ca784d0c tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ccac9ed-74f4-4696-b448-656d89222055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:54 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-25c02bdf-4b3f-4a74-a66a-4080ca784d0c tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a1fc922-5069-4d83-b997-c3e1b5a6bf9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:54 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-25c02bdf-4b3f-4a74-a66a-4080ca784d0c tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Volume ded39399-c478-4dd1-9409-d7ca639fba02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ded39399-c478-4dd1-9409-d7ca639fba02', 'volume_size': 1} Sep 18 21:48:54 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-25c02bdf-4b3f-4a74-a66a-4080ca784d0c tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:48:54 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-25c02bdf-4b3f-4a74-a66a-4080ca784d0c tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:48:54 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-25c02bdf-4b3f-4a74-a66a-4080ca784d0c tempest-CreateVolumesFromSourceVolumeTest-628114287 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:48:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1801190822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ded39399-c478-4dd1-9409-d7ca639fba02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d776d50f4f94679a1e5eaaade3384d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:48:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:48:54Z,use_quota=True,user_id='6a5b5a5aba114bf48088fc7e9f23c301',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:48:54 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-25c02bdf-4b3f-4a74-a66a-4080ca784d0c tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Creating volume ded39399-c478-4dd1-9409-d7ca639fba02 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:48:54 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-25c02bdf-4b3f-4a74-a66a-4080ca784d0c tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:48:54 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-25c02bdf-4b3f-4a74-a66a-4080ca784d0c tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:48:54 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-25c02bdf-4b3f-4a74-a66a-4080ca784d0c tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:48:54 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-25c02bdf-4b3f-4a74-a66a-4080ca784d0c tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:48:54 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-25c02bdf-4b3f-4a74-a66a-4080ca784d0c tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:48:54 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-25c02bdf-4b3f-4a74-a66a-4080ca784d0c tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:48:54 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-25c02bdf-4b3f-4a74-a66a-4080ca784d0c tempest-CreateVolumesFromSourceVolumeTest-628114287 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:48:54 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-25c02bdf-4b3f-4a74-a66a-4080ca784d0c tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ded39399-c478-4dd1-9409-d7ca639fba02 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:54 devstack sudo[103165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ded39399-c478-4dd1-9409-d7ca639fba02 1073741824 Sep 18 21:48:54 devstack sudo[103165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:54 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-5035689e-f3f2-4a6b-bca2-79519328a309 tempest-VolumesGetTest-2025585433 None] Acquiring lock "cinder-3044b7b0-4662-4e88-b7b4-2b3b88434174-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:48:54 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-5035689e-f3f2-4a6b-bca2-79519328a309 tempest-VolumesGetTest-2025585433 None] Lock "cinder-3044b7b0-4662-4e88-b7b4-2b3b88434174-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:48:54 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-5035689e-f3f2-4a6b-bca2-79519328a309 tempest-VolumesGetTest-2025585433 None] Acquiring lock "cinder-quobyte-3044b7b0-4662-4e88-b7b4-2b3b88434174" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:48:54 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-524dd44f-2cf7-429d-92a7-3e5c56479544 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:48:54 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-524dd44f-2cf7-429d-92a7-3e5c56479544 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Flow 'volume_create_manager' (97be97bd-6f5d-4504-a8d9-6bbf6f6aeacf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:48:54 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-524dd44f-2cf7-429d-92a7-3e5c56479544 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (149b74f2-e501-4746-be4c-905925fce765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:54 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-5035689e-f3f2-4a6b-bca2-79519328a309 tempest-VolumesGetTest-2025585433 None] Lock "cinder-quobyte-3044b7b0-4662-4e88-b7b4-2b3b88434174" acquired by "delete_volume" :: waited 0.067s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:48:54 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-524dd44f-2cf7-429d-92a7-3e5c56479544 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (149b74f2-e501-4746-be4c-905925fce765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:48:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1789062685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eee4ce10-e8d8-4606-a8c8-a48276b4b416,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d776d50f4f94679a1e5eaaade3384d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:48:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:48:54Z,use_quota=True,user_id='6a5b5a5aba114bf48088fc7e9f23c301',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:54 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-524dd44f-2cf7-429d-92a7-3e5c56479544 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adeb1eb0-509e-4074-9bde-bddd4cc9f0ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:54 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-524dd44f-2cf7-429d-92a7-3e5c56479544 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adeb1eb0-509e-4074-9bde-bddd4cc9f0ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:54 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-524dd44f-2cf7-429d-92a7-3e5c56479544 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cde15e5-bb0b-4e04-bde4-7f309ea84f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:54 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-524dd44f-2cf7-429d-92a7-3e5c56479544 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cde15e5-bb0b-4e04-bde4-7f309ea84f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eee4ce10-e8d8-4606-a8c8-a48276b4b416', 'volume_name': 'volume-eee4ce10-e8d8-4606-a8c8-a48276b4b416', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:54 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-524dd44f-2cf7-429d-92a7-3e5c56479544 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d4356e4-348b-4880-b240-4d0412d8e37d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:54 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-524dd44f-2cf7-429d-92a7-3e5c56479544 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d4356e4-348b-4880-b240-4d0412d8e37d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:54 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-524dd44f-2cf7-429d-92a7-3e5c56479544 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3a8d716-d46f-45f9-a97e-9aa4aaf23a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:54 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-524dd44f-2cf7-429d-92a7-3e5c56479544 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Volume eee4ce10-e8d8-4606-a8c8-a48276b4b416: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eee4ce10-e8d8-4606-a8c8-a48276b4b416', 'volume_size': 1} Sep 18 21:48:54 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-524dd44f-2cf7-429d-92a7-3e5c56479544 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:48:54 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a7fa4ee-fca7-4fa9-959a-45d6caaef480]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:48:54 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5035689e-f3f2-4a6b-bca2-79519328a309 tempest-VolumesGetTest-2025585433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3044b7b0-4662-4e88-b7b4-2b3b88434174 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:54 devstack sudo[103165]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:54 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-25c02bdf-4b3f-4a74-a66a-4080ca784d0c tempest-CreateVolumesFromSourceVolumeTest-628114287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ded39399-c478-4dd1-9409-d7ca639fba02 1073741824" returned: 0 in 0.586s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:54 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-25c02bdf-4b3f-4a74-a66a-4080ca784d0c tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ded39399-c478-4dd1-9409-d7ca639fba02 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:54 devstack sudo[103171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3044b7b0-4662-4e88-b7b4-2b3b88434174 Sep 18 21:48:54 devstack sudo[103171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:54 devstack sudo[103172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ded39399-c478-4dd1-9409-d7ca639fba02 Sep 18 21:48:54 devstack sudo[103172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:54 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-64d3ef48-5e08-47ff-8998-0e58fc92efeb tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:48:54 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-64d3ef48-5e08-47ff-8998-0e58fc92efeb tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Flow 'volume_create_manager' (0ad6a026-c3ea-4713-a66b-463543b92cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:48:54 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-64d3ef48-5e08-47ff-8998-0e58fc92efeb tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (624c5e83-9229-41d0-8101-ecc5f4dce4b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:54 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-64d3ef48-5e08-47ff-8998-0e58fc92efeb tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (624c5e83-9229-41d0-8101-ecc5f4dce4b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:48:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-221904886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6391252-41c1-4862-b7b7-99ac70ee2268,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d776d50f4f94679a1e5eaaade3384d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:48:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:48:55Z,use_quota=True,user_id='6a5b5a5aba114bf48088fc7e9f23c301',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:54 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-64d3ef48-5e08-47ff-8998-0e58fc92efeb tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1e90114-6006-46ae-8d41-42853a0fceb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-64d3ef48-5e08-47ff-8998-0e58fc92efeb tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1e90114-6006-46ae-8d41-42853a0fceb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-64d3ef48-5e08-47ff-8998-0e58fc92efeb tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df27dbf6-7b04-4a5f-960e-e1ad40574756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-64d3ef48-5e08-47ff-8998-0e58fc92efeb tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df27dbf6-7b04-4a5f-960e-e1ad40574756) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6391252-41c1-4862-b7b7-99ac70ee2268', 'volume_name': 'volume-f6391252-41c1-4862-b7b7-99ac70ee2268', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-64d3ef48-5e08-47ff-8998-0e58fc92efeb tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b4fc625-4567-485c-b81c-cc64fc508063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-64d3ef48-5e08-47ff-8998-0e58fc92efeb tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b4fc625-4567-485c-b81c-cc64fc508063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:55 devstack sudo[103171]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-64d3ef48-5e08-47ff-8998-0e58fc92efeb tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (194c8aba-e3d0-4e77-9b0d-50f597de81e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:55 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-64d3ef48-5e08-47ff-8998-0e58fc92efeb tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Volume f6391252-41c1-4862-b7b7-99ac70ee2268: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6391252-41c1-4862-b7b7-99ac70ee2268', 'volume_size': 1} Sep 18 21:48:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-64d3ef48-5e08-47ff-8998-0e58fc92efeb tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:48:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5035689e-f3f2-4a6b-bca2-79519328a309 tempest-VolumesGetTest-2025585433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3044b7b0-4662-4e88-b7b4-2b3b88434174" returned: 0 in 0.452s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5035689e-f3f2-4a6b-bca2-79519328a309 tempest-VolumesGetTest-2025585433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3044b7b0-4662-4e88-b7b4-2b3b88434174 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:55 devstack sudo[103179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3044b7b0-4662-4e88-b7b4-2b3b88434174 Sep 18 21:48:55 devstack sudo[103179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:55 devstack sudo[103172]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-25c02bdf-4b3f-4a74-a66a-4080ca784d0c tempest-CreateVolumesFromSourceVolumeTest-628114287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ded39399-c478-4dd1-9409-d7ca639fba02" returned: 0 in 0.378s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:55 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-25c02bdf-4b3f-4a74-a66a-4080ca784d0c tempest-CreateVolumesFromSourceVolumeTest-628114287 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:48:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-25c02bdf-4b3f-4a74-a66a-4080ca784d0c tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:48:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-524dd44f-2cf7-429d-92a7-3e5c56479544 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.525s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:48:55 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-524dd44f-2cf7-429d-92a7-3e5c56479544 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:48:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1789062685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eee4ce10-e8d8-4606-a8c8-a48276b4b416,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d776d50f4f94679a1e5eaaade3384d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:48:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:48:54Z,use_quota=True,user_id='6a5b5a5aba114bf48088fc7e9f23c301',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:48:55 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-524dd44f-2cf7-429d-92a7-3e5c56479544 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Creating volume eee4ce10-e8d8-4606-a8c8-a48276b4b416 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:48:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-524dd44f-2cf7-429d-92a7-3e5c56479544 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:48:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-524dd44f-2cf7-429d-92a7-3e5c56479544 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:48:55 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-524dd44f-2cf7-429d-92a7-3e5c56479544 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:48:55 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-524dd44f-2cf7-429d-92a7-3e5c56479544 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:48:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-524dd44f-2cf7-429d-92a7-3e5c56479544 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:48:55 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-524dd44f-2cf7-429d-92a7-3e5c56479544 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:48:55 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-524dd44f-2cf7-429d-92a7-3e5c56479544 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:48:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-524dd44f-2cf7-429d-92a7-3e5c56479544 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-eee4ce10-e8d8-4606-a8c8-a48276b4b416 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-25c02bdf-4b3f-4a74-a66a-4080ca784d0c tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a1fc922-5069-4d83-b997-c3e1b5a6bf9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ded39399-c478-4dd1-9409-d7ca639fba02', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-25c02bdf-4b3f-4a74-a66a-4080ca784d0c tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16ed0229-5976-4903-a946-2625e26ae2df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:55 devstack sudo[103181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-eee4ce10-e8d8-4606-a8c8-a48276b4b416 1073741824 Sep 18 21:48:55 devstack sudo[103181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:55 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-25c02bdf-4b3f-4a74-a66a-4080ca784d0c tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Volume volume-ded39399-c478-4dd1-9409-d7ca639fba02 (ded39399-c478-4dd1-9409-d7ca639fba02): created successfully Sep 18 21:48:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-25c02bdf-4b3f-4a74-a66a-4080ca784d0c tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16ed0229-5976-4903-a946-2625e26ae2df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-25c02bdf-4b3f-4a74-a66a-4080ca784d0c tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Flow 'volume_create_manager' (3c2f96e4-5ee7-4b15-959a-a207def6576b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:48:55 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-25c02bdf-4b3f-4a74-a66a-4080ca784d0c tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Created volume successfully. Sep 18 21:48:55 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdbdfbda-455d-4dd3-9a4b-5b6696fd678f tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:48:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-bdbdfbda-455d-4dd3-9a4b-5b6696fd678f tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Flow 'volume_create_manager' (4d6c8c00-3edf-4716-af03-6790ba7ac586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:48:55 devstack sudo[103179]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-bdbdfbda-455d-4dd3-9a4b-5b6696fd678f tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80e1fdbd-bbd4-45dd-bfa6-231146df788d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5035689e-f3f2-4a6b-bca2-79519328a309 tempest-VolumesGetTest-2025585433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3044b7b0-4662-4e88-b7b4-2b3b88434174" returned: 0 in 0.316s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-bdbdfbda-455d-4dd3-9a4b-5b6696fd678f tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80e1fdbd-bbd4-45dd-bfa6-231146df788d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:48:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1559103934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eb40f2a-06eb-4c1d-bcdb-f9192054ded3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d776d50f4f94679a1e5eaaade3384d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:48:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:48:55Z,use_quota=True,user_id='6a5b5a5aba114bf48088fc7e9f23c301',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-bdbdfbda-455d-4dd3-9a4b-5b6696fd678f tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10abc515-32aa-4ebd-bb91-421fa60fcf1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-bdbdfbda-455d-4dd3-9a4b-5b6696fd678f tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10abc515-32aa-4ebd-bb91-421fa60fcf1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-bdbdfbda-455d-4dd3-9a4b-5b6696fd678f tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5ce164a-abdc-4b42-b4ad-c17bca35c3bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-bdbdfbda-455d-4dd3-9a4b-5b6696fd678f tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5ce164a-abdc-4b42-b4ad-c17bca35c3bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9eb40f2a-06eb-4c1d-bcdb-f9192054ded3', 'volume_name': 'volume-9eb40f2a-06eb-4c1d-bcdb-f9192054ded3', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-bdbdfbda-455d-4dd3-9a4b-5b6696fd678f tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d732a22d-5dcf-4d66-bc1a-a68a66483d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-bdbdfbda-455d-4dd3-9a4b-5b6696fd678f tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d732a22d-5dcf-4d66-bc1a-a68a66483d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-bdbdfbda-455d-4dd3-9a4b-5b6696fd678f tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7258b486-d992-4620-a331-bea8cc6bc83f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:55 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-bdbdfbda-455d-4dd3-9a4b-5b6696fd678f tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Volume 9eb40f2a-06eb-4c1d-bcdb-f9192054ded3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9eb40f2a-06eb-4c1d-bcdb-f9192054ded3', 'volume_size': 1} Sep 18 21:48:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-bdbdfbda-455d-4dd3-9a4b-5b6696fd678f tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:48:55 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-5035689e-f3f2-4a6b-bca2-79519328a309 tempest-VolumesGetTest-2025585433 None] Lock "cinder-quobyte-3044b7b0-4662-4e88-b7b4-2b3b88434174" released by "delete_volume" :: held 0.937s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:48:55 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-5035689e-f3f2-4a6b-bca2-79519328a309 tempest-VolumesGetTest-2025585433 None] Created reservations ['3b533f2f-b249-45a4-98e6-2b2f6e24e621', '69d89ddc-a5d4-41e5-966f-ec7fc6083aeb', '75076d78-bacd-4df5-9c6d-c7d220084043', '2326b160-50a9-48ec-b7db-dd6db7d3335c'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:48:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-5035689e-f3f2-4a6b-bca2-79519328a309 tempest-VolumesGetTest-2025585433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:48:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-5035689e-f3f2-4a6b-bca2-79519328a309 tempest-VolumesGetTest-2025585433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:48:55 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-5035689e-f3f2-4a6b-bca2-79519328a309 tempest-VolumesGetTest-2025585433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:48:55 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-5035689e-f3f2-4a6b-bca2-79519328a309 tempest-VolumesGetTest-2025585433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:48:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-5035689e-f3f2-4a6b-bca2-79519328a309 tempest-VolumesGetTest-2025585433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:48:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5035689e-f3f2-4a6b-bca2-79519328a309 tempest-VolumesGetTest-2025585433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:55 devstack sudo[103187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:48:55 devstack sudo[103187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:55 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-867aed58-51ce-426f-8924-00ecac312e14 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:48:55 devstack sudo[103181]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-867aed58-51ce-426f-8924-00ecac312e14 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Flow 'volume_create_manager' (3262b8e2-b913-409d-94df-dd0802b80bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:48:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-867aed58-51ce-426f-8924-00ecac312e14 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89298c9a-fb47-48f2-8437-70c5acdd651d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-524dd44f-2cf7-429d-92a7-3e5c56479544 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-eee4ce10-e8d8-4606-a8c8-a48276b4b416 1073741824" returned: 0 in 0.653s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-867aed58-51ce-426f-8924-00ecac312e14 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89298c9a-fb47-48f2-8437-70c5acdd651d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:48:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1647121375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d162d51-80ec-4630-badd-aed2a2152216,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d776d50f4f94679a1e5eaaade3384d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:48:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:48:56Z,use_quota=True,user_id='6a5b5a5aba114bf48088fc7e9f23c301',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-867aed58-51ce-426f-8924-00ecac312e14 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e46fe70e-8424-456e-a949-3b3014e7fc99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-867aed58-51ce-426f-8924-00ecac312e14 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e46fe70e-8424-456e-a949-3b3014e7fc99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-867aed58-51ce-426f-8924-00ecac312e14 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b4a44e1-77c0-43da-bed2-96b3051e21f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-867aed58-51ce-426f-8924-00ecac312e14 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b4a44e1-77c0-43da-bed2-96b3051e21f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d162d51-80ec-4630-badd-aed2a2152216', 'volume_name': 'volume-0d162d51-80ec-4630-badd-aed2a2152216', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-867aed58-51ce-426f-8924-00ecac312e14 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04c84172-341a-4598-bb4a-36b621c5b8e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-867aed58-51ce-426f-8924-00ecac312e14 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04c84172-341a-4598-bb4a-36b621c5b8e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-867aed58-51ce-426f-8924-00ecac312e14 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf8b6054-69b6-4f2d-969b-a2b4adf87629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:55 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-867aed58-51ce-426f-8924-00ecac312e14 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Volume 0d162d51-80ec-4630-badd-aed2a2152216: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d162d51-80ec-4630-badd-aed2a2152216', 'volume_size': 1} Sep 18 21:48:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-867aed58-51ce-426f-8924-00ecac312e14 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:48:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-524dd44f-2cf7-429d-92a7-3e5c56479544 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-eee4ce10-e8d8-4606-a8c8-a48276b4b416 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:55 devstack sudo[103187]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5035689e-f3f2-4a6b-bca2-79519328a309 tempest-VolumesGetTest-2025585433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.270s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:55 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-5035689e-f3f2-4a6b-bca2-79519328a309 tempest-VolumesGetTest-2025585433 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:48:55 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-5035689e-f3f2-4a6b-bca2-79519328a309 tempest-VolumesGetTest-2025585433 None] Deleted volume successfully. Sep 18 21:48:55 devstack sudo[103191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-eee4ce10-e8d8-4606-a8c8-a48276b4b416 Sep 18 21:48:55 devstack sudo[103191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:55 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-5035689e-f3f2-4a6b-bca2-79519328a309 tempest-VolumesGetTest-2025585433 None] Lock "cinder-3044b7b0-4662-4e88-b7b4-2b3b88434174-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:48:56 devstack sudo[103191]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-524dd44f-2cf7-429d-92a7-3e5c56479544 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-eee4ce10-e8d8-4606-a8c8-a48276b4b416" returned: 0 in 0.252s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:56 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-524dd44f-2cf7-429d-92a7-3e5c56479544 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:48:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-524dd44f-2cf7-429d-92a7-3e5c56479544 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:48:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-64d3ef48-5e08-47ff-8998-0e58fc92efeb tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.086s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:48:56 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-64d3ef48-5e08-47ff-8998-0e58fc92efeb tempest-CreateVolumesFromSourceVolumeTest-628114287 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:48:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-221904886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6391252-41c1-4862-b7b7-99ac70ee2268,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d776d50f4f94679a1e5eaaade3384d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:48:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:48:55Z,use_quota=True,user_id='6a5b5a5aba114bf48088fc7e9f23c301',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:48:56 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-64d3ef48-5e08-47ff-8998-0e58fc92efeb tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Creating volume f6391252-41c1-4862-b7b7-99ac70ee2268 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:48:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-64d3ef48-5e08-47ff-8998-0e58fc92efeb tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:48:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-64d3ef48-5e08-47ff-8998-0e58fc92efeb tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:48:56 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-64d3ef48-5e08-47ff-8998-0e58fc92efeb tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:48:56 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-64d3ef48-5e08-47ff-8998-0e58fc92efeb tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:48:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-64d3ef48-5e08-47ff-8998-0e58fc92efeb tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:48:56 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-64d3ef48-5e08-47ff-8998-0e58fc92efeb tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:48:56 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-64d3ef48-5e08-47ff-8998-0e58fc92efeb tempest-CreateVolumesFromSourceVolumeTest-628114287 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:48:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-64d3ef48-5e08-47ff-8998-0e58fc92efeb tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f6391252-41c1-4862-b7b7-99ac70ee2268 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:56 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-524dd44f-2cf7-429d-92a7-3e5c56479544 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3a8d716-d46f-45f9-a97e-9aa4aaf23a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eee4ce10-e8d8-4606-a8c8-a48276b4b416', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:56 devstack sudo[103194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f6391252-41c1-4862-b7b7-99ac70ee2268 1073741824 Sep 18 21:48:56 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-524dd44f-2cf7-429d-92a7-3e5c56479544 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3331dd94-294f-4a33-81bb-111a72ce9aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:56 devstack sudo[103194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:56 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-524dd44f-2cf7-429d-92a7-3e5c56479544 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Volume volume-eee4ce10-e8d8-4606-a8c8-a48276b4b416 (eee4ce10-e8d8-4606-a8c8-a48276b4b416): created successfully Sep 18 21:48:56 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-524dd44f-2cf7-429d-92a7-3e5c56479544 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3331dd94-294f-4a33-81bb-111a72ce9aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:56 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-524dd44f-2cf7-429d-92a7-3e5c56479544 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Flow 'volume_create_manager' (97be97bd-6f5d-4504-a8d9-6bbf6f6aeacf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:48:56 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-524dd44f-2cf7-429d-92a7-3e5c56479544 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Created volume successfully. Sep 18 21:48:56 devstack sudo[103194]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-64d3ef48-5e08-47ff-8998-0e58fc92efeb tempest-CreateVolumesFromSourceVolumeTest-628114287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f6391252-41c1-4862-b7b7-99ac70ee2268 1073741824" returned: 0 in 0.443s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:56 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-dc8430d7-eee6-4ca5-a559-968110d161cc tempest-VolumesGetTest-2025585433 None] Acquiring lock "cinder-5a3ab1e8-e275-4a10-b289-b68ffad05ec2-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:48:56 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-dc8430d7-eee6-4ca5-a559-968110d161cc tempest-VolumesGetTest-2025585433 None] Lock "cinder-5a3ab1e8-e275-4a10-b289-b68ffad05ec2-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:48:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-64d3ef48-5e08-47ff-8998-0e58fc92efeb tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f6391252-41c1-4862-b7b7-99ac70ee2268 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:56 devstack sudo[103200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f6391252-41c1-4862-b7b7-99ac70ee2268 Sep 18 21:48:56 devstack sudo[103200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:56 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-dc8430d7-eee6-4ca5-a559-968110d161cc tempest-VolumesGetTest-2025585433 None] Acquiring lock "cinder-quobyte-5a3ab1e8-e275-4a10-b289-b68ffad05ec2" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:48:56 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-dc8430d7-eee6-4ca5-a559-968110d161cc tempest-VolumesGetTest-2025585433 None] Lock "cinder-quobyte-5a3ab1e8-e275-4a10-b289-b68ffad05ec2" acquired by "delete_volume" :: waited 0.032s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:48:56 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[8335a347-14fb-41e1-931d-e05860a60c46]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:48:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-dc8430d7-eee6-4ca5-a559-968110d161cc tempest-VolumesGetTest-2025585433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-5a3ab1e8-e275-4a10-b289-b68ffad05ec2 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:56 devstack sudo[103202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-5a3ab1e8-e275-4a10-b289-b68ffad05ec2 Sep 18 21:48:56 devstack sudo[103200]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:56 devstack sudo[103202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-64d3ef48-5e08-47ff-8998-0e58fc92efeb tempest-CreateVolumesFromSourceVolumeTest-628114287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f6391252-41c1-4862-b7b7-99ac70ee2268" returned: 0 in 0.275s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:56 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-64d3ef48-5e08-47ff-8998-0e58fc92efeb tempest-CreateVolumesFromSourceVolumeTest-628114287 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:48:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-64d3ef48-5e08-47ff-8998-0e58fc92efeb tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:48:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-bdbdfbda-455d-4dd3-9a4b-5b6696fd678f tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.506s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:48:56 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-bdbdfbda-455d-4dd3-9a4b-5b6696fd678f tempest-CreateVolumesFromSourceVolumeTest-628114287 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:48:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1559103934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eb40f2a-06eb-4c1d-bcdb-f9192054ded3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d776d50f4f94679a1e5eaaade3384d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:48:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:48:55Z,use_quota=True,user_id='6a5b5a5aba114bf48088fc7e9f23c301',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:48:56 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-bdbdfbda-455d-4dd3-9a4b-5b6696fd678f tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Creating volume 9eb40f2a-06eb-4c1d-bcdb-f9192054ded3 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:48:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-bdbdfbda-455d-4dd3-9a4b-5b6696fd678f tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:48:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-bdbdfbda-455d-4dd3-9a4b-5b6696fd678f tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:48:56 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-bdbdfbda-455d-4dd3-9a4b-5b6696fd678f tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:48:56 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-bdbdfbda-455d-4dd3-9a4b-5b6696fd678f tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:48:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-bdbdfbda-455d-4dd3-9a4b-5b6696fd678f tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:48:56 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-bdbdfbda-455d-4dd3-9a4b-5b6696fd678f tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:48:56 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-bdbdfbda-455d-4dd3-9a4b-5b6696fd678f tempest-CreateVolumesFromSourceVolumeTest-628114287 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:48:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-bdbdfbda-455d-4dd3-9a4b-5b6696fd678f tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9eb40f2a-06eb-4c1d-bcdb-f9192054ded3 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:56 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-64d3ef48-5e08-47ff-8998-0e58fc92efeb tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (194c8aba-e3d0-4e77-9b0d-50f597de81e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6391252-41c1-4862-b7b7-99ac70ee2268', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:56 devstack sudo[103205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9eb40f2a-06eb-4c1d-bcdb-f9192054ded3 1073741824 Sep 18 21:48:56 devstack sudo[103205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:56 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-64d3ef48-5e08-47ff-8998-0e58fc92efeb tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee0a1777-f5b4-4a6d-ae58-3df5ca7c842f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:57 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-64d3ef48-5e08-47ff-8998-0e58fc92efeb tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Volume volume-f6391252-41c1-4862-b7b7-99ac70ee2268 (f6391252-41c1-4862-b7b7-99ac70ee2268): created successfully Sep 18 21:48:57 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-64d3ef48-5e08-47ff-8998-0e58fc92efeb tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee0a1777-f5b4-4a6d-ae58-3df5ca7c842f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:57 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-64d3ef48-5e08-47ff-8998-0e58fc92efeb tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Flow 'volume_create_manager' (0ad6a026-c3ea-4713-a66b-463543b92cd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:48:57 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-64d3ef48-5e08-47ff-8998-0e58fc92efeb tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Created volume successfully. Sep 18 21:48:57 devstack sudo[103202]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-dc8430d7-eee6-4ca5-a559-968110d161cc tempest-VolumesGetTest-2025585433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-5a3ab1e8-e275-4a10-b289-b68ffad05ec2" returned: 0 in 0.413s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-dc8430d7-eee6-4ca5-a559-968110d161cc tempest-VolumesGetTest-2025585433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-5a3ab1e8-e275-4a10-b289-b68ffad05ec2 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:57 devstack sudo[103213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-5a3ab1e8-e275-4a10-b289-b68ffad05ec2 Sep 18 21:48:57 devstack sudo[103213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:57 devstack sudo[103205]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-bdbdfbda-455d-4dd3-9a4b-5b6696fd678f tempest-CreateVolumesFromSourceVolumeTest-628114287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9eb40f2a-06eb-4c1d-bcdb-f9192054ded3 1073741824" returned: 0 in 0.431s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-bdbdfbda-455d-4dd3-9a4b-5b6696fd678f tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9eb40f2a-06eb-4c1d-bcdb-f9192054ded3 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:57 devstack sudo[103213]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-dc8430d7-eee6-4ca5-a559-968110d161cc tempest-VolumesGetTest-2025585433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-5a3ab1e8-e275-4a10-b289-b68ffad05ec2" returned: 0 in 0.244s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:57 devstack sudo[103217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9eb40f2a-06eb-4c1d-bcdb-f9192054ded3 Sep 18 21:48:57 devstack sudo[103217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:57 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-dc8430d7-eee6-4ca5-a559-968110d161cc tempest-VolumesGetTest-2025585433 None] Lock "cinder-quobyte-5a3ab1e8-e275-4a10-b289-b68ffad05ec2" released by "delete_volume" :: held 0.719s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:48:57 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-dc8430d7-eee6-4ca5-a559-968110d161cc tempest-VolumesGetTest-2025585433 None] Created reservations ['454649a1-11ff-49a6-b4b0-dc70991218b0', 'bf293dfa-864a-4b58-9355-a9afe6d2c82b', '0db4b115-9354-484f-89c2-7ffa7a125cb4', '8b478b17-eb51-4aa7-b343-6e680f072837'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:48:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-dc8430d7-eee6-4ca5-a559-968110d161cc tempest-VolumesGetTest-2025585433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:48:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-dc8430d7-eee6-4ca5-a559-968110d161cc tempest-VolumesGetTest-2025585433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:48:57 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-dc8430d7-eee6-4ca5-a559-968110d161cc tempest-VolumesGetTest-2025585433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:48:57 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-dc8430d7-eee6-4ca5-a559-968110d161cc tempest-VolumesGetTest-2025585433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:48:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-dc8430d7-eee6-4ca5-a559-968110d161cc tempest-VolumesGetTest-2025585433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:48:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-dc8430d7-eee6-4ca5-a559-968110d161cc tempest-VolumesGetTest-2025585433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:57 devstack sudo[103219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:48:57 devstack sudo[103219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:57 devstack sudo[103217]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-bdbdfbda-455d-4dd3-9a4b-5b6696fd678f tempest-CreateVolumesFromSourceVolumeTest-628114287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9eb40f2a-06eb-4c1d-bcdb-f9192054ded3" returned: 0 in 0.272s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:57 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-bdbdfbda-455d-4dd3-9a4b-5b6696fd678f tempest-CreateVolumesFromSourceVolumeTest-628114287 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:48:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-bdbdfbda-455d-4dd3-9a4b-5b6696fd678f tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:48:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-867aed58-51ce-426f-8924-00ecac312e14 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.864s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:48:57 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-867aed58-51ce-426f-8924-00ecac312e14 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:48:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1647121375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d162d51-80ec-4630-badd-aed2a2152216,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d776d50f4f94679a1e5eaaade3384d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:48:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:48:56Z,use_quota=True,user_id='6a5b5a5aba114bf48088fc7e9f23c301',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:48:57 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-867aed58-51ce-426f-8924-00ecac312e14 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Creating volume 0d162d51-80ec-4630-badd-aed2a2152216 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:48:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-867aed58-51ce-426f-8924-00ecac312e14 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:48:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-867aed58-51ce-426f-8924-00ecac312e14 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:48:57 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-867aed58-51ce-426f-8924-00ecac312e14 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:48:57 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-867aed58-51ce-426f-8924-00ecac312e14 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:48:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-867aed58-51ce-426f-8924-00ecac312e14 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:48:57 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-867aed58-51ce-426f-8924-00ecac312e14 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:48:57 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-867aed58-51ce-426f-8924-00ecac312e14 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:48:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-867aed58-51ce-426f-8924-00ecac312e14 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-0d162d51-80ec-4630-badd-aed2a2152216 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:57 devstack sudo[103222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-0d162d51-80ec-4630-badd-aed2a2152216 1073741824 Sep 18 21:48:57 devstack sudo[103222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:57 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-bdbdfbda-455d-4dd3-9a4b-5b6696fd678f tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7258b486-d992-4620-a331-bea8cc6bc83f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9eb40f2a-06eb-4c1d-bcdb-f9192054ded3', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:57 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-bdbdfbda-455d-4dd3-9a4b-5b6696fd678f tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1774b19b-4440-4bb7-b7df-abaea4108fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:57 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-bdbdfbda-455d-4dd3-9a4b-5b6696fd678f tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Volume volume-9eb40f2a-06eb-4c1d-bcdb-f9192054ded3 (9eb40f2a-06eb-4c1d-bcdb-f9192054ded3): created successfully Sep 18 21:48:57 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-bdbdfbda-455d-4dd3-9a4b-5b6696fd678f tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1774b19b-4440-4bb7-b7df-abaea4108fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:57 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-bdbdfbda-455d-4dd3-9a4b-5b6696fd678f tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Flow 'volume_create_manager' (4d6c8c00-3edf-4716-af03-6790ba7ac586) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:48:57 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-bdbdfbda-455d-4dd3-9a4b-5b6696fd678f tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Created volume successfully. Sep 18 21:48:57 devstack sudo[103219]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-dc8430d7-eee6-4ca5-a559-968110d161cc tempest-VolumesGetTest-2025585433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.298s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:57 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-dc8430d7-eee6-4ca5-a559-968110d161cc tempest-VolumesGetTest-2025585433 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:48:57 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-dc8430d7-eee6-4ca5-a559-968110d161cc tempest-VolumesGetTest-2025585433 None] Deleted volume successfully. Sep 18 21:48:57 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-dc8430d7-eee6-4ca5-a559-968110d161cc tempest-VolumesGetTest-2025585433 None] Lock "cinder-5a3ab1e8-e275-4a10-b289-b68ffad05ec2-delete_volume" released by "delete_volume" :: held 1.297s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:48:58 devstack sudo[103222]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-867aed58-51ce-426f-8924-00ecac312e14 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-0d162d51-80ec-4630-badd-aed2a2152216 1073741824" returned: 0 in 0.528s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-867aed58-51ce-426f-8924-00ecac312e14 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-0d162d51-80ec-4630-badd-aed2a2152216 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:58 devstack sudo[103229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-0d162d51-80ec-4630-badd-aed2a2152216 Sep 18 21:48:58 devstack sudo[103229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:58 devstack sudo[103229]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-867aed58-51ce-426f-8924-00ecac312e14 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-0d162d51-80ec-4630-badd-aed2a2152216" returned: 0 in 0.264s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:58 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-867aed58-51ce-426f-8924-00ecac312e14 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] <== create_volume: return (836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:48:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-867aed58-51ce-426f-8924-00ecac312e14 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:48:58 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-867aed58-51ce-426f-8924-00ecac312e14 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf8b6054-69b6-4f2d-969b-a2b4adf87629) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d162d51-80ec-4630-badd-aed2a2152216', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:58 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-867aed58-51ce-426f-8924-00ecac312e14 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (530c4ec3-aef9-474f-9c3d-6997c9fb9774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:48:58 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-867aed58-51ce-426f-8924-00ecac312e14 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Volume volume-0d162d51-80ec-4630-badd-aed2a2152216 (0d162d51-80ec-4630-badd-aed2a2152216): created successfully Sep 18 21:48:58 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-867aed58-51ce-426f-8924-00ecac312e14 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (530c4ec3-aef9-474f-9c3d-6997c9fb9774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:48:58 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-867aed58-51ce-426f-8924-00ecac312e14 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Flow 'volume_create_manager' (3262b8e2-b913-409d-94df-dd0802b80bc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:48:58 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-867aed58-51ce-426f-8924-00ecac312e14 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Created volume successfully. Sep 18 21:48:59 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-e6fbe9e1-338f-4774-997a-3550aaecea34 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Acquiring lock "cinder-0d162d51-80ec-4630-badd-aed2a2152216-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:48:59 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-e6fbe9e1-338f-4774-997a-3550aaecea34 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Lock "cinder-0d162d51-80ec-4630-badd-aed2a2152216-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:48:59 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-e6fbe9e1-338f-4774-997a-3550aaecea34 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Acquiring lock "cinder-quobyte-0d162d51-80ec-4630-badd-aed2a2152216" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:48:59 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-e6fbe9e1-338f-4774-997a-3550aaecea34 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Lock "cinder-quobyte-0d162d51-80ec-4630-badd-aed2a2152216" acquired by "delete_volume" :: waited 0.016s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:48:59 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[b74fc2e5-381b-4aee-882d-bad5c711fe23]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:48:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e6fbe9e1-338f-4774-997a-3550aaecea34 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-0d162d51-80ec-4630-badd-aed2a2152216 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:59 devstack sudo[103232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-0d162d51-80ec-4630-badd-aed2a2152216 Sep 18 21:48:59 devstack sudo[103232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:59 devstack sudo[103232]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e6fbe9e1-338f-4774-997a-3550aaecea34 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-0d162d51-80ec-4630-badd-aed2a2152216" returned: 0 in 0.386s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e6fbe9e1-338f-4774-997a-3550aaecea34 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-0d162d51-80ec-4630-badd-aed2a2152216 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:48:59 devstack sudo[103237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-0d162d51-80ec-4630-badd-aed2a2152216 Sep 18 21:48:59 devstack sudo[103237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:48:59 devstack sudo[103237]: pam_unix(sudo:session): session closed for user root Sep 18 21:48:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e6fbe9e1-338f-4774-997a-3550aaecea34 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-0d162d51-80ec-4630-badd-aed2a2152216" returned: 0 in 0.257s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:48:59 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-e6fbe9e1-338f-4774-997a-3550aaecea34 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Lock "cinder-quobyte-0d162d51-80ec-4630-badd-aed2a2152216" released by "delete_volume" :: held 0.694s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:49:00 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-e6fbe9e1-338f-4774-997a-3550aaecea34 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Created reservations ['f923439b-11b0-429d-a9fd-62f8612f7ae2', 'b9a6381e-4281-48ca-8a26-509cd1e2e7d8', 'df43bc68-255f-490f-b225-66cb51f5ea5d', 'd98fd88e-5a12-485e-aaf4-3059f21861bc'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:49:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-e6fbe9e1-338f-4774-997a-3550aaecea34 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:49:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-e6fbe9e1-338f-4774-997a-3550aaecea34 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:49:00 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-e6fbe9e1-338f-4774-997a-3550aaecea34 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:49:00 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-e6fbe9e1-338f-4774-997a-3550aaecea34 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:49:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-e6fbe9e1-338f-4774-997a-3550aaecea34 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:49:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e6fbe9e1-338f-4774-997a-3550aaecea34 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:00 devstack sudo[103240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:49:00 devstack sudo[103240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:00 devstack sudo[103240]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e6fbe9e1-338f-4774-997a-3550aaecea34 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.260s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:00 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-e6fbe9e1-338f-4774-997a-3550aaecea34 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:49:00 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-158a6f2b-08d9-42d2-8299-d6657e0ce074 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Acquiring lock "cinder-9eb40f2a-06eb-4c1d-bcdb-f9192054ded3-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:49:00 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-e6fbe9e1-338f-4774-997a-3550aaecea34 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Deleted volume successfully. Sep 18 21:49:00 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-158a6f2b-08d9-42d2-8299-d6657e0ce074 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Lock "cinder-9eb40f2a-06eb-4c1d-bcdb-f9192054ded3-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:49:00 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-e6fbe9e1-338f-4774-997a-3550aaecea34 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Lock "cinder-0d162d51-80ec-4630-badd-aed2a2152216-delete_volume" released by "delete_volume" :: held 1.214s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:49:00 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-158a6f2b-08d9-42d2-8299-d6657e0ce074 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Acquiring lock "cinder-quobyte-9eb40f2a-06eb-4c1d-bcdb-f9192054ded3" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:49:00 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-158a6f2b-08d9-42d2-8299-d6657e0ce074 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Lock "cinder-quobyte-9eb40f2a-06eb-4c1d-bcdb-f9192054ded3" acquired by "delete_volume" :: waited 0.019s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:49:00 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc6f8a4-ef87-4c6f-9abd-97d7f2259f89]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:49:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-158a6f2b-08d9-42d2-8299-d6657e0ce074 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9eb40f2a-06eb-4c1d-bcdb-f9192054ded3 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:00 devstack sudo[103243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9eb40f2a-06eb-4c1d-bcdb-f9192054ded3 Sep 18 21:49:00 devstack sudo[103243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:00 devstack sudo[103243]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-158a6f2b-08d9-42d2-8299-d6657e0ce074 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9eb40f2a-06eb-4c1d-bcdb-f9192054ded3" returned: 0 in 0.392s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-158a6f2b-08d9-42d2-8299-d6657e0ce074 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9eb40f2a-06eb-4c1d-bcdb-f9192054ded3 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:00 devstack sudo[103249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9eb40f2a-06eb-4c1d-bcdb-f9192054ded3 Sep 18 21:49:00 devstack sudo[103249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:01 devstack sudo[103249]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-158a6f2b-08d9-42d2-8299-d6657e0ce074 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9eb40f2a-06eb-4c1d-bcdb-f9192054ded3" returned: 0 in 0.269s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:01 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-158a6f2b-08d9-42d2-8299-d6657e0ce074 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Lock "cinder-quobyte-9eb40f2a-06eb-4c1d-bcdb-f9192054ded3" released by "delete_volume" :: held 0.706s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:49:01 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-158a6f2b-08d9-42d2-8299-d6657e0ce074 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Created reservations ['aaa45260-a394-42b0-bf67-13042f98dbd7', '4a885185-1987-4012-9f4d-0685d3375c06', 'c00369d6-f6b7-47c7-a4b4-80edd54aab32', '7ecd859a-4eb8-4757-83e4-10deae82043c'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:49:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-158a6f2b-08d9-42d2-8299-d6657e0ce074 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:49:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-158a6f2b-08d9-42d2-8299-d6657e0ce074 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:49:01 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-158a6f2b-08d9-42d2-8299-d6657e0ce074 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:49:01 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-158a6f2b-08d9-42d2-8299-d6657e0ce074 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:49:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-158a6f2b-08d9-42d2-8299-d6657e0ce074 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:49:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-158a6f2b-08d9-42d2-8299-d6657e0ce074 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:01 devstack sudo[103252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:49:01 devstack sudo[103252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:01 devstack sudo[103252]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-158a6f2b-08d9-42d2-8299-d6657e0ce074 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.260s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:01 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-6361ef9f-0917-457d-bc8c-79e242b15c8b tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Acquiring lock "cinder-f6391252-41c1-4862-b7b7-99ac70ee2268-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:49:01 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-158a6f2b-08d9-42d2-8299-d6657e0ce074 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:49:01 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-158a6f2b-08d9-42d2-8299-d6657e0ce074 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Deleted volume successfully. Sep 18 21:49:01 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-6361ef9f-0917-457d-bc8c-79e242b15c8b tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Lock "cinder-f6391252-41c1-4862-b7b7-99ac70ee2268-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:49:01 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-158a6f2b-08d9-42d2-8299-d6657e0ce074 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Lock "cinder-9eb40f2a-06eb-4c1d-bcdb-f9192054ded3-delete_volume" released by "delete_volume" :: held 1.242s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:49:01 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-6361ef9f-0917-457d-bc8c-79e242b15c8b tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Acquiring lock "cinder-quobyte-f6391252-41c1-4862-b7b7-99ac70ee2268" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:49:01 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-6361ef9f-0917-457d-bc8c-79e242b15c8b tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Lock "cinder-quobyte-f6391252-41c1-4862-b7b7-99ac70ee2268" acquired by "delete_volume" :: waited 0.017s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:49:01 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[e93c2d1a-b100-4b00-ab2d-7968a8676b50]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:49:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6361ef9f-0917-457d-bc8c-79e242b15c8b tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f6391252-41c1-4862-b7b7-99ac70ee2268 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:01 devstack sudo[103255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f6391252-41c1-4862-b7b7-99ac70ee2268 Sep 18 21:49:01 devstack sudo[103255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:02 devstack sudo[103255]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:02 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6361ef9f-0917-457d-bc8c-79e242b15c8b tempest-CreateVolumesFromSourceVolumeTest-628114287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f6391252-41c1-4862-b7b7-99ac70ee2268" returned: 0 in 0.443s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:02 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6361ef9f-0917-457d-bc8c-79e242b15c8b tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f6391252-41c1-4862-b7b7-99ac70ee2268 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:02 devstack sudo[103260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f6391252-41c1-4862-b7b7-99ac70ee2268 Sep 18 21:49:02 devstack sudo[103260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:02 devstack sudo[103260]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:02 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6361ef9f-0917-457d-bc8c-79e242b15c8b tempest-CreateVolumesFromSourceVolumeTest-628114287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f6391252-41c1-4862-b7b7-99ac70ee2268" returned: 0 in 0.259s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:02 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-6361ef9f-0917-457d-bc8c-79e242b15c8b tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Lock "cinder-quobyte-f6391252-41c1-4862-b7b7-99ac70ee2268" released by "delete_volume" :: held 0.748s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:49:02 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-6361ef9f-0917-457d-bc8c-79e242b15c8b tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Created reservations ['380e7f54-b9c8-4669-8760-e773742865c9', '50f5de89-95f1-4c6f-9aa0-fd9e091daa13', '496e4e49-90bf-4760-9e1d-dca1f0fab5fd', 'ba1c4985-aa09-497e-9b79-c3ed4eec55b0'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:49:02 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6361ef9f-0917-457d-bc8c-79e242b15c8b tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:49:02 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6361ef9f-0917-457d-bc8c-79e242b15c8b tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:49:02 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-6361ef9f-0917-457d-bc8c-79e242b15c8b tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:49:02 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-6361ef9f-0917-457d-bc8c-79e242b15c8b tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:49:02 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6361ef9f-0917-457d-bc8c-79e242b15c8b tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:49:02 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6361ef9f-0917-457d-bc8c-79e242b15c8b tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:02 devstack sudo[103263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:49:02 devstack sudo[103263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:02 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-7753cd1b-b74d-4b9f-b60a-4346f892ef16 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Acquiring lock "cinder-eee4ce10-e8d8-4606-a8c8-a48276b4b416-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:49:02 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-7753cd1b-b74d-4b9f-b60a-4346f892ef16 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Lock "cinder-eee4ce10-e8d8-4606-a8c8-a48276b4b416-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:49:02 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-7753cd1b-b74d-4b9f-b60a-4346f892ef16 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Acquiring lock "cinder-quobyte-eee4ce10-e8d8-4606-a8c8-a48276b4b416" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:49:02 devstack sudo[103263]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:02 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6361ef9f-0917-457d-bc8c-79e242b15c8b tempest-CreateVolumesFromSourceVolumeTest-628114287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.309s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:02 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-6361ef9f-0917-457d-bc8c-79e242b15c8b tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:49:02 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-7753cd1b-b74d-4b9f-b60a-4346f892ef16 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Lock "cinder-quobyte-eee4ce10-e8d8-4606-a8c8-a48276b4b416" acquired by "delete_volume" :: waited 0.019s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:49:02 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-6361ef9f-0917-457d-bc8c-79e242b15c8b tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Deleted volume successfully. Sep 18 21:49:02 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-6361ef9f-0917-457d-bc8c-79e242b15c8b tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Lock "cinder-f6391252-41c1-4862-b7b7-99ac70ee2268-delete_volume" released by "delete_volume" :: held 1.300s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:49:02 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2098d64-cdbe-4faa-b519-8b23a61eb105]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:49:02 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-7753cd1b-b74d-4b9f-b60a-4346f892ef16 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-eee4ce10-e8d8-4606-a8c8-a48276b4b416 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:03 devstack sudo[103266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-eee4ce10-e8d8-4606-a8c8-a48276b4b416 Sep 18 21:49:03 devstack sudo[103266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:03 devstack sudo[103266]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-7753cd1b-b74d-4b9f-b60a-4346f892ef16 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-eee4ce10-e8d8-4606-a8c8-a48276b4b416" returned: 0 in 0.378s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-7753cd1b-b74d-4b9f-b60a-4346f892ef16 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-eee4ce10-e8d8-4606-a8c8-a48276b4b416 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:03 devstack sudo[103271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-eee4ce10-e8d8-4606-a8c8-a48276b4b416 Sep 18 21:49:03 devstack sudo[103271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:03 devstack sudo[103271]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-7753cd1b-b74d-4b9f-b60a-4346f892ef16 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-eee4ce10-e8d8-4606-a8c8-a48276b4b416" returned: 0 in 0.280s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:03 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-7753cd1b-b74d-4b9f-b60a-4346f892ef16 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Lock "cinder-quobyte-eee4ce10-e8d8-4606-a8c8-a48276b4b416" released by "delete_volume" :: held 0.722s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:49:03 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-7753cd1b-b74d-4b9f-b60a-4346f892ef16 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Created reservations ['c3b67f5f-35a0-4477-83f6-0d6737fcf83d', '1bc92ba3-36ef-44ea-947d-fcc1661552a5', '465364b1-52b4-4901-8bff-f59608b84520', '55e9ed50-d147-4ce8-aaab-3ee4bf194ff5'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:49:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-7753cd1b-b74d-4b9f-b60a-4346f892ef16 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:49:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-7753cd1b-b74d-4b9f-b60a-4346f892ef16 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:49:03 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-7753cd1b-b74d-4b9f-b60a-4346f892ef16 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:49:03 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-7753cd1b-b74d-4b9f-b60a-4346f892ef16 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:49:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-7753cd1b-b74d-4b9f-b60a-4346f892ef16 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:49:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-7753cd1b-b74d-4b9f-b60a-4346f892ef16 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:03 devstack sudo[103274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:49:03 devstack sudo[103274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:03 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-45ff7fc9-25bd-45c9-9686-0c219f5f45e5 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Acquiring lock "cinder-ded39399-c478-4dd1-9409-d7ca639fba02-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:49:04 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-45ff7fc9-25bd-45c9-9686-0c219f5f45e5 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Lock "cinder-ded39399-c478-4dd1-9409-d7ca639fba02-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:49:04 devstack sudo[103274]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-7753cd1b-b74d-4b9f-b60a-4346f892ef16 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.291s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:04 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-7753cd1b-b74d-4b9f-b60a-4346f892ef16 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:49:04 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-7753cd1b-b74d-4b9f-b60a-4346f892ef16 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Deleted volume successfully. Sep 18 21:49:04 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-45ff7fc9-25bd-45c9-9686-0c219f5f45e5 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Acquiring lock "cinder-quobyte-ded39399-c478-4dd1-9409-d7ca639fba02" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:49:04 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-7753cd1b-b74d-4b9f-b60a-4346f892ef16 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Lock "cinder-eee4ce10-e8d8-4606-a8c8-a48276b4b416-delete_volume" released by "delete_volume" :: held 1.275s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:49:04 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-45ff7fc9-25bd-45c9-9686-0c219f5f45e5 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Lock "cinder-quobyte-ded39399-c478-4dd1-9409-d7ca639fba02" acquired by "delete_volume" :: waited 0.025s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:49:04 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7a1987-318e-47fe-9d7f-8606e04f0ea4]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:49:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-45ff7fc9-25bd-45c9-9686-0c219f5f45e5 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ded39399-c478-4dd1-9409-d7ca639fba02 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:04 devstack sudo[103277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ded39399-c478-4dd1-9409-d7ca639fba02 Sep 18 21:49:04 devstack sudo[103277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:04 devstack sudo[103277]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-45ff7fc9-25bd-45c9-9686-0c219f5f45e5 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ded39399-c478-4dd1-9409-d7ca639fba02" returned: 0 in 0.420s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-45ff7fc9-25bd-45c9-9686-0c219f5f45e5 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ded39399-c478-4dd1-9409-d7ca639fba02 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:04 devstack sudo[103282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ded39399-c478-4dd1-9409-d7ca639fba02 Sep 18 21:49:04 devstack sudo[103282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:04 devstack sudo[103282]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-45ff7fc9-25bd-45c9-9686-0c219f5f45e5 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ded39399-c478-4dd1-9409-d7ca639fba02" returned: 0 in 0.293s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:04 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-45ff7fc9-25bd-45c9-9686-0c219f5f45e5 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Lock "cinder-quobyte-ded39399-c478-4dd1-9409-d7ca639fba02" released by "delete_volume" :: held 0.774s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:49:04 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-45ff7fc9-25bd-45c9-9686-0c219f5f45e5 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Created reservations ['3b8a6569-5111-4dd4-b504-7ef865b55aa4', '0a4cef4b-3ce1-4b00-b992-ffdc0d77f650', 'f958649c-6f21-4ad9-be90-14f49d739cf9', '9d52bea8-7c4f-4371-b06a-5883e8028d76'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:49:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-45ff7fc9-25bd-45c9-9686-0c219f5f45e5 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:49:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-45ff7fc9-25bd-45c9-9686-0c219f5f45e5 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:49:04 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-45ff7fc9-25bd-45c9-9686-0c219f5f45e5 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:49:04 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-45ff7fc9-25bd-45c9-9686-0c219f5f45e5 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:49:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-45ff7fc9-25bd-45c9-9686-0c219f5f45e5 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:49:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-45ff7fc9-25bd-45c9-9686-0c219f5f45e5 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:05 devstack sudo[103285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:49:05 devstack sudo[103285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:05 devstack cinder-volume[86136]: DEBUG oslo_service.periodic_task [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86136) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 21:49:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:49:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:49:05 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:49:05 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:49:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:49:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:05 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-a682b90c-c372-414e-b0c4-a8cc7ddc638c tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Acquiring lock "cinder-54810e41-a8e7-4f07-8d4f-5f4ffad7d39e-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:49:05 devstack sudo[103287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:49:05 devstack sudo[103287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:05 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-a682b90c-c372-414e-b0c4-a8cc7ddc638c tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Lock "cinder-54810e41-a8e7-4f07-8d4f-5f4ffad7d39e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:49:05 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-a682b90c-c372-414e-b0c4-a8cc7ddc638c tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Acquiring lock "cinder-quobyte-54810e41-a8e7-4f07-8d4f-5f4ffad7d39e" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:49:05 devstack sudo[103285]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-45ff7fc9-25bd-45c9-9686-0c219f5f45e5 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.321s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:05 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-45ff7fc9-25bd-45c9-9686-0c219f5f45e5 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:49:05 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-45ff7fc9-25bd-45c9-9686-0c219f5f45e5 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Deleted volume successfully. Sep 18 21:49:05 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-a682b90c-c372-414e-b0c4-a8cc7ddc638c tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Lock "cinder-quobyte-54810e41-a8e7-4f07-8d4f-5f4ffad7d39e" acquired by "delete_volume" :: waited 0.030s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:49:05 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9c1b81-c5da-47f6-97b3-7fa984f7d584]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:49:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-a682b90c-c372-414e-b0c4-a8cc7ddc638c tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-54810e41-a8e7-4f07-8d4f-5f4ffad7d39e {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:05 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-45ff7fc9-25bd-45c9-9686-0c219f5f45e5 tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Lock "cinder-ded39399-c478-4dd1-9409-d7ca639fba02-delete_volume" released by "delete_volume" :: held 1.369s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:49:05 devstack sudo[103290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-54810e41-a8e7-4f07-8d4f-5f4ffad7d39e Sep 18 21:49:05 devstack sudo[103290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:05 devstack sudo[103287]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.337s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:05 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:49:05 devstack cinder-volume[86136]: DEBUG oslo_service.periodic_task [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Running periodic task VolumeManager._thread_info {{(pid=86136) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 21:49:05 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] thread count: 28 {{(pid=86136) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 18 21:49:05 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] thread info: [<_MainThread(MainThread, started 138548347871360)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86136) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 18 21:49:05 devstack sudo[103290]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-a682b90c-c372-414e-b0c4-a8cc7ddc638c tempest-CreateVolumesFromSourceVolumeTest-628114287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-54810e41-a8e7-4f07-8d4f-5f4ffad7d39e" returned: 0 in 0.397s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-a682b90c-c372-414e-b0c4-a8cc7ddc638c tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-54810e41-a8e7-4f07-8d4f-5f4ffad7d39e {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:05 devstack sudo[103296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-54810e41-a8e7-4f07-8d4f-5f4ffad7d39e Sep 18 21:49:05 devstack sudo[103296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:06 devstack sudo[103296]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:06 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-a682b90c-c372-414e-b0c4-a8cc7ddc638c tempest-CreateVolumesFromSourceVolumeTest-628114287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-54810e41-a8e7-4f07-8d4f-5f4ffad7d39e" returned: 0 in 0.255s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:06 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-a682b90c-c372-414e-b0c4-a8cc7ddc638c tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Lock "cinder-quobyte-54810e41-a8e7-4f07-8d4f-5f4ffad7d39e" released by "delete_volume" :: held 0.707s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:49:06 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-a682b90c-c372-414e-b0c4-a8cc7ddc638c tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Created reservations ['b6caa6e9-5676-44c3-afb4-fd2378f34c2a', 'c6ec183f-0e51-40cb-be50-241175be6ba4', '6b4cf691-2648-4ce2-9566-b5d391c15729', '22947a93-76cf-47ab-a488-f8eb3b875c11'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:49:06 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-a682b90c-c372-414e-b0c4-a8cc7ddc638c tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:49:06 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-a682b90c-c372-414e-b0c4-a8cc7ddc638c tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:49:06 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-a682b90c-c372-414e-b0c4-a8cc7ddc638c tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:49:06 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-a682b90c-c372-414e-b0c4-a8cc7ddc638c tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:49:06 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-a682b90c-c372-414e-b0c4-a8cc7ddc638c tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:49:06 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-a682b90c-c372-414e-b0c4-a8cc7ddc638c tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:06 devstack sudo[103299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:49:06 devstack sudo[103299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:06 devstack sudo[103299]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:06 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-a682b90c-c372-414e-b0c4-a8cc7ddc638c tempest-CreateVolumesFromSourceVolumeTest-628114287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.280s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:06 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-a682b90c-c372-414e-b0c4-a8cc7ddc638c tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:49:06 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-a682b90c-c372-414e-b0c4-a8cc7ddc638c tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Deleted volume successfully. Sep 18 21:49:06 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-a682b90c-c372-414e-b0c4-a8cc7ddc638c tempest-CreateVolumesFromSourceVolumeTest-628114287 None] Lock "cinder-54810e41-a8e7-4f07-8d4f-5f4ffad7d39e-delete_volume" released by "delete_volume" :: held 1.230s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:49:09 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-34e069e7-ccf9-46f5-9453-3606fa8f8b46 tempest-VolumeDependencyTests-1698754972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:49:09 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-34e069e7-ccf9-46f5-9453-3606fa8f8b46 tempest-VolumeDependencyTests-1698754972 None] Flow 'volume_create_manager' (e6c746bf-75cb-4070-a8f1-935e5a0f2cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:49:09 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-34e069e7-ccf9-46f5-9453-3606fa8f8b46 tempest-VolumeDependencyTests-1698754972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e852c699-1a25-404c-af30-66de673dd06d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:49:09 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-34e069e7-ccf9-46f5-9453-3606fa8f8b46 tempest-VolumeDependencyTests-1698754972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e852c699-1a25-404c-af30-66de673dd06d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:49:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1914940214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61458ac1-3269-4c21-9711-13760f85394a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5167fbe6027547c4abab11eeb1738724',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:49:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:49:09Z,use_quota=True,user_id='937bf4b7058c4ea4a1ec706a709ea234',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:49:09 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-34e069e7-ccf9-46f5-9453-3606fa8f8b46 tempest-VolumeDependencyTests-1698754972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc329606-64ff-4cc0-b77d-865f3743c120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:49:09 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-34e069e7-ccf9-46f5-9453-3606fa8f8b46 tempest-VolumeDependencyTests-1698754972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc329606-64ff-4cc0-b77d-865f3743c120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:49:09 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-34e069e7-ccf9-46f5-9453-3606fa8f8b46 tempest-VolumeDependencyTests-1698754972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc3be785-0251-4579-8301-826feb6a1e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:49:09 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-34e069e7-ccf9-46f5-9453-3606fa8f8b46 tempest-VolumeDependencyTests-1698754972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc3be785-0251-4579-8301-826feb6a1e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61458ac1-3269-4c21-9711-13760f85394a', 'volume_name': 'volume-61458ac1-3269-4c21-9711-13760f85394a', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:49:09 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-34e069e7-ccf9-46f5-9453-3606fa8f8b46 tempest-VolumeDependencyTests-1698754972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc5a8b7c-e8e8-4344-8f69-20b6bfc7390f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:49:09 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-34e069e7-ccf9-46f5-9453-3606fa8f8b46 tempest-VolumeDependencyTests-1698754972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc5a8b7c-e8e8-4344-8f69-20b6bfc7390f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:49:09 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-34e069e7-ccf9-46f5-9453-3606fa8f8b46 tempest-VolumeDependencyTests-1698754972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1dece1c-f1c6-43f2-a616-4f0eb32fe308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:49:09 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-34e069e7-ccf9-46f5-9453-3606fa8f8b46 tempest-VolumeDependencyTests-1698754972 None] Volume 61458ac1-3269-4c21-9711-13760f85394a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61458ac1-3269-4c21-9711-13760f85394a', 'volume_size': 1} Sep 18 21:49:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-34e069e7-ccf9-46f5-9453-3606fa8f8b46 tempest-VolumeDependencyTests-1698754972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:49:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-34e069e7-ccf9-46f5-9453-3606fa8f8b46 tempest-VolumeDependencyTests-1698754972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:49:09 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-34e069e7-ccf9-46f5-9453-3606fa8f8b46 tempest-VolumeDependencyTests-1698754972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:49:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1914940214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61458ac1-3269-4c21-9711-13760f85394a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5167fbe6027547c4abab11eeb1738724',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:49:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:49:09Z,use_quota=True,user_id='937bf4b7058c4ea4a1ec706a709ea234',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:49:09 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-34e069e7-ccf9-46f5-9453-3606fa8f8b46 tempest-VolumeDependencyTests-1698754972 None] Creating volume 61458ac1-3269-4c21-9711-13760f85394a {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:49:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-34e069e7-ccf9-46f5-9453-3606fa8f8b46 tempest-VolumeDependencyTests-1698754972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:49:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-34e069e7-ccf9-46f5-9453-3606fa8f8b46 tempest-VolumeDependencyTests-1698754972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:49:09 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-34e069e7-ccf9-46f5-9453-3606fa8f8b46 tempest-VolumeDependencyTests-1698754972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:49:09 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-34e069e7-ccf9-46f5-9453-3606fa8f8b46 tempest-VolumeDependencyTests-1698754972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:49:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-34e069e7-ccf9-46f5-9453-3606fa8f8b46 tempest-VolumeDependencyTests-1698754972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:49:09 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-34e069e7-ccf9-46f5-9453-3606fa8f8b46 tempest-VolumeDependencyTests-1698754972 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:49:09 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-34e069e7-ccf9-46f5-9453-3606fa8f8b46 tempest-VolumeDependencyTests-1698754972 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:49:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-34e069e7-ccf9-46f5-9453-3606fa8f8b46 tempest-VolumeDependencyTests-1698754972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-61458ac1-3269-4c21-9711-13760f85394a 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:09 devstack sudo[103304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-61458ac1-3269-4c21-9711-13760f85394a 1073741824 Sep 18 21:49:09 devstack sudo[103304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:10 devstack sudo[103304]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:10 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-34e069e7-ccf9-46f5-9453-3606fa8f8b46 tempest-VolumeDependencyTests-1698754972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-61458ac1-3269-4c21-9711-13760f85394a 1073741824" returned: 0 in 0.493s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:10 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-34e069e7-ccf9-46f5-9453-3606fa8f8b46 tempest-VolumeDependencyTests-1698754972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-61458ac1-3269-4c21-9711-13760f85394a {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:10 devstack sudo[103310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-61458ac1-3269-4c21-9711-13760f85394a Sep 18 21:49:10 devstack sudo[103310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:10 devstack sudo[103310]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:10 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-34e069e7-ccf9-46f5-9453-3606fa8f8b46 tempest-VolumeDependencyTests-1698754972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-61458ac1-3269-4c21-9711-13760f85394a" returned: 0 in 0.281s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:10 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-34e069e7-ccf9-46f5-9453-3606fa8f8b46 tempest-VolumeDependencyTests-1698754972 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:49:10 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-34e069e7-ccf9-46f5-9453-3606fa8f8b46 tempest-VolumeDependencyTests-1698754972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:49:10 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-34e069e7-ccf9-46f5-9453-3606fa8f8b46 tempest-VolumeDependencyTests-1698754972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1dece1c-f1c6-43f2-a616-4f0eb32fe308) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61458ac1-3269-4c21-9711-13760f85394a', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:49:10 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-34e069e7-ccf9-46f5-9453-3606fa8f8b46 tempest-VolumeDependencyTests-1698754972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (314dfade-c513-452c-bb61-6636bd693d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:49:10 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-34e069e7-ccf9-46f5-9453-3606fa8f8b46 tempest-VolumeDependencyTests-1698754972 None] Volume volume-61458ac1-3269-4c21-9711-13760f85394a (61458ac1-3269-4c21-9711-13760f85394a): created successfully Sep 18 21:49:10 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-34e069e7-ccf9-46f5-9453-3606fa8f8b46 tempest-VolumeDependencyTests-1698754972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (314dfade-c513-452c-bb61-6636bd693d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:49:10 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-34e069e7-ccf9-46f5-9453-3606fa8f8b46 tempest-VolumeDependencyTests-1698754972 None] Flow 'volume_create_manager' (e6c746bf-75cb-4070-a8f1-935e5a0f2cd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:49:10 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-34e069e7-ccf9-46f5-9453-3606fa8f8b46 tempest-VolumeDependencyTests-1698754972 None] Created volume successfully. Sep 18 21:49:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6a4557cc-a7e9-47e8-842b-7cc5ff23300c tempest-VolumeDependencyTests-1698754972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:49:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6a4557cc-a7e9-47e8-842b-7cc5ff23300c tempest-VolumeDependencyTests-1698754972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:49:11 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-6a4557cc-a7e9-47e8-842b-7cc5ff23300c tempest-VolumeDependencyTests-1698754972 None] Creating offline snapshot 2ac53244-5235-4d39-90d1-da73f4013980 of volume 61458ac1-3269-4c21-9711-13760f85394a {{(pid=86136) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 21:49:11 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[d970a988-e074-4a7e-a1d4-e23721d59815]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:49:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6a4557cc-a7e9-47e8-842b-7cc5ff23300c tempest-VolumeDependencyTests-1698754972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-61458ac1-3269-4c21-9711-13760f85394a {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:11 devstack sudo[103314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-61458ac1-3269-4c21-9711-13760f85394a Sep 18 21:49:11 devstack sudo[103314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:12 devstack sudo[103314]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6a4557cc-a7e9-47e8-842b-7cc5ff23300c tempest-VolumeDependencyTests-1698754972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-61458ac1-3269-4c21-9711-13760f85394a" returned: 0 in 0.377s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6a4557cc-a7e9-47e8-842b-7cc5ff23300c tempest-VolumeDependencyTests-1698754972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-61458ac1-3269-4c21-9711-13760f85394a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-61458ac1-3269-4c21-9711-13760f85394a.2ac53244-5235-4d39-90d1-da73f4013980 1G {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:12 devstack sudo[103319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-61458ac1-3269-4c21-9711-13760f85394a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-61458ac1-3269-4c21-9711-13760f85394a.2ac53244-5235-4d39-90d1-da73f4013980 1G Sep 18 21:49:12 devstack sudo[103319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:12 devstack sudo[103319]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6a4557cc-a7e9-47e8-842b-7cc5ff23300c tempest-VolumeDependencyTests-1698754972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-61458ac1-3269-4c21-9711-13760f85394a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-61458ac1-3269-4c21-9711-13760f85394a.2ac53244-5235-4d39-90d1-da73f4013980 1G" returned: 0 in 0.470s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6a4557cc-a7e9-47e8-842b-7cc5ff23300c tempest-VolumeDependencyTests-1698754972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61458ac1-3269-4c21-9711-13760f85394a -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-61458ac1-3269-4c21-9711-13760f85394a.2ac53244-5235-4d39-90d1-da73f4013980 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:12 devstack sudo[103325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61458ac1-3269-4c21-9711-13760f85394a -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-61458ac1-3269-4c21-9711-13760f85394a.2ac53244-5235-4d39-90d1-da73f4013980 Sep 18 21:49:12 devstack sudo[103325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:12 devstack sudo[103325]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6a4557cc-a7e9-47e8-842b-7cc5ff23300c tempest-VolumeDependencyTests-1698754972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61458ac1-3269-4c21-9711-13760f85394a -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-61458ac1-3269-4c21-9711-13760f85394a.2ac53244-5235-4d39-90d1-da73f4013980" returned: 0 in 0.309s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:12 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-6a4557cc-a7e9-47e8-842b-7cc5ff23300c tempest-VolumeDependencyTests-1698754972 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-61458ac1-3269-4c21-9711-13760f85394a.2ac53244-5235-4d39-90d1-da73f4013980 is being set with open permissions: ugo+rw Sep 18 21:49:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6a4557cc-a7e9-47e8-842b-7cc5ff23300c tempest-VolumeDependencyTests-1698754972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-61458ac1-3269-4c21-9711-13760f85394a.2ac53244-5235-4d39-90d1-da73f4013980 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:12 devstack sudo[103330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-61458ac1-3269-4c21-9711-13760f85394a.2ac53244-5235-4d39-90d1-da73f4013980 Sep 18 21:49:12 devstack sudo[103330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:13 devstack sudo[103330]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6a4557cc-a7e9-47e8-842b-7cc5ff23300c tempest-VolumeDependencyTests-1698754972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-61458ac1-3269-4c21-9711-13760f85394a.2ac53244-5235-4d39-90d1-da73f4013980" returned: 0 in 0.272s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6a4557cc-a7e9-47e8-842b-7cc5ff23300c tempest-VolumeDependencyTests-1698754972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-61458ac1-3269-4c21-9711-13760f85394a.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:13 devstack sudo[103333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-61458ac1-3269-4c21-9711-13760f85394a.info Sep 18 21:49:13 devstack sudo[103333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:13 devstack sudo[103333]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6a4557cc-a7e9-47e8-842b-7cc5ff23300c tempest-VolumeDependencyTests-1698754972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-61458ac1-3269-4c21-9711-13760f85394a.info" returned: 0 in 0.261s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:13 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-6a4557cc-a7e9-47e8-842b-7cc5ff23300c tempest-VolumeDependencyTests-1698754972 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-61458ac1-3269-4c21-9711-13760f85394a.info is being set with open permissions: ugo+rw Sep 18 21:49:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6a4557cc-a7e9-47e8-842b-7cc5ff23300c tempest-VolumeDependencyTests-1698754972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-61458ac1-3269-4c21-9711-13760f85394a.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:13 devstack sudo[103336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-61458ac1-3269-4c21-9711-13760f85394a.info Sep 18 21:49:13 devstack sudo[103336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:13 devstack sudo[103336]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6a4557cc-a7e9-47e8-842b-7cc5ff23300c tempest-VolumeDependencyTests-1698754972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-61458ac1-3269-4c21-9711-13760f85394a.info" returned: 0 in 0.296s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6a4557cc-a7e9-47e8-842b-7cc5ff23300c tempest-VolumeDependencyTests-1698754972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.095s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:49:13 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-6a4557cc-a7e9-47e8-842b-7cc5ff23300c tempest-VolumeDependencyTests-1698754972 None] Create snapshot completed successfully Sep 18 21:49:15 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ff24b6a-d8ab-4a93-becd-034ae45cb9dc tempest-VolumeDependencyTests-1698754972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:49:15 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6ff24b6a-d8ab-4a93-becd-034ae45cb9dc tempest-VolumeDependencyTests-1698754972 None] Flow 'volume_create_manager' (15e47b3a-a5e2-49e5-8b4d-bf0a74bb61f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:49:15 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6ff24b6a-d8ab-4a93-becd-034ae45cb9dc tempest-VolumeDependencyTests-1698754972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8734d7d-bf12-4bfd-8cb1-27f8ae12c896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:49:15 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6ff24b6a-d8ab-4a93-becd-034ae45cb9dc tempest-VolumeDependencyTests-1698754972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8734d7d-bf12-4bfd-8cb1-27f8ae12c896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:49:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-319782856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eb1af34-5863-4565-bb1c-837fc940bbfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5167fbe6027547c4abab11eeb1738724',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:49:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2ac53244-5235-4d39-90d1-da73f4013980,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:49:15Z,use_quota=True,user_id='937bf4b7058c4ea4a1ec706a709ea234',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:49:15 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6ff24b6a-d8ab-4a93-becd-034ae45cb9dc tempest-VolumeDependencyTests-1698754972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b3dd323-1f84-498e-9ba0-f8cedc91616b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:49:15 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6ff24b6a-d8ab-4a93-becd-034ae45cb9dc tempest-VolumeDependencyTests-1698754972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b3dd323-1f84-498e-9ba0-f8cedc91616b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:49:15 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6ff24b6a-d8ab-4a93-becd-034ae45cb9dc tempest-VolumeDependencyTests-1698754972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7470088d-b6c1-475d-9093-a6455f628ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:49:15 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6ff24b6a-d8ab-4a93-becd-034ae45cb9dc tempest-VolumeDependencyTests-1698754972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7470088d-b6c1-475d-9093-a6455f628ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2eb1af34-5863-4565-bb1c-837fc940bbfc', 'volume_name': 'volume-2eb1af34-5863-4565-bb1c-837fc940bbfc', 'volume_size': 1, 'snapshot_id': '2ac53244-5235-4d39-90d1-da73f4013980'}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:49:15 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6ff24b6a-d8ab-4a93-becd-034ae45cb9dc tempest-VolumeDependencyTests-1698754972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f51dadb0-96f1-4db7-a1fa-9c54d74a7695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:49:15 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6ff24b6a-d8ab-4a93-becd-034ae45cb9dc tempest-VolumeDependencyTests-1698754972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f51dadb0-96f1-4db7-a1fa-9c54d74a7695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:49:15 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6ff24b6a-d8ab-4a93-becd-034ae45cb9dc tempest-VolumeDependencyTests-1698754972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ef5906b-7f8d-4bbb-ade7-f645a637b41f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:49:15 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-6ff24b6a-d8ab-4a93-becd-034ae45cb9dc tempest-VolumeDependencyTests-1698754972 None] Volume 2eb1af34-5863-4565-bb1c-837fc940bbfc: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2eb1af34-5863-4565-bb1c-837fc940bbfc', 'volume_size': 1, 'snapshot_id': '2ac53244-5235-4d39-90d1-da73f4013980'} Sep 18 21:49:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6ff24b6a-d8ab-4a93-becd-034ae45cb9dc tempest-VolumeDependencyTests-1698754972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:49:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6ff24b6a-d8ab-4a93-becd-034ae45cb9dc tempest-VolumeDependencyTests-1698754972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:49:15 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-6ff24b6a-d8ab-4a93-becd-034ae45cb9dc tempest-VolumeDependencyTests-1698754972 None] Acquiring lock "cinder-quobyte-2ac53244-5235-4d39-90d1-da73f4013980-2eb1af34-5863-4565-bb1c-837fc940bbfc" by "_create_volume_from_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:49:15 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-6ff24b6a-d8ab-4a93-becd-034ae45cb9dc tempest-VolumeDependencyTests-1698754972 None] Lock "cinder-quobyte-2ac53244-5235-4d39-90d1-da73f4013980-2eb1af34-5863-4565-bb1c-837fc940bbfc" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:49:15 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-6ff24b6a-d8ab-4a93-becd-034ae45cb9dc tempest-VolumeDependencyTests-1698754972 None] Creating volume 2eb1af34-5863-4565-bb1c-837fc940bbfc from snapshot 2ac53244-5235-4d39-90d1-da73f4013980 {{(pid=86136) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 18 21:49:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6ff24b6a-d8ab-4a93-becd-034ae45cb9dc tempest-VolumeDependencyTests-1698754972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:49:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6ff24b6a-d8ab-4a93-becd-034ae45cb9dc tempest-VolumeDependencyTests-1698754972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:49:15 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-6ff24b6a-d8ab-4a93-becd-034ae45cb9dc tempest-VolumeDependencyTests-1698754972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:49:15 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-6ff24b6a-d8ab-4a93-becd-034ae45cb9dc tempest-VolumeDependencyTests-1698754972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:49:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6ff24b6a-d8ab-4a93-becd-034ae45cb9dc tempest-VolumeDependencyTests-1698754972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:49:15 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-6ff24b6a-d8ab-4a93-becd-034ae45cb9dc tempest-VolumeDependencyTests-1698754972 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:49:15 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-6ff24b6a-d8ab-4a93-becd-034ae45cb9dc tempest-VolumeDependencyTests-1698754972 None] Acquiring lock "cinder-quobyte-2eb1af34-5863-4565-bb1c-837fc940bbfc" by "_copy_volume_from_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:49:15 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-6ff24b6a-d8ab-4a93-becd-034ae45cb9dc tempest-VolumeDependencyTests-1698754972 None] Lock "cinder-quobyte-2eb1af34-5863-4565-bb1c-837fc940bbfc" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:49:15 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-6ff24b6a-d8ab-4a93-becd-034ae45cb9dc tempest-VolumeDependencyTests-1698754972 None] snapshot: 2ac53244-5235-4d39-90d1-da73f4013980, volume: 2eb1af34-5863-4565-bb1c-837fc940bbfc, {{(pid=86136) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 18 21:49:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6ff24b6a-d8ab-4a93-becd-034ae45cb9dc tempest-VolumeDependencyTests-1698754972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:49:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6ff24b6a-d8ab-4a93-becd-034ae45cb9dc tempest-VolumeDependencyTests-1698754972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:49:15 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-6ff24b6a-d8ab-4a93-becd-034ae45cb9dc tempest-VolumeDependencyTests-1698754972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:49:15 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-6ff24b6a-d8ab-4a93-becd-034ae45cb9dc tempest-VolumeDependencyTests-1698754972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:49:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6ff24b6a-d8ab-4a93-becd-034ae45cb9dc tempest-VolumeDependencyTests-1698754972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:49:15 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[48186feb-ac2e-41b4-8db4-46b0cdcd95f4]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:49:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6ff24b6a-d8ab-4a93-becd-034ae45cb9dc tempest-VolumeDependencyTests-1698754972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-61458ac1-3269-4c21-9711-13760f85394a.2ac53244-5235-4d39-90d1-da73f4013980 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:15 devstack sudo[103339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-61458ac1-3269-4c21-9711-13760f85394a.2ac53244-5235-4d39-90d1-da73f4013980 Sep 18 21:49:15 devstack sudo[103339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:16 devstack sudo[103339]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6ff24b6a-d8ab-4a93-becd-034ae45cb9dc tempest-VolumeDependencyTests-1698754972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-61458ac1-3269-4c21-9711-13760f85394a.2ac53244-5235-4d39-90d1-da73f4013980" returned: 0 in 0.406s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:16 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-6ff24b6a-d8ab-4a93-becd-034ae45cb9dc tempest-VolumeDependencyTests-1698754972 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61458ac1-3269-4c21-9711-13760f85394a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86136) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 21:49:16 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a4904d6-d4e8-49de-8a31-90fda9ce4d4a]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:49:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6ff24b6a-d8ab-4a93-becd-034ae45cb9dc tempest-VolumeDependencyTests-1698754972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-61458ac1-3269-4c21-9711-13760f85394a {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:16 devstack sudo[103345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-61458ac1-3269-4c21-9711-13760f85394a Sep 18 21:49:16 devstack sudo[103345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:16 devstack sudo[103345]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6ff24b6a-d8ab-4a93-becd-034ae45cb9dc tempest-VolumeDependencyTests-1698754972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-61458ac1-3269-4c21-9711-13760f85394a" returned: 0 in 0.389s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:16 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-6ff24b6a-d8ab-4a93-becd-034ae45cb9dc tempest-VolumeDependencyTests-1698754972 None] will copy from snapshot at /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-61458ac1-3269-4c21-9711-13760f85394a {{(pid=86136) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 18 21:49:16 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-6ff24b6a-d8ab-4a93-becd-034ae45cb9dc tempest-VolumeDependencyTests-1698754972 None] Creating direct copy from snapshot {{(pid=86136) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 18 21:49:16 devstack cinder-volume[86136]: DEBUG cinder.utils [None req-6ff24b6a-d8ab-4a93-becd-034ae45cb9dc tempest-VolumeDependencyTests-1698754972 None] Path /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2eb1af34-5863-4565-bb1c-837fc940bbfc not found in is_blk_device check {{(pid=86136) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 18 21:49:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6ff24b6a-d8ab-4a93-becd-034ae45cb9dc tempest-VolumeDependencyTests-1698754972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-61458ac1-3269-4c21-9711-13760f85394a /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2eb1af34-5863-4565-bb1c-837fc940bbfc {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:16 devstack sudo[103350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-61458ac1-3269-4c21-9711-13760f85394a /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2eb1af34-5863-4565-bb1c-837fc940bbfc Sep 18 21:49:16 devstack sudo[103350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:16 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-078b6665-2dde-45d0-bf2e-773c7a8be820 tempest-VolumesSnapshotTestJSON-2116537629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:49:16 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-078b6665-2dde-45d0-bf2e-773c7a8be820 tempest-VolumesSnapshotTestJSON-2116537629 None] Flow 'volume_create_manager' (f6970995-927f-4755-9b82-a4503e9db0e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:49:16 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-078b6665-2dde-45d0-bf2e-773c7a8be820 tempest-VolumesSnapshotTestJSON-2116537629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20b83c5d-e73e-4e66-8b8d-30f17e44f0c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:49:16 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-078b6665-2dde-45d0-bf2e-773c7a8be820 tempest-VolumesSnapshotTestJSON-2116537629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20b83c5d-e73e-4e66-8b8d-30f17e44f0c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:49:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-729410488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44e67452-6317-4ed4-a3f9-4a8d8eabcfc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56bc1d47940d4119a14cf1970728710e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:49:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:49:17Z,use_quota=True,user_id='8ace514290c84ec1a763bcbe1fade50d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:49:17 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-078b6665-2dde-45d0-bf2e-773c7a8be820 tempest-VolumesSnapshotTestJSON-2116537629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b65c7e32-ecc2-4351-9121-b2be001a92d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:49:17 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-078b6665-2dde-45d0-bf2e-773c7a8be820 tempest-VolumesSnapshotTestJSON-2116537629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b65c7e32-ecc2-4351-9121-b2be001a92d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:49:17 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-078b6665-2dde-45d0-bf2e-773c7a8be820 tempest-VolumesSnapshotTestJSON-2116537629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a34c12c1-27e7-4884-adba-a511e5025bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:49:17 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-078b6665-2dde-45d0-bf2e-773c7a8be820 tempest-VolumesSnapshotTestJSON-2116537629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a34c12c1-27e7-4884-adba-a511e5025bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44e67452-6317-4ed4-a3f9-4a8d8eabcfc5', 'volume_name': 'volume-44e67452-6317-4ed4-a3f9-4a8d8eabcfc5', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:49:17 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-078b6665-2dde-45d0-bf2e-773c7a8be820 tempest-VolumesSnapshotTestJSON-2116537629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89e07365-8ed2-448f-8ac8-1886f7dddde1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:49:17 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-078b6665-2dde-45d0-bf2e-773c7a8be820 tempest-VolumesSnapshotTestJSON-2116537629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89e07365-8ed2-448f-8ac8-1886f7dddde1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:49:17 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-078b6665-2dde-45d0-bf2e-773c7a8be820 tempest-VolumesSnapshotTestJSON-2116537629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8147fc8a-35bb-493f-b713-34bffacf10d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:49:17 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-078b6665-2dde-45d0-bf2e-773c7a8be820 tempest-VolumesSnapshotTestJSON-2116537629 None] Volume 44e67452-6317-4ed4-a3f9-4a8d8eabcfc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44e67452-6317-4ed4-a3f9-4a8d8eabcfc5', 'volume_size': 1} Sep 18 21:49:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-078b6665-2dde-45d0-bf2e-773c7a8be820 tempest-VolumesSnapshotTestJSON-2116537629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:49:22 devstack sudo[103350]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6ff24b6a-d8ab-4a93-becd-034ae45cb9dc tempest-VolumeDependencyTests-1698754972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-61458ac1-3269-4c21-9711-13760f85394a /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2eb1af34-5863-4565-bb1c-837fc940bbfc" returned: 0 in 5.973s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:22 devstack cinder-volume[86136]: DEBUG cinder.image.image_utils [None req-6ff24b6a-d8ab-4a93-becd-034ae45cb9dc tempest-VolumeDependencyTests-1698754972 None] Image conversion details: src /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-61458ac1-3269-4c21-9711-13760f85394a, size 1024.00 MB, duration 5.97 sec, destination /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2eb1af34-5863-4565-bb1c-837fc940bbfc {{(pid=86136) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 18 21:49:22 devstack cinder-volume[86136]: INFO cinder.image.image_utils [None req-6ff24b6a-d8ab-4a93-becd-034ae45cb9dc tempest-VolumeDependencyTests-1698754972 None] Converted 1024.00 MB image at 171.40 MB/s Sep 18 21:49:22 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-6ff24b6a-d8ab-4a93-becd-034ae45cb9dc tempest-VolumeDependencyTests-1698754972 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2eb1af34-5863-4565-bb1c-837fc940bbfc is being set with open permissions: ugo+rw Sep 18 21:49:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6ff24b6a-d8ab-4a93-becd-034ae45cb9dc tempest-VolumeDependencyTests-1698754972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2eb1af34-5863-4565-bb1c-837fc940bbfc {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:22 devstack sudo[103364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2eb1af34-5863-4565-bb1c-837fc940bbfc Sep 18 21:49:22 devstack sudo[103364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:22 devstack sudo[103364]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6ff24b6a-d8ab-4a93-becd-034ae45cb9dc tempest-VolumeDependencyTests-1698754972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2eb1af34-5863-4565-bb1c-837fc940bbfc" returned: 0 in 0.267s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:22 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-6ff24b6a-d8ab-4a93-becd-034ae45cb9dc tempest-VolumeDependencyTests-1698754972 None] Lock "cinder-quobyte-2eb1af34-5863-4565-bb1c-837fc940bbfc" released by "_copy_volume_from_snapshot" :: held 7.148s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:49:22 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-6ff24b6a-d8ab-4a93-becd-034ae45cb9dc tempest-VolumeDependencyTests-1698754972 None] Lock "cinder-quobyte-2ac53244-5235-4d39-90d1-da73f4013980-2eb1af34-5863-4565-bb1c-837fc940bbfc" released by "_create_volume_from_snapshot" :: held 7.260s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:49:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6ff24b6a-d8ab-4a93-becd-034ae45cb9dc tempest-VolumeDependencyTests-1698754972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.278s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:49:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-078b6665-2dde-45d0-bf2e-773c7a8be820 tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.877s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:49:22 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-078b6665-2dde-45d0-bf2e-773c7a8be820 tempest-VolumesSnapshotTestJSON-2116537629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:49:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-729410488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44e67452-6317-4ed4-a3f9-4a8d8eabcfc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56bc1d47940d4119a14cf1970728710e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:49:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:49:17Z,use_quota=True,user_id='8ace514290c84ec1a763bcbe1fade50d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:49:22 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-078b6665-2dde-45d0-bf2e-773c7a8be820 tempest-VolumesSnapshotTestJSON-2116537629 None] Creating volume 44e67452-6317-4ed4-a3f9-4a8d8eabcfc5 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:49:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-078b6665-2dde-45d0-bf2e-773c7a8be820 tempest-VolumesSnapshotTestJSON-2116537629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:49:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-078b6665-2dde-45d0-bf2e-773c7a8be820 tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:49:22 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-078b6665-2dde-45d0-bf2e-773c7a8be820 tempest-VolumesSnapshotTestJSON-2116537629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:49:22 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-078b6665-2dde-45d0-bf2e-773c7a8be820 tempest-VolumesSnapshotTestJSON-2116537629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:49:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-078b6665-2dde-45d0-bf2e-773c7a8be820 tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:49:22 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-078b6665-2dde-45d0-bf2e-773c7a8be820 tempest-VolumesSnapshotTestJSON-2116537629 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:49:22 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-078b6665-2dde-45d0-bf2e-773c7a8be820 tempest-VolumesSnapshotTestJSON-2116537629 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:49:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-078b6665-2dde-45d0-bf2e-773c7a8be820 tempest-VolumesSnapshotTestJSON-2116537629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-44e67452-6317-4ed4-a3f9-4a8d8eabcfc5 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:22 devstack sudo[103367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-44e67452-6317-4ed4-a3f9-4a8d8eabcfc5 1073741824 Sep 18 21:49:22 devstack sudo[103367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:22 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6ff24b6a-d8ab-4a93-becd-034ae45cb9dc tempest-VolumeDependencyTests-1698754972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ef5906b-7f8d-4bbb-ade7-f645a637b41f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2eb1af34-5863-4565-bb1c-837fc940bbfc', 'volume_size': 1, 'snapshot_id': '2ac53244-5235-4d39-90d1-da73f4013980'}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:49:22 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6ff24b6a-d8ab-4a93-becd-034ae45cb9dc tempest-VolumeDependencyTests-1698754972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (740b2c1c-ed28-48ef-8516-08a7b7afa7e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:49:22 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-6ff24b6a-d8ab-4a93-becd-034ae45cb9dc tempest-VolumeDependencyTests-1698754972 None] Volume volume-2eb1af34-5863-4565-bb1c-837fc940bbfc (2eb1af34-5863-4565-bb1c-837fc940bbfc): created successfully Sep 18 21:49:22 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6ff24b6a-d8ab-4a93-becd-034ae45cb9dc tempest-VolumeDependencyTests-1698754972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (740b2c1c-ed28-48ef-8516-08a7b7afa7e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:49:22 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6ff24b6a-d8ab-4a93-becd-034ae45cb9dc tempest-VolumeDependencyTests-1698754972 None] Flow 'volume_create_manager' (15e47b3a-a5e2-49e5-8b4d-bf0a74bb61f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:49:23 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-6ff24b6a-d8ab-4a93-becd-034ae45cb9dc tempest-VolumeDependencyTests-1698754972 None] Created volume successfully. Sep 18 21:49:23 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-5f73252f-c5a5-4940-b3ff-0b184df4c54d tempest-VolumeDependencyTests-1698754972 None] Acquiring lock "cinder-2ac53244-5235-4d39-90d1-da73f4013980-delete_snapshot" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:49:23 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-5f73252f-c5a5-4940-b3ff-0b184df4c54d tempest-VolumeDependencyTests-1698754972 None] Lock "cinder-2ac53244-5235-4d39-90d1-da73f4013980-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:49:23 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-5f73252f-c5a5-4940-b3ff-0b184df4c54d tempest-VolumeDependencyTests-1698754972 None] Acquiring lock "cinder-quobyte-61458ac1-3269-4c21-9711-13760f85394a" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:49:23 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-5f73252f-c5a5-4940-b3ff-0b184df4c54d tempest-VolumeDependencyTests-1698754972 None] Lock "cinder-quobyte-61458ac1-3269-4c21-9711-13760f85394a" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:49:23 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-5f73252f-c5a5-4940-b3ff-0b184df4c54d tempest-VolumeDependencyTests-1698754972 None] Acquiring lock "cinder-quobyte-2ac53244-5235-4d39-90d1-da73f4013980" by "_delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:49:23 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-5f73252f-c5a5-4940-b3ff-0b184df4c54d tempest-VolumeDependencyTests-1698754972 None] Lock "cinder-quobyte-2ac53244-5235-4d39-90d1-da73f4013980" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:49:23 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-5f73252f-c5a5-4940-b3ff-0b184df4c54d tempest-VolumeDependencyTests-1698754972 None] Deleting offline snapshot 2ac53244-5235-4d39-90d1-da73f4013980 of volume 61458ac1-3269-4c21-9711-13760f85394a {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 21:49:23 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-5f73252f-c5a5-4940-b3ff-0b184df4c54d tempest-VolumeDependencyTests-1698754972 None] snapshot_file for this snap is: volume-61458ac1-3269-4c21-9711-13760f85394a.2ac53244-5235-4d39-90d1-da73f4013980 {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 21:49:23 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0d327c-e7ec-4818-aff8-665c83fc321e]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:49:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5f73252f-c5a5-4940-b3ff-0b184df4c54d tempest-VolumeDependencyTests-1698754972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-61458ac1-3269-4c21-9711-13760f85394a.2ac53244-5235-4d39-90d1-da73f4013980 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:23 devstack sudo[103372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-61458ac1-3269-4c21-9711-13760f85394a.2ac53244-5235-4d39-90d1-da73f4013980 Sep 18 21:49:23 devstack sudo[103372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:23 devstack sudo[103367]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-078b6665-2dde-45d0-bf2e-773c7a8be820 tempest-VolumesSnapshotTestJSON-2116537629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-44e67452-6317-4ed4-a3f9-4a8d8eabcfc5 1073741824" returned: 0 in 0.464s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-078b6665-2dde-45d0-bf2e-773c7a8be820 tempest-VolumesSnapshotTestJSON-2116537629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-44e67452-6317-4ed4-a3f9-4a8d8eabcfc5 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:23 devstack sudo[103375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-44e67452-6317-4ed4-a3f9-4a8d8eabcfc5 Sep 18 21:49:23 devstack sudo[103375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:23 devstack sudo[103372]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5f73252f-c5a5-4940-b3ff-0b184df4c54d tempest-VolumeDependencyTests-1698754972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-61458ac1-3269-4c21-9711-13760f85394a.2ac53244-5235-4d39-90d1-da73f4013980" returned: 0 in 0.377s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:23 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-5f73252f-c5a5-4940-b3ff-0b184df4c54d tempest-VolumeDependencyTests-1698754972 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61458ac1-3269-4c21-9711-13760f85394a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86136) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 21:49:23 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb55f5d-8eef-4b70-b135-af01a494b611]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:49:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5f73252f-c5a5-4940-b3ff-0b184df4c54d tempest-VolumeDependencyTests-1698754972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-61458ac1-3269-4c21-9711-13760f85394a {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:23 devstack sudo[103375]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-078b6665-2dde-45d0-bf2e-773c7a8be820 tempest-VolumesSnapshotTestJSON-2116537629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-44e67452-6317-4ed4-a3f9-4a8d8eabcfc5" returned: 0 in 0.263s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:23 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-078b6665-2dde-45d0-bf2e-773c7a8be820 tempest-VolumesSnapshotTestJSON-2116537629 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:49:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-078b6665-2dde-45d0-bf2e-773c7a8be820 tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:49:23 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-078b6665-2dde-45d0-bf2e-773c7a8be820 tempest-VolumesSnapshotTestJSON-2116537629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8147fc8a-35bb-493f-b713-34bffacf10d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44e67452-6317-4ed4-a3f9-4a8d8eabcfc5', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:49:23 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-078b6665-2dde-45d0-bf2e-773c7a8be820 tempest-VolumesSnapshotTestJSON-2116537629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a36e169-6bc4-408f-8704-920e3c70977f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:49:23 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-078b6665-2dde-45d0-bf2e-773c7a8be820 tempest-VolumesSnapshotTestJSON-2116537629 None] Volume volume-44e67452-6317-4ed4-a3f9-4a8d8eabcfc5 (44e67452-6317-4ed4-a3f9-4a8d8eabcfc5): created successfully Sep 18 21:49:23 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-078b6665-2dde-45d0-bf2e-773c7a8be820 tempest-VolumesSnapshotTestJSON-2116537629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a36e169-6bc4-408f-8704-920e3c70977f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:49:23 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-078b6665-2dde-45d0-bf2e-773c7a8be820 tempest-VolumesSnapshotTestJSON-2116537629 None] Flow 'volume_create_manager' (f6970995-927f-4755-9b82-a4503e9db0e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:49:23 devstack sudo[103380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-61458ac1-3269-4c21-9711-13760f85394a Sep 18 21:49:23 devstack sudo[103380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:23 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-078b6665-2dde-45d0-bf2e-773c7a8be820 tempest-VolumesSnapshotTestJSON-2116537629 None] Created volume successfully. Sep 18 21:49:24 devstack sudo[103380]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5f73252f-c5a5-4940-b3ff-0b184df4c54d tempest-VolumeDependencyTests-1698754972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-61458ac1-3269-4c21-9711-13760f85394a" returned: 0 in 0.536s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5f73252f-c5a5-4940-b3ff-0b184df4c54d tempest-VolumeDependencyTests-1698754972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-61458ac1-3269-4c21-9711-13760f85394a.2ac53244-5235-4d39-90d1-da73f4013980 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:24 devstack sudo[103386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-61458ac1-3269-4c21-9711-13760f85394a.2ac53244-5235-4d39-90d1-da73f4013980 Sep 18 21:49:24 devstack sudo[103386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:24 devstack sudo[103386]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5f73252f-c5a5-4940-b3ff-0b184df4c54d tempest-VolumeDependencyTests-1698754972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-61458ac1-3269-4c21-9711-13760f85394a.2ac53244-5235-4d39-90d1-da73f4013980" returned: 0 in 0.344s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5f73252f-c5a5-4940-b3ff-0b184df4c54d tempest-VolumeDependencyTests-1698754972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-61458ac1-3269-4c21-9711-13760f85394a.2ac53244-5235-4d39-90d1-da73f4013980 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:24 devstack sudo[103392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-61458ac1-3269-4c21-9711-13760f85394a.2ac53244-5235-4d39-90d1-da73f4013980 Sep 18 21:49:24 devstack sudo[103392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c986f8c0-a238-4927-9d53-8d06b503c332 tempest-VolumesSnapshotTestJSON-2116537629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:49:24 devstack sudo[103392]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c986f8c0-a238-4927-9d53-8d06b503c332 tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:49:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5f73252f-c5a5-4940-b3ff-0b184df4c54d tempest-VolumeDependencyTests-1698754972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-61458ac1-3269-4c21-9711-13760f85394a.2ac53244-5235-4d39-90d1-da73f4013980" returned: 0 in 0.273s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:24 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-c986f8c0-a238-4927-9d53-8d06b503c332 tempest-VolumesSnapshotTestJSON-2116537629 None] Creating offline snapshot 62447139-d4c5-4cc3-80df-24b425c0a17f of volume 44e67452-6317-4ed4-a3f9-4a8d8eabcfc5 {{(pid=86136) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 21:49:24 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c24782-88c9-4bec-880b-3429c3398078]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:49:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c986f8c0-a238-4927-9d53-8d06b503c332 tempest-VolumesSnapshotTestJSON-2116537629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-44e67452-6317-4ed4-a3f9-4a8d8eabcfc5 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:24 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-5f73252f-c5a5-4940-b3ff-0b184df4c54d tempest-VolumeDependencyTests-1698754972 None] Lock "cinder-quobyte-2ac53244-5235-4d39-90d1-da73f4013980" released by "_delete_snapshot" :: held 1.648s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:49:24 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-5f73252f-c5a5-4940-b3ff-0b184df4c54d tempest-VolumeDependencyTests-1698754972 None] Lock "cinder-quobyte-61458ac1-3269-4c21-9711-13760f85394a" released by "delete_snapshot" :: held 1.674s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:49:24 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-5f73252f-c5a5-4940-b3ff-0b184df4c54d tempest-VolumeDependencyTests-1698754972 None] Created reservations ['8e1a82dd-0558-4b71-85c3-897e493f5038', '13aeed8d-027b-4833-bfd9-325ca20cb3d3', 'd578fb3b-61b4-4aac-93fd-3faee366de00', 'fbd32a1c-1c09-41f0-9693-a233c30a745c'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:49:24 devstack sudo[103395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-44e67452-6317-4ed4-a3f9-4a8d8eabcfc5 Sep 18 21:49:24 devstack sudo[103395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:24 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-5f73252f-c5a5-4940-b3ff-0b184df4c54d tempest-VolumeDependencyTests-1698754972 None] Delete snapshot completed successfully. Sep 18 21:49:24 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-5f73252f-c5a5-4940-b3ff-0b184df4c54d tempest-VolumeDependencyTests-1698754972 None] Lock "cinder-2ac53244-5235-4d39-90d1-da73f4013980-delete_snapshot" released by "delete_snapshot" :: held 1.812s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:49:25 devstack sudo[103395]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:25 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c986f8c0-a238-4927-9d53-8d06b503c332 tempest-VolumesSnapshotTestJSON-2116537629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-44e67452-6317-4ed4-a3f9-4a8d8eabcfc5" returned: 0 in 0.366s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:25 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c986f8c0-a238-4927-9d53-8d06b503c332 tempest-VolumesSnapshotTestJSON-2116537629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-44e67452-6317-4ed4-a3f9-4a8d8eabcfc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-44e67452-6317-4ed4-a3f9-4a8d8eabcfc5.62447139-d4c5-4cc3-80df-24b425c0a17f 1G {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:25 devstack sudo[103400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-44e67452-6317-4ed4-a3f9-4a8d8eabcfc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-44e67452-6317-4ed4-a3f9-4a8d8eabcfc5.62447139-d4c5-4cc3-80df-24b425c0a17f 1G Sep 18 21:49:25 devstack sudo[103400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:25 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-94050b75-9e5b-495b-8866-e45782d54967 tempest-VolumeDependencyTests-1698754972 None] Acquiring lock "cinder-61458ac1-3269-4c21-9711-13760f85394a-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:49:25 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-94050b75-9e5b-495b-8866-e45782d54967 tempest-VolumeDependencyTests-1698754972 None] Lock "cinder-61458ac1-3269-4c21-9711-13760f85394a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:49:25 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-94050b75-9e5b-495b-8866-e45782d54967 tempest-VolumeDependencyTests-1698754972 None] Acquiring lock "cinder-quobyte-61458ac1-3269-4c21-9711-13760f85394a" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:49:25 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-94050b75-9e5b-495b-8866-e45782d54967 tempest-VolumeDependencyTests-1698754972 None] Lock "cinder-quobyte-61458ac1-3269-4c21-9711-13760f85394a" acquired by "delete_volume" :: waited 0.016s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:49:25 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c122f1-66cb-4a29-bd0a-eb6ecfdb42d0]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:49:25 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-94050b75-9e5b-495b-8866-e45782d54967 tempest-VolumeDependencyTests-1698754972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-61458ac1-3269-4c21-9711-13760f85394a {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:25 devstack sudo[103404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-61458ac1-3269-4c21-9711-13760f85394a Sep 18 21:49:25 devstack sudo[103404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:25 devstack sudo[103400]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:25 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c986f8c0-a238-4927-9d53-8d06b503c332 tempest-VolumesSnapshotTestJSON-2116537629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-44e67452-6317-4ed4-a3f9-4a8d8eabcfc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-44e67452-6317-4ed4-a3f9-4a8d8eabcfc5.62447139-d4c5-4cc3-80df-24b425c0a17f 1G" returned: 0 in 0.413s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:25 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c986f8c0-a238-4927-9d53-8d06b503c332 tempest-VolumesSnapshotTestJSON-2116537629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44e67452-6317-4ed4-a3f9-4a8d8eabcfc5 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-44e67452-6317-4ed4-a3f9-4a8d8eabcfc5.62447139-d4c5-4cc3-80df-24b425c0a17f {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:25 devstack sudo[103408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44e67452-6317-4ed4-a3f9-4a8d8eabcfc5 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-44e67452-6317-4ed4-a3f9-4a8d8eabcfc5.62447139-d4c5-4cc3-80df-24b425c0a17f Sep 18 21:49:25 devstack sudo[103408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:25 devstack sudo[103404]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:25 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-94050b75-9e5b-495b-8866-e45782d54967 tempest-VolumeDependencyTests-1698754972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-61458ac1-3269-4c21-9711-13760f85394a" returned: 0 in 0.374s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:25 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-94050b75-9e5b-495b-8866-e45782d54967 tempest-VolumeDependencyTests-1698754972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-61458ac1-3269-4c21-9711-13760f85394a {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:25 devstack sudo[103413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-61458ac1-3269-4c21-9711-13760f85394a Sep 18 21:49:25 devstack sudo[103413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:25 devstack sudo[103408]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:25 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c986f8c0-a238-4927-9d53-8d06b503c332 tempest-VolumesSnapshotTestJSON-2116537629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44e67452-6317-4ed4-a3f9-4a8d8eabcfc5 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-44e67452-6317-4ed4-a3f9-4a8d8eabcfc5.62447139-d4c5-4cc3-80df-24b425c0a17f" returned: 0 in 0.308s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:25 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-c986f8c0-a238-4927-9d53-8d06b503c332 tempest-VolumesSnapshotTestJSON-2116537629 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-44e67452-6317-4ed4-a3f9-4a8d8eabcfc5.62447139-d4c5-4cc3-80df-24b425c0a17f is being set with open permissions: ugo+rw Sep 18 21:49:25 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c986f8c0-a238-4927-9d53-8d06b503c332 tempest-VolumesSnapshotTestJSON-2116537629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-44e67452-6317-4ed4-a3f9-4a8d8eabcfc5.62447139-d4c5-4cc3-80df-24b425c0a17f {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:25 devstack sudo[103418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-44e67452-6317-4ed4-a3f9-4a8d8eabcfc5.62447139-d4c5-4cc3-80df-24b425c0a17f Sep 18 21:49:25 devstack sudo[103418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:26 devstack sudo[103413]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-94050b75-9e5b-495b-8866-e45782d54967 tempest-VolumeDependencyTests-1698754972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-61458ac1-3269-4c21-9711-13760f85394a" returned: 0 in 0.269s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:26 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-94050b75-9e5b-495b-8866-e45782d54967 tempest-VolumeDependencyTests-1698754972 None] Lock "cinder-quobyte-61458ac1-3269-4c21-9711-13760f85394a" released by "delete_volume" :: held 0.708s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:49:26 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-94050b75-9e5b-495b-8866-e45782d54967 tempest-VolumeDependencyTests-1698754972 None] Created reservations ['cfa6ff94-2d94-45a8-ba80-3195c7cd307f', 'd10a5ec8-da6f-43b9-a18d-1adffe519ba3', 'e9363e80-ec9c-4545-87bd-1965d2f1d754', '7c5693e2-efb3-4e4b-ac1a-e6d56beeaf67'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:49:26 devstack sudo[103418]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c986f8c0-a238-4927-9d53-8d06b503c332 tempest-VolumesSnapshotTestJSON-2116537629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-44e67452-6317-4ed4-a3f9-4a8d8eabcfc5.62447139-d4c5-4cc3-80df-24b425c0a17f" returned: 0 in 0.269s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-94050b75-9e5b-495b-8866-e45782d54967 tempest-VolumeDependencyTests-1698754972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:49:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-94050b75-9e5b-495b-8866-e45782d54967 tempest-VolumeDependencyTests-1698754972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:49:26 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-94050b75-9e5b-495b-8866-e45782d54967 tempest-VolumeDependencyTests-1698754972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:49:26 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-94050b75-9e5b-495b-8866-e45782d54967 tempest-VolumeDependencyTests-1698754972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:49:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-94050b75-9e5b-495b-8866-e45782d54967 tempest-VolumeDependencyTests-1698754972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:49:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-94050b75-9e5b-495b-8866-e45782d54967 tempest-VolumeDependencyTests-1698754972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c986f8c0-a238-4927-9d53-8d06b503c332 tempest-VolumesSnapshotTestJSON-2116537629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-44e67452-6317-4ed4-a3f9-4a8d8eabcfc5.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:26 devstack sudo[103456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:49:26 devstack sudo[103456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:26 devstack sudo[103457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-44e67452-6317-4ed4-a3f9-4a8d8eabcfc5.info Sep 18 21:49:26 devstack sudo[103457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:26 devstack sudo[103456]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:26 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-dc4156f9-0232-4dff-bbb4-57ebd4392c30 tempest-VolumeDependencyTests-1698754972 None] Acquiring lock "cinder-2eb1af34-5863-4565-bb1c-837fc940bbfc-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:49:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-94050b75-9e5b-495b-8866-e45782d54967 tempest-VolumeDependencyTests-1698754972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.284s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:26 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-94050b75-9e5b-495b-8866-e45782d54967 tempest-VolumeDependencyTests-1698754972 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:49:26 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-94050b75-9e5b-495b-8866-e45782d54967 tempest-VolumeDependencyTests-1698754972 None] Deleted volume successfully. Sep 18 21:49:26 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-dc4156f9-0232-4dff-bbb4-57ebd4392c30 tempest-VolumeDependencyTests-1698754972 None] Lock "cinder-2eb1af34-5863-4565-bb1c-837fc940bbfc-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:49:26 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-94050b75-9e5b-495b-8866-e45782d54967 tempest-VolumeDependencyTests-1698754972 None] Lock "cinder-61458ac1-3269-4c21-9711-13760f85394a-delete_volume" released by "delete_volume" :: held 1.261s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:49:26 devstack sudo[103457]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c986f8c0-a238-4927-9d53-8d06b503c332 tempest-VolumesSnapshotTestJSON-2116537629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-44e67452-6317-4ed4-a3f9-4a8d8eabcfc5.info" returned: 0 in 0.337s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:26 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-c986f8c0-a238-4927-9d53-8d06b503c332 tempest-VolumesSnapshotTestJSON-2116537629 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-44e67452-6317-4ed4-a3f9-4a8d8eabcfc5.info is being set with open permissions: ugo+rw Sep 18 21:49:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c986f8c0-a238-4927-9d53-8d06b503c332 tempest-VolumesSnapshotTestJSON-2116537629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-44e67452-6317-4ed4-a3f9-4a8d8eabcfc5.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:26 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-dc4156f9-0232-4dff-bbb4-57ebd4392c30 tempest-VolumeDependencyTests-1698754972 None] Acquiring lock "cinder-quobyte-2eb1af34-5863-4565-bb1c-837fc940bbfc" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:49:26 devstack sudo[103464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-44e67452-6317-4ed4-a3f9-4a8d8eabcfc5.info Sep 18 21:49:26 devstack sudo[103464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:26 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-dc4156f9-0232-4dff-bbb4-57ebd4392c30 tempest-VolumeDependencyTests-1698754972 None] Lock "cinder-quobyte-2eb1af34-5863-4565-bb1c-837fc940bbfc" acquired by "delete_volume" :: waited 0.018s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:49:26 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b3ddcf1-5aca-4cb8-8815-72a356bf8fcc]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:49:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-dc4156f9-0232-4dff-bbb4-57ebd4392c30 tempest-VolumeDependencyTests-1698754972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2eb1af34-5863-4565-bb1c-837fc940bbfc {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:26 devstack sudo[103466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2eb1af34-5863-4565-bb1c-837fc940bbfc Sep 18 21:49:26 devstack sudo[103466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:26 devstack sudo[103464]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c986f8c0-a238-4927-9d53-8d06b503c332 tempest-VolumesSnapshotTestJSON-2116537629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-44e67452-6317-4ed4-a3f9-4a8d8eabcfc5.info" returned: 0 in 0.273s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c986f8c0-a238-4927-9d53-8d06b503c332 tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.103s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:49:26 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-c986f8c0-a238-4927-9d53-8d06b503c332 tempest-VolumesSnapshotTestJSON-2116537629 None] Create snapshot completed successfully Sep 18 21:49:27 devstack sudo[103466]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:27 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-dc4156f9-0232-4dff-bbb4-57ebd4392c30 tempest-VolumeDependencyTests-1698754972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2eb1af34-5863-4565-bb1c-837fc940bbfc" returned: 0 in 0.362s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:27 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-dc4156f9-0232-4dff-bbb4-57ebd4392c30 tempest-VolumeDependencyTests-1698754972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2eb1af34-5863-4565-bb1c-837fc940bbfc {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:27 devstack sudo[103472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2eb1af34-5863-4565-bb1c-837fc940bbfc Sep 18 21:49:27 devstack sudo[103472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:27 devstack sudo[103472]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:27 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-dc4156f9-0232-4dff-bbb4-57ebd4392c30 tempest-VolumeDependencyTests-1698754972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2eb1af34-5863-4565-bb1c-837fc940bbfc" returned: 0 in 0.240s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:27 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-dc4156f9-0232-4dff-bbb4-57ebd4392c30 tempest-VolumeDependencyTests-1698754972 None] Lock "cinder-quobyte-2eb1af34-5863-4565-bb1c-837fc940bbfc" released by "delete_volume" :: held 0.644s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:49:27 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-dc4156f9-0232-4dff-bbb4-57ebd4392c30 tempest-VolumeDependencyTests-1698754972 None] Created reservations ['552d7eef-73bc-42b8-91f0-fd39bbced6a4', 'ccd04da9-fd9b-4aef-b2af-c2d5d5baaab7', 'b4baabd0-70bb-43e3-8cd0-7e9e8ccd24ab', 'bb683b2f-b0b7-49a5-8c6e-083ff53efda2'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:49:27 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-dc4156f9-0232-4dff-bbb4-57ebd4392c30 tempest-VolumeDependencyTests-1698754972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:49:27 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-dc4156f9-0232-4dff-bbb4-57ebd4392c30 tempest-VolumeDependencyTests-1698754972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:49:27 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-dc4156f9-0232-4dff-bbb4-57ebd4392c30 tempest-VolumeDependencyTests-1698754972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:49:27 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-dc4156f9-0232-4dff-bbb4-57ebd4392c30 tempest-VolumeDependencyTests-1698754972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:49:27 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-dc4156f9-0232-4dff-bbb4-57ebd4392c30 tempest-VolumeDependencyTests-1698754972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:49:27 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-dc4156f9-0232-4dff-bbb4-57ebd4392c30 tempest-VolumeDependencyTests-1698754972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:27 devstack sudo[103481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:49:27 devstack sudo[103481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:27 devstack sudo[103481]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:27 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-dc4156f9-0232-4dff-bbb4-57ebd4392c30 tempest-VolumeDependencyTests-1698754972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.249s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:27 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-dc4156f9-0232-4dff-bbb4-57ebd4392c30 tempest-VolumeDependencyTests-1698754972 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:49:27 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-dc4156f9-0232-4dff-bbb4-57ebd4392c30 tempest-VolumeDependencyTests-1698754972 None] Deleted volume successfully. Sep 18 21:49:27 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-dc4156f9-0232-4dff-bbb4-57ebd4392c30 tempest-VolumeDependencyTests-1698754972 None] Lock "cinder-2eb1af34-5863-4565-bb1c-837fc940bbfc-delete_volume" released by "delete_volume" :: held 1.120s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:49:28 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-edc1cd40-0daa-476a-9168-58915d1c7d65 tempest-VolumesSnapshotTestJSON-2116537629 None] Acquiring lock "cinder-62447139-d4c5-4cc3-80df-24b425c0a17f-delete_snapshot" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:49:28 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-edc1cd40-0daa-476a-9168-58915d1c7d65 tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "cinder-62447139-d4c5-4cc3-80df-24b425c0a17f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:49:28 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-edc1cd40-0daa-476a-9168-58915d1c7d65 tempest-VolumesSnapshotTestJSON-2116537629 None] Acquiring lock "cinder-quobyte-44e67452-6317-4ed4-a3f9-4a8d8eabcfc5" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:49:28 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-edc1cd40-0daa-476a-9168-58915d1c7d65 tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "cinder-quobyte-44e67452-6317-4ed4-a3f9-4a8d8eabcfc5" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:49:28 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-edc1cd40-0daa-476a-9168-58915d1c7d65 tempest-VolumesSnapshotTestJSON-2116537629 None] Acquiring lock "cinder-quobyte-62447139-d4c5-4cc3-80df-24b425c0a17f" by "_delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:49:28 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-edc1cd40-0daa-476a-9168-58915d1c7d65 tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "cinder-quobyte-62447139-d4c5-4cc3-80df-24b425c0a17f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:49:28 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-edc1cd40-0daa-476a-9168-58915d1c7d65 tempest-VolumesSnapshotTestJSON-2116537629 None] Deleting offline snapshot 62447139-d4c5-4cc3-80df-24b425c0a17f of volume 44e67452-6317-4ed4-a3f9-4a8d8eabcfc5 {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 21:49:28 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-edc1cd40-0daa-476a-9168-58915d1c7d65 tempest-VolumesSnapshotTestJSON-2116537629 None] snapshot_file for this snap is: volume-44e67452-6317-4ed4-a3f9-4a8d8eabcfc5.62447139-d4c5-4cc3-80df-24b425c0a17f {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 21:49:28 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d79406c-4567-4d39-933f-611a9b54229f]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:49:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-edc1cd40-0daa-476a-9168-58915d1c7d65 tempest-VolumesSnapshotTestJSON-2116537629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-44e67452-6317-4ed4-a3f9-4a8d8eabcfc5.62447139-d4c5-4cc3-80df-24b425c0a17f {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:28 devstack sudo[103484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-44e67452-6317-4ed4-a3f9-4a8d8eabcfc5.62447139-d4c5-4cc3-80df-24b425c0a17f Sep 18 21:49:28 devstack sudo[103484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:28 devstack sudo[103484]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-edc1cd40-0daa-476a-9168-58915d1c7d65 tempest-VolumesSnapshotTestJSON-2116537629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-44e67452-6317-4ed4-a3f9-4a8d8eabcfc5.62447139-d4c5-4cc3-80df-24b425c0a17f" returned: 0 in 0.383s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:28 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-edc1cd40-0daa-476a-9168-58915d1c7d65 tempest-VolumesSnapshotTestJSON-2116537629 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44e67452-6317-4ed4-a3f9-4a8d8eabcfc5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86136) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 21:49:28 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2605ce4-0bde-4ae5-bd49-e2d8cb9d1997]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:49:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-edc1cd40-0daa-476a-9168-58915d1c7d65 tempest-VolumesSnapshotTestJSON-2116537629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-44e67452-6317-4ed4-a3f9-4a8d8eabcfc5 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:28 devstack sudo[103489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-44e67452-6317-4ed4-a3f9-4a8d8eabcfc5 Sep 18 21:49:28 devstack sudo[103489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:28 devstack sudo[103489]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-edc1cd40-0daa-476a-9168-58915d1c7d65 tempest-VolumesSnapshotTestJSON-2116537629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-44e67452-6317-4ed4-a3f9-4a8d8eabcfc5" returned: 0 in 0.377s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-edc1cd40-0daa-476a-9168-58915d1c7d65 tempest-VolumesSnapshotTestJSON-2116537629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-44e67452-6317-4ed4-a3f9-4a8d8eabcfc5.62447139-d4c5-4cc3-80df-24b425c0a17f {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:29 devstack sudo[103494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-44e67452-6317-4ed4-a3f9-4a8d8eabcfc5.62447139-d4c5-4cc3-80df-24b425c0a17f Sep 18 21:49:29 devstack sudo[103494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:29 devstack sudo[103494]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-edc1cd40-0daa-476a-9168-58915d1c7d65 tempest-VolumesSnapshotTestJSON-2116537629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-44e67452-6317-4ed4-a3f9-4a8d8eabcfc5.62447139-d4c5-4cc3-80df-24b425c0a17f" returned: 0 in 0.348s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-edc1cd40-0daa-476a-9168-58915d1c7d65 tempest-VolumesSnapshotTestJSON-2116537629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-44e67452-6317-4ed4-a3f9-4a8d8eabcfc5.62447139-d4c5-4cc3-80df-24b425c0a17f {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:29 devstack sudo[103499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-44e67452-6317-4ed4-a3f9-4a8d8eabcfc5.62447139-d4c5-4cc3-80df-24b425c0a17f Sep 18 21:49:29 devstack sudo[103499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:29 devstack sudo[103499]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-edc1cd40-0daa-476a-9168-58915d1c7d65 tempest-VolumesSnapshotTestJSON-2116537629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-44e67452-6317-4ed4-a3f9-4a8d8eabcfc5.62447139-d4c5-4cc3-80df-24b425c0a17f" returned: 0 in 0.263s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:29 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-edc1cd40-0daa-476a-9168-58915d1c7d65 tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "cinder-quobyte-62447139-d4c5-4cc3-80df-24b425c0a17f" released by "_delete_snapshot" :: held 1.495s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:49:29 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-edc1cd40-0daa-476a-9168-58915d1c7d65 tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "cinder-quobyte-44e67452-6317-4ed4-a3f9-4a8d8eabcfc5" released by "delete_snapshot" :: held 1.520s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:49:29 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-edc1cd40-0daa-476a-9168-58915d1c7d65 tempest-VolumesSnapshotTestJSON-2116537629 None] Created reservations ['9b11263a-9ef5-4268-b01d-fad5a63e6e1b', '6498928a-5118-4b9e-9a57-d7b0a3ae5e8e', '17c03110-4e10-4bf7-bc1b-c2b0ad796240', '9fdb4566-728c-4314-8969-2e71d6175dce'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:49:29 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-edc1cd40-0daa-476a-9168-58915d1c7d65 tempest-VolumesSnapshotTestJSON-2116537629 None] Delete snapshot completed successfully. Sep 18 21:49:29 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-edc1cd40-0daa-476a-9168-58915d1c7d65 tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "cinder-62447139-d4c5-4cc3-80df-24b425c0a17f-delete_snapshot" released by "delete_snapshot" :: held 1.704s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:49:30 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3c4e346-9ac0-4ff2-b8c8-c31d3af5a7f4 tempest-VolumesSnapshotTestJSON-2116537629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:49:30 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-a3c4e346-9ac0-4ff2-b8c8-c31d3af5a7f4 tempest-VolumesSnapshotTestJSON-2116537629 None] Flow 'volume_create_manager' (a313cca2-a26b-4325-a3d0-a885837efdb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:49:30 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-a3c4e346-9ac0-4ff2-b8c8-c31d3af5a7f4 tempest-VolumesSnapshotTestJSON-2116537629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (089f5893-95d4-4f7c-a430-b14d562b7d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:49:30 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-a3c4e346-9ac0-4ff2-b8c8-c31d3af5a7f4 tempest-VolumesSnapshotTestJSON-2116537629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (089f5893-95d4-4f7c-a430-b14d562b7d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:49:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-906517380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8e1b8b6-4168-4074-b922-c37788ca28a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56bc1d47940d4119a14cf1970728710e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:49:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:49:31Z,use_quota=True,user_id='8ace514290c84ec1a763bcbe1fade50d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:49:30 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-a3c4e346-9ac0-4ff2-b8c8-c31d3af5a7f4 tempest-VolumesSnapshotTestJSON-2116537629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d1e7658-e314-423b-a5db-03c03cb45362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:49:30 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-a3c4e346-9ac0-4ff2-b8c8-c31d3af5a7f4 tempest-VolumesSnapshotTestJSON-2116537629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d1e7658-e314-423b-a5db-03c03cb45362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:49:30 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-a3c4e346-9ac0-4ff2-b8c8-c31d3af5a7f4 tempest-VolumesSnapshotTestJSON-2116537629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3d8b9ef-de26-4640-8d24-d0434b2640c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:49:30 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-a3c4e346-9ac0-4ff2-b8c8-c31d3af5a7f4 tempest-VolumesSnapshotTestJSON-2116537629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3d8b9ef-de26-4640-8d24-d0434b2640c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8e1b8b6-4168-4074-b922-c37788ca28a5', 'volume_name': 'volume-b8e1b8b6-4168-4074-b922-c37788ca28a5', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:49:30 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-a3c4e346-9ac0-4ff2-b8c8-c31d3af5a7f4 tempest-VolumesSnapshotTestJSON-2116537629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c1381c9-2c03-4415-8d63-fecac8ea32c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:49:30 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-a3c4e346-9ac0-4ff2-b8c8-c31d3af5a7f4 tempest-VolumesSnapshotTestJSON-2116537629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c1381c9-2c03-4415-8d63-fecac8ea32c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:49:30 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-a3c4e346-9ac0-4ff2-b8c8-c31d3af5a7f4 tempest-VolumesSnapshotTestJSON-2116537629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4158c6e9-a762-4c4a-b76d-9e8a2b6d1d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:49:30 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-a3c4e346-9ac0-4ff2-b8c8-c31d3af5a7f4 tempest-VolumesSnapshotTestJSON-2116537629 None] Volume b8e1b8b6-4168-4074-b922-c37788ca28a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8e1b8b6-4168-4074-b922-c37788ca28a5', 'volume_size': 1} Sep 18 21:49:30 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-a3c4e346-9ac0-4ff2-b8c8-c31d3af5a7f4 tempest-VolumesSnapshotTestJSON-2116537629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:49:30 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-a3c4e346-9ac0-4ff2-b8c8-c31d3af5a7f4 tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:49:30 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-a3c4e346-9ac0-4ff2-b8c8-c31d3af5a7f4 tempest-VolumesSnapshotTestJSON-2116537629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:49:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-906517380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8e1b8b6-4168-4074-b922-c37788ca28a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56bc1d47940d4119a14cf1970728710e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:49:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:49:31Z,use_quota=True,user_id='8ace514290c84ec1a763bcbe1fade50d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:49:30 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-a3c4e346-9ac0-4ff2-b8c8-c31d3af5a7f4 tempest-VolumesSnapshotTestJSON-2116537629 None] Creating volume b8e1b8b6-4168-4074-b922-c37788ca28a5 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:49:30 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-a3c4e346-9ac0-4ff2-b8c8-c31d3af5a7f4 tempest-VolumesSnapshotTestJSON-2116537629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:49:30 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-a3c4e346-9ac0-4ff2-b8c8-c31d3af5a7f4 tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:49:30 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-a3c4e346-9ac0-4ff2-b8c8-c31d3af5a7f4 tempest-VolumesSnapshotTestJSON-2116537629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:49:30 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-a3c4e346-9ac0-4ff2-b8c8-c31d3af5a7f4 tempest-VolumesSnapshotTestJSON-2116537629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:49:30 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-a3c4e346-9ac0-4ff2-b8c8-c31d3af5a7f4 tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:49:30 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-a3c4e346-9ac0-4ff2-b8c8-c31d3af5a7f4 tempest-VolumesSnapshotTestJSON-2116537629 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:49:30 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-a3c4e346-9ac0-4ff2-b8c8-c31d3af5a7f4 tempest-VolumesSnapshotTestJSON-2116537629 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:49:30 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-a3c4e346-9ac0-4ff2-b8c8-c31d3af5a7f4 tempest-VolumesSnapshotTestJSON-2116537629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b8e1b8b6-4168-4074-b922-c37788ca28a5 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:30 devstack sudo[103503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b8e1b8b6-4168-4074-b922-c37788ca28a5 1073741824 Sep 18 21:49:30 devstack sudo[103503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:31 devstack sudo[103503]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-a3c4e346-9ac0-4ff2-b8c8-c31d3af5a7f4 tempest-VolumesSnapshotTestJSON-2116537629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b8e1b8b6-4168-4074-b922-c37788ca28a5 1073741824" returned: 0 in 0.490s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-a3c4e346-9ac0-4ff2-b8c8-c31d3af5a7f4 tempest-VolumesSnapshotTestJSON-2116537629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b8e1b8b6-4168-4074-b922-c37788ca28a5 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:31 devstack sudo[103509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b8e1b8b6-4168-4074-b922-c37788ca28a5 Sep 18 21:49:31 devstack sudo[103509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:31 devstack sudo[103509]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-a3c4e346-9ac0-4ff2-b8c8-c31d3af5a7f4 tempest-VolumesSnapshotTestJSON-2116537629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b8e1b8b6-4168-4074-b922-c37788ca28a5" returned: 0 in 0.282s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:31 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-a3c4e346-9ac0-4ff2-b8c8-c31d3af5a7f4 tempest-VolumesSnapshotTestJSON-2116537629 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:49:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-a3c4e346-9ac0-4ff2-b8c8-c31d3af5a7f4 tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:49:31 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-a3c4e346-9ac0-4ff2-b8c8-c31d3af5a7f4 tempest-VolumesSnapshotTestJSON-2116537629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4158c6e9-a762-4c4a-b76d-9e8a2b6d1d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8e1b8b6-4168-4074-b922-c37788ca28a5', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:49:31 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-a3c4e346-9ac0-4ff2-b8c8-c31d3af5a7f4 tempest-VolumesSnapshotTestJSON-2116537629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adbe7366-e54f-405f-ab04-4c1397823345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:49:31 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-a3c4e346-9ac0-4ff2-b8c8-c31d3af5a7f4 tempest-VolumesSnapshotTestJSON-2116537629 None] Volume volume-b8e1b8b6-4168-4074-b922-c37788ca28a5 (b8e1b8b6-4168-4074-b922-c37788ca28a5): created successfully Sep 18 21:49:31 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-a3c4e346-9ac0-4ff2-b8c8-c31d3af5a7f4 tempest-VolumesSnapshotTestJSON-2116537629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adbe7366-e54f-405f-ab04-4c1397823345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:49:31 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-a3c4e346-9ac0-4ff2-b8c8-c31d3af5a7f4 tempest-VolumesSnapshotTestJSON-2116537629 None] Flow 'volume_create_manager' (a313cca2-a26b-4325-a3d0-a885837efdb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:49:31 devstack cinder-volume[86136]: DEBUG dbcounter [-] [86136] Writing DB stats cinder:UPDATE=275,cinder:SELECT=181,cinder:INSERT=68,cinder:DELETE=25 {{(pid=86136) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 21:49:31 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-a3c4e346-9ac0-4ff2-b8c8-c31d3af5a7f4 tempest-VolumesSnapshotTestJSON-2116537629 None] Created volume successfully. Sep 18 21:49:31 devstack cinder-volume[86136]: DEBUG dbcounter [-] [86136] Writing DB stats cinder:UPDATE=247,cinder:SELECT=195,cinder:INSERT=66,cinder:DELETE=22 {{(pid=86136) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 21:49:33 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-983157aa-b1e4-46e5-938c-0443da5ceb7c tempest-VolumesSnapshotTestJSON-2116537629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:49:33 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-983157aa-b1e4-46e5-938c-0443da5ceb7c tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:49:33 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-983157aa-b1e4-46e5-938c-0443da5ceb7c tempest-VolumesSnapshotTestJSON-2116537629 None] Creating offline snapshot 26b60afd-2e7e-41fe-b1df-f90764b798c7 of volume b8e1b8b6-4168-4074-b922-c37788ca28a5 {{(pid=86136) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 21:49:33 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa8bcb1-60db-46e6-ab13-fc44d45be6f0]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:49:33 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-983157aa-b1e4-46e5-938c-0443da5ceb7c tempest-VolumesSnapshotTestJSON-2116537629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b8e1b8b6-4168-4074-b922-c37788ca28a5 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:33 devstack sudo[103512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b8e1b8b6-4168-4074-b922-c37788ca28a5 Sep 18 21:49:33 devstack sudo[103512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:33 devstack sudo[103512]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:33 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-983157aa-b1e4-46e5-938c-0443da5ceb7c tempest-VolumesSnapshotTestJSON-2116537629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b8e1b8b6-4168-4074-b922-c37788ca28a5" returned: 0 in 0.395s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:33 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-983157aa-b1e4-46e5-938c-0443da5ceb7c tempest-VolumesSnapshotTestJSON-2116537629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b8e1b8b6-4168-4074-b922-c37788ca28a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b8e1b8b6-4168-4074-b922-c37788ca28a5.26b60afd-2e7e-41fe-b1df-f90764b798c7 1G {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:33 devstack sudo[103517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b8e1b8b6-4168-4074-b922-c37788ca28a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b8e1b8b6-4168-4074-b922-c37788ca28a5.26b60afd-2e7e-41fe-b1df-f90764b798c7 1G Sep 18 21:49:33 devstack sudo[103517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:33 devstack sudo[103517]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:33 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-983157aa-b1e4-46e5-938c-0443da5ceb7c tempest-VolumesSnapshotTestJSON-2116537629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b8e1b8b6-4168-4074-b922-c37788ca28a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b8e1b8b6-4168-4074-b922-c37788ca28a5.26b60afd-2e7e-41fe-b1df-f90764b798c7 1G" returned: 0 in 0.413s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:33 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-983157aa-b1e4-46e5-938c-0443da5ceb7c tempest-VolumesSnapshotTestJSON-2116537629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8e1b8b6-4168-4074-b922-c37788ca28a5 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b8e1b8b6-4168-4074-b922-c37788ca28a5.26b60afd-2e7e-41fe-b1df-f90764b798c7 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:33 devstack sudo[103523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8e1b8b6-4168-4074-b922-c37788ca28a5 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b8e1b8b6-4168-4074-b922-c37788ca28a5.26b60afd-2e7e-41fe-b1df-f90764b798c7 Sep 18 21:49:33 devstack sudo[103523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:34 devstack sudo[103523]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:34 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-983157aa-b1e4-46e5-938c-0443da5ceb7c tempest-VolumesSnapshotTestJSON-2116537629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8e1b8b6-4168-4074-b922-c37788ca28a5 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b8e1b8b6-4168-4074-b922-c37788ca28a5.26b60afd-2e7e-41fe-b1df-f90764b798c7" returned: 0 in 0.345s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:34 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-983157aa-b1e4-46e5-938c-0443da5ceb7c tempest-VolumesSnapshotTestJSON-2116537629 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b8e1b8b6-4168-4074-b922-c37788ca28a5.26b60afd-2e7e-41fe-b1df-f90764b798c7 is being set with open permissions: ugo+rw Sep 18 21:49:34 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-983157aa-b1e4-46e5-938c-0443da5ceb7c tempest-VolumesSnapshotTestJSON-2116537629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b8e1b8b6-4168-4074-b922-c37788ca28a5.26b60afd-2e7e-41fe-b1df-f90764b798c7 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:34 devstack sudo[103529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b8e1b8b6-4168-4074-b922-c37788ca28a5.26b60afd-2e7e-41fe-b1df-f90764b798c7 Sep 18 21:49:34 devstack sudo[103529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:34 devstack sudo[103529]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:34 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-983157aa-b1e4-46e5-938c-0443da5ceb7c tempest-VolumesSnapshotTestJSON-2116537629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b8e1b8b6-4168-4074-b922-c37788ca28a5.26b60afd-2e7e-41fe-b1df-f90764b798c7" returned: 0 in 0.315s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:34 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-983157aa-b1e4-46e5-938c-0443da5ceb7c tempest-VolumesSnapshotTestJSON-2116537629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b8e1b8b6-4168-4074-b922-c37788ca28a5.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:34 devstack sudo[103532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b8e1b8b6-4168-4074-b922-c37788ca28a5.info Sep 18 21:49:34 devstack sudo[103532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:34 devstack sudo[103532]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:34 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-983157aa-b1e4-46e5-938c-0443da5ceb7c tempest-VolumesSnapshotTestJSON-2116537629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b8e1b8b6-4168-4074-b922-c37788ca28a5.info" returned: 0 in 0.266s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:34 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-983157aa-b1e4-46e5-938c-0443da5ceb7c tempest-VolumesSnapshotTestJSON-2116537629 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b8e1b8b6-4168-4074-b922-c37788ca28a5.info is being set with open permissions: ugo+rw Sep 18 21:49:34 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-983157aa-b1e4-46e5-938c-0443da5ceb7c tempest-VolumesSnapshotTestJSON-2116537629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b8e1b8b6-4168-4074-b922-c37788ca28a5.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:34 devstack sudo[103535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b8e1b8b6-4168-4074-b922-c37788ca28a5.info Sep 18 21:49:34 devstack sudo[103535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:35 devstack sudo[103535]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:35 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-983157aa-b1e4-46e5-938c-0443da5ceb7c tempest-VolumesSnapshotTestJSON-2116537629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b8e1b8b6-4168-4074-b922-c37788ca28a5.info" returned: 0 in 0.289s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:35 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-983157aa-b1e4-46e5-938c-0443da5ceb7c tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.127s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:49:35 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-983157aa-b1e4-46e5-938c-0443da5ceb7c tempest-VolumesSnapshotTestJSON-2116537629 None] Create snapshot completed successfully Sep 18 21:49:36 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-748654b6-3862-4ec8-87ed-e3a4e73f5bcb tempest-VolumesSnapshotTestJSON-2116537629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:49:36 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-748654b6-3862-4ec8-87ed-e3a4e73f5bcb tempest-VolumesSnapshotTestJSON-2116537629 None] Flow 'volume_create_manager' (f543e5e1-6a54-4702-abe4-c4e7c141de95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:49:36 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-748654b6-3862-4ec8-87ed-e3a4e73f5bcb tempest-VolumesSnapshotTestJSON-2116537629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19865034-d2bc-44c3-9e1c-74cdd3eea5b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:49:36 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-748654b6-3862-4ec8-87ed-e3a4e73f5bcb tempest-VolumesSnapshotTestJSON-2116537629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19865034-d2bc-44c3-9e1c-74cdd3eea5b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:49:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1934539948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1543fbef-c56b-4fa7-8a88-4687f0cbbb8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56bc1d47940d4119a14cf1970728710e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:49:37Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=26b60afd-2e7e-41fe-b1df-f90764b798c7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:49:37Z,use_quota=True,user_id='8ace514290c84ec1a763bcbe1fade50d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:49:36 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-748654b6-3862-4ec8-87ed-e3a4e73f5bcb tempest-VolumesSnapshotTestJSON-2116537629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddfb263a-4b44-49ed-b4bd-5946f24bb4d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:49:36 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-748654b6-3862-4ec8-87ed-e3a4e73f5bcb tempest-VolumesSnapshotTestJSON-2116537629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddfb263a-4b44-49ed-b4bd-5946f24bb4d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:49:36 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-748654b6-3862-4ec8-87ed-e3a4e73f5bcb tempest-VolumesSnapshotTestJSON-2116537629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44dc764b-92f3-43f4-a0e6-fb35e69a6f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:49:36 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-748654b6-3862-4ec8-87ed-e3a4e73f5bcb tempest-VolumesSnapshotTestJSON-2116537629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44dc764b-92f3-43f4-a0e6-fb35e69a6f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1543fbef-c56b-4fa7-8a88-4687f0cbbb8e', 'volume_name': 'volume-1543fbef-c56b-4fa7-8a88-4687f0cbbb8e', 'volume_size': 2, 'snapshot_id': '26b60afd-2e7e-41fe-b1df-f90764b798c7'}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:49:36 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-748654b6-3862-4ec8-87ed-e3a4e73f5bcb tempest-VolumesSnapshotTestJSON-2116537629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca77c544-fce8-4b1f-8bd1-eb6b43df2efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:49:36 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-748654b6-3862-4ec8-87ed-e3a4e73f5bcb tempest-VolumesSnapshotTestJSON-2116537629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca77c544-fce8-4b1f-8bd1-eb6b43df2efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:49:36 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-748654b6-3862-4ec8-87ed-e3a4e73f5bcb tempest-VolumesSnapshotTestJSON-2116537629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8000d2ed-91d5-49c6-8880-10d5e97c917f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:49:36 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-748654b6-3862-4ec8-87ed-e3a4e73f5bcb tempest-VolumesSnapshotTestJSON-2116537629 None] Volume 1543fbef-c56b-4fa7-8a88-4687f0cbbb8e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1543fbef-c56b-4fa7-8a88-4687f0cbbb8e', 'volume_size': 2, 'snapshot_id': '26b60afd-2e7e-41fe-b1df-f90764b798c7'} Sep 18 21:49:36 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-748654b6-3862-4ec8-87ed-e3a4e73f5bcb tempest-VolumesSnapshotTestJSON-2116537629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:49:36 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-748654b6-3862-4ec8-87ed-e3a4e73f5bcb tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:49:36 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-748654b6-3862-4ec8-87ed-e3a4e73f5bcb tempest-VolumesSnapshotTestJSON-2116537629 None] Acquiring lock "cinder-quobyte-26b60afd-2e7e-41fe-b1df-f90764b798c7-1543fbef-c56b-4fa7-8a88-4687f0cbbb8e" by "_create_volume_from_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:49:36 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-748654b6-3862-4ec8-87ed-e3a4e73f5bcb tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "cinder-quobyte-26b60afd-2e7e-41fe-b1df-f90764b798c7-1543fbef-c56b-4fa7-8a88-4687f0cbbb8e" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:49:36 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-748654b6-3862-4ec8-87ed-e3a4e73f5bcb tempest-VolumesSnapshotTestJSON-2116537629 None] Creating volume 1543fbef-c56b-4fa7-8a88-4687f0cbbb8e from snapshot 26b60afd-2e7e-41fe-b1df-f90764b798c7 {{(pid=86136) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 18 21:49:36 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-748654b6-3862-4ec8-87ed-e3a4e73f5bcb tempest-VolumesSnapshotTestJSON-2116537629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:49:36 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-748654b6-3862-4ec8-87ed-e3a4e73f5bcb tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:49:36 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-748654b6-3862-4ec8-87ed-e3a4e73f5bcb tempest-VolumesSnapshotTestJSON-2116537629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:49:36 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-748654b6-3862-4ec8-87ed-e3a4e73f5bcb tempest-VolumesSnapshotTestJSON-2116537629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:49:36 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-748654b6-3862-4ec8-87ed-e3a4e73f5bcb tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:49:36 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-748654b6-3862-4ec8-87ed-e3a4e73f5bcb tempest-VolumesSnapshotTestJSON-2116537629 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:49:36 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-748654b6-3862-4ec8-87ed-e3a4e73f5bcb tempest-VolumesSnapshotTestJSON-2116537629 None] Acquiring lock "cinder-quobyte-1543fbef-c56b-4fa7-8a88-4687f0cbbb8e" by "_copy_volume_from_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:49:36 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-748654b6-3862-4ec8-87ed-e3a4e73f5bcb tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "cinder-quobyte-1543fbef-c56b-4fa7-8a88-4687f0cbbb8e" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:49:36 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-748654b6-3862-4ec8-87ed-e3a4e73f5bcb tempest-VolumesSnapshotTestJSON-2116537629 None] snapshot: 26b60afd-2e7e-41fe-b1df-f90764b798c7, volume: 1543fbef-c56b-4fa7-8a88-4687f0cbbb8e, {{(pid=86136) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 18 21:49:36 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-748654b6-3862-4ec8-87ed-e3a4e73f5bcb tempest-VolumesSnapshotTestJSON-2116537629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:49:36 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-748654b6-3862-4ec8-87ed-e3a4e73f5bcb tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:49:36 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-748654b6-3862-4ec8-87ed-e3a4e73f5bcb tempest-VolumesSnapshotTestJSON-2116537629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:49:36 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-748654b6-3862-4ec8-87ed-e3a4e73f5bcb tempest-VolumesSnapshotTestJSON-2116537629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:49:36 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-748654b6-3862-4ec8-87ed-e3a4e73f5bcb tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:49:36 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e1d4cf-5274-4557-bcd5-30f64f0be7f8]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:49:36 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-748654b6-3862-4ec8-87ed-e3a4e73f5bcb tempest-VolumesSnapshotTestJSON-2116537629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b8e1b8b6-4168-4074-b922-c37788ca28a5.26b60afd-2e7e-41fe-b1df-f90764b798c7 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:37 devstack sudo[103538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b8e1b8b6-4168-4074-b922-c37788ca28a5.26b60afd-2e7e-41fe-b1df-f90764b798c7 Sep 18 21:49:37 devstack sudo[103538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:37 devstack sudo[103538]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:37 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-748654b6-3862-4ec8-87ed-e3a4e73f5bcb tempest-VolumesSnapshotTestJSON-2116537629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b8e1b8b6-4168-4074-b922-c37788ca28a5.26b60afd-2e7e-41fe-b1df-f90764b798c7" returned: 0 in 0.416s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:37 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-748654b6-3862-4ec8-87ed-e3a4e73f5bcb tempest-VolumesSnapshotTestJSON-2116537629 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b8e1b8b6-4168-4074-b922-c37788ca28a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86136) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 21:49:37 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[44eec579-8908-476e-bb9a-8d3a696afa89]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:49:37 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-748654b6-3862-4ec8-87ed-e3a4e73f5bcb tempest-VolumesSnapshotTestJSON-2116537629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b8e1b8b6-4168-4074-b922-c37788ca28a5 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:37 devstack sudo[103544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b8e1b8b6-4168-4074-b922-c37788ca28a5 Sep 18 21:49:37 devstack sudo[103544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:37 devstack sudo[103544]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:37 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-748654b6-3862-4ec8-87ed-e3a4e73f5bcb tempest-VolumesSnapshotTestJSON-2116537629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b8e1b8b6-4168-4074-b922-c37788ca28a5" returned: 0 in 0.401s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:37 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-748654b6-3862-4ec8-87ed-e3a4e73f5bcb tempest-VolumesSnapshotTestJSON-2116537629 None] will copy from snapshot at /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b8e1b8b6-4168-4074-b922-c37788ca28a5 {{(pid=86136) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 18 21:49:37 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-748654b6-3862-4ec8-87ed-e3a4e73f5bcb tempest-VolumesSnapshotTestJSON-2116537629 None] Creating direct copy from snapshot {{(pid=86136) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 18 21:49:37 devstack cinder-volume[86136]: DEBUG cinder.utils [None req-748654b6-3862-4ec8-87ed-e3a4e73f5bcb tempest-VolumesSnapshotTestJSON-2116537629 None] Path /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-1543fbef-c56b-4fa7-8a88-4687f0cbbb8e not found in is_blk_device check {{(pid=86136) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 18 21:49:37 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-748654b6-3862-4ec8-87ed-e3a4e73f5bcb tempest-VolumesSnapshotTestJSON-2116537629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b8e1b8b6-4168-4074-b922-c37788ca28a5 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-1543fbef-c56b-4fa7-8a88-4687f0cbbb8e {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:37 devstack sudo[103549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b8e1b8b6-4168-4074-b922-c37788ca28a5 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-1543fbef-c56b-4fa7-8a88-4687f0cbbb8e Sep 18 21:49:37 devstack sudo[103549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:45 devstack sudo[103549]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:45 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-748654b6-3862-4ec8-87ed-e3a4e73f5bcb tempest-VolumesSnapshotTestJSON-2116537629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b8e1b8b6-4168-4074-b922-c37788ca28a5 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-1543fbef-c56b-4fa7-8a88-4687f0cbbb8e" returned: 0 in 7.391s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:45 devstack cinder-volume[86136]: DEBUG cinder.image.image_utils [None req-748654b6-3862-4ec8-87ed-e3a4e73f5bcb tempest-VolumesSnapshotTestJSON-2116537629 None] Image conversion details: src /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b8e1b8b6-4168-4074-b922-c37788ca28a5, size 1024.00 MB, duration 7.39 sec, destination /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-1543fbef-c56b-4fa7-8a88-4687f0cbbb8e {{(pid=86136) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 18 21:49:45 devstack cinder-volume[86136]: INFO cinder.image.image_utils [None req-748654b6-3862-4ec8-87ed-e3a4e73f5bcb tempest-VolumesSnapshotTestJSON-2116537629 None] Converted 1024.00 MB image at 138.52 MB/s Sep 18 21:49:45 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-748654b6-3862-4ec8-87ed-e3a4e73f5bcb tempest-VolumesSnapshotTestJSON-2116537629 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-1543fbef-c56b-4fa7-8a88-4687f0cbbb8e is being set with open permissions: ugo+rw Sep 18 21:49:45 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-748654b6-3862-4ec8-87ed-e3a4e73f5bcb tempest-VolumesSnapshotTestJSON-2116537629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-1543fbef-c56b-4fa7-8a88-4687f0cbbb8e {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:45 devstack sudo[103564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-1543fbef-c56b-4fa7-8a88-4687f0cbbb8e Sep 18 21:49:45 devstack sudo[103564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:45 devstack sudo[103564]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:45 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-748654b6-3862-4ec8-87ed-e3a4e73f5bcb tempest-VolumesSnapshotTestJSON-2116537629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-1543fbef-c56b-4fa7-8a88-4687f0cbbb8e" returned: 0 in 0.259s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:45 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-748654b6-3862-4ec8-87ed-e3a4e73f5bcb tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "cinder-quobyte-1543fbef-c56b-4fa7-8a88-4687f0cbbb8e" released by "_copy_volume_from_snapshot" :: held 8.573s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:49:45 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-748654b6-3862-4ec8-87ed-e3a4e73f5bcb tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "cinder-quobyte-26b60afd-2e7e-41fe-b1df-f90764b798c7-1543fbef-c56b-4fa7-8a88-4687f0cbbb8e" released by "_create_volume_from_snapshot" :: held 8.674s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:49:45 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-748654b6-3862-4ec8-87ed-e3a4e73f5bcb tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.690s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:49:45 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-748654b6-3862-4ec8-87ed-e3a4e73f5bcb tempest-VolumesSnapshotTestJSON-2116537629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8000d2ed-91d5-49c6-8880-10d5e97c917f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1543fbef-c56b-4fa7-8a88-4687f0cbbb8e', 'volume_size': 2, 'snapshot_id': '26b60afd-2e7e-41fe-b1df-f90764b798c7'}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:49:45 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-748654b6-3862-4ec8-87ed-e3a4e73f5bcb tempest-VolumesSnapshotTestJSON-2116537629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53fba963-8b58-432a-8e8a-590603763c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:49:45 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-748654b6-3862-4ec8-87ed-e3a4e73f5bcb tempest-VolumesSnapshotTestJSON-2116537629 None] Volume volume-1543fbef-c56b-4fa7-8a88-4687f0cbbb8e (1543fbef-c56b-4fa7-8a88-4687f0cbbb8e): created successfully Sep 18 21:49:45 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-748654b6-3862-4ec8-87ed-e3a4e73f5bcb tempest-VolumesSnapshotTestJSON-2116537629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53fba963-8b58-432a-8e8a-590603763c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:49:45 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-748654b6-3862-4ec8-87ed-e3a4e73f5bcb tempest-VolumesSnapshotTestJSON-2116537629 None] Flow 'volume_create_manager' (f543e5e1-6a54-4702-abe4-c4e7c141de95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:49:45 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-748654b6-3862-4ec8-87ed-e3a4e73f5bcb tempest-VolumesSnapshotTestJSON-2116537629 None] Created volume successfully. Sep 18 21:49:46 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-b605c131-076b-4322-8e7f-f9c5934f8c58 tempest-VolumesSnapshotTestJSON-2116537629 None] Acquiring lock "cinder-1543fbef-c56b-4fa7-8a88-4687f0cbbb8e-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:49:46 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-b605c131-076b-4322-8e7f-f9c5934f8c58 tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "cinder-1543fbef-c56b-4fa7-8a88-4687f0cbbb8e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:49:46 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-b605c131-076b-4322-8e7f-f9c5934f8c58 tempest-VolumesSnapshotTestJSON-2116537629 None] Acquiring lock "cinder-quobyte-1543fbef-c56b-4fa7-8a88-4687f0cbbb8e" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:49:46 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-b605c131-076b-4322-8e7f-f9c5934f8c58 tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "cinder-quobyte-1543fbef-c56b-4fa7-8a88-4687f0cbbb8e" acquired by "delete_volume" :: waited 0.015s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:49:46 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a1ebd2-6ccf-4466-a4c8-9d683f03a64b]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:49:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-b605c131-076b-4322-8e7f-f9c5934f8c58 tempest-VolumesSnapshotTestJSON-2116537629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-1543fbef-c56b-4fa7-8a88-4687f0cbbb8e {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:46 devstack sudo[103568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-1543fbef-c56b-4fa7-8a88-4687f0cbbb8e Sep 18 21:49:46 devstack sudo[103568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:47 devstack sudo[103568]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:47 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-b605c131-076b-4322-8e7f-f9c5934f8c58 tempest-VolumesSnapshotTestJSON-2116537629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-1543fbef-c56b-4fa7-8a88-4687f0cbbb8e" returned: 0 in 0.383s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:47 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-b605c131-076b-4322-8e7f-f9c5934f8c58 tempest-VolumesSnapshotTestJSON-2116537629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-1543fbef-c56b-4fa7-8a88-4687f0cbbb8e {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:47 devstack sudo[103574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-1543fbef-c56b-4fa7-8a88-4687f0cbbb8e Sep 18 21:49:47 devstack sudo[103574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:47 devstack sudo[103574]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:47 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-b605c131-076b-4322-8e7f-f9c5934f8c58 tempest-VolumesSnapshotTestJSON-2116537629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-1543fbef-c56b-4fa7-8a88-4687f0cbbb8e" returned: 0 in 0.268s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:47 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-b605c131-076b-4322-8e7f-f9c5934f8c58 tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "cinder-quobyte-1543fbef-c56b-4fa7-8a88-4687f0cbbb8e" released by "delete_volume" :: held 0.697s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:49:47 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-b605c131-076b-4322-8e7f-f9c5934f8c58 tempest-VolumesSnapshotTestJSON-2116537629 None] Created reservations ['bd926f3c-301e-4272-ab4c-8667eb03e0b5', '719a0e82-d57d-4531-a5ca-89742f5b9a43', '49661c3f-ff61-4f02-b933-a2c361c78f40', 'a0d23463-3ca9-4d19-bbfe-f36dc316a5a7'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:49:47 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-b605c131-076b-4322-8e7f-f9c5934f8c58 tempest-VolumesSnapshotTestJSON-2116537629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:49:47 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-b605c131-076b-4322-8e7f-f9c5934f8c58 tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:49:47 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-b605c131-076b-4322-8e7f-f9c5934f8c58 tempest-VolumesSnapshotTestJSON-2116537629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:49:47 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-b605c131-076b-4322-8e7f-f9c5934f8c58 tempest-VolumesSnapshotTestJSON-2116537629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:49:47 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-b605c131-076b-4322-8e7f-f9c5934f8c58 tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:49:47 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-b605c131-076b-4322-8e7f-f9c5934f8c58 tempest-VolumesSnapshotTestJSON-2116537629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:47 devstack sudo[103577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:49:47 devstack sudo[103577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:47 devstack sudo[103577]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:47 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-b605c131-076b-4322-8e7f-f9c5934f8c58 tempest-VolumesSnapshotTestJSON-2116537629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.276s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:47 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-b605c131-076b-4322-8e7f-f9c5934f8c58 tempest-VolumesSnapshotTestJSON-2116537629 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:49:47 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-b605c131-076b-4322-8e7f-f9c5934f8c58 tempest-VolumesSnapshotTestJSON-2116537629 None] Deleted volume successfully. Sep 18 21:49:47 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-65ae7642-7c29-45a5-bc2b-3a5c47712156 tempest-VolumesSnapshotTestJSON-2116537629 None] Acquiring lock "cinder-26b60afd-2e7e-41fe-b1df-f90764b798c7-delete_snapshot" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:49:48 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-65ae7642-7c29-45a5-bc2b-3a5c47712156 tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "cinder-26b60afd-2e7e-41fe-b1df-f90764b798c7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:49:48 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-65ae7642-7c29-45a5-bc2b-3a5c47712156 tempest-VolumesSnapshotTestJSON-2116537629 None] Acquiring lock "cinder-quobyte-b8e1b8b6-4168-4074-b922-c37788ca28a5" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:49:48 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-b605c131-076b-4322-8e7f-f9c5934f8c58 tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "cinder-1543fbef-c56b-4fa7-8a88-4687f0cbbb8e-delete_volume" released by "delete_volume" :: held 1.243s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:49:48 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-65ae7642-7c29-45a5-bc2b-3a5c47712156 tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "cinder-quobyte-b8e1b8b6-4168-4074-b922-c37788ca28a5" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:49:48 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-65ae7642-7c29-45a5-bc2b-3a5c47712156 tempest-VolumesSnapshotTestJSON-2116537629 None] Acquiring lock "cinder-quobyte-26b60afd-2e7e-41fe-b1df-f90764b798c7" by "_delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:49:48 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-65ae7642-7c29-45a5-bc2b-3a5c47712156 tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "cinder-quobyte-26b60afd-2e7e-41fe-b1df-f90764b798c7" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:49:48 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-65ae7642-7c29-45a5-bc2b-3a5c47712156 tempest-VolumesSnapshotTestJSON-2116537629 None] Deleting offline snapshot 26b60afd-2e7e-41fe-b1df-f90764b798c7 of volume b8e1b8b6-4168-4074-b922-c37788ca28a5 {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 21:49:48 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-65ae7642-7c29-45a5-bc2b-3a5c47712156 tempest-VolumesSnapshotTestJSON-2116537629 None] snapshot_file for this snap is: volume-b8e1b8b6-4168-4074-b922-c37788ca28a5.26b60afd-2e7e-41fe-b1df-f90764b798c7 {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 21:49:48 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0caa664-c774-428b-a631-a58466a8b472]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:49:48 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-65ae7642-7c29-45a5-bc2b-3a5c47712156 tempest-VolumesSnapshotTestJSON-2116537629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b8e1b8b6-4168-4074-b922-c37788ca28a5.26b60afd-2e7e-41fe-b1df-f90764b798c7 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:48 devstack sudo[103580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b8e1b8b6-4168-4074-b922-c37788ca28a5.26b60afd-2e7e-41fe-b1df-f90764b798c7 Sep 18 21:49:48 devstack sudo[103580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:48 devstack sudo[103580]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:48 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-65ae7642-7c29-45a5-bc2b-3a5c47712156 tempest-VolumesSnapshotTestJSON-2116537629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b8e1b8b6-4168-4074-b922-c37788ca28a5.26b60afd-2e7e-41fe-b1df-f90764b798c7" returned: 0 in 0.369s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:48 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-65ae7642-7c29-45a5-bc2b-3a5c47712156 tempest-VolumesSnapshotTestJSON-2116537629 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b8e1b8b6-4168-4074-b922-c37788ca28a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86136) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 21:49:48 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e04dd3-bbab-4173-8600-fe8c7be71f26]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:49:48 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-65ae7642-7c29-45a5-bc2b-3a5c47712156 tempest-VolumesSnapshotTestJSON-2116537629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b8e1b8b6-4168-4074-b922-c37788ca28a5 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:48 devstack sudo[103585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b8e1b8b6-4168-4074-b922-c37788ca28a5 Sep 18 21:49:48 devstack sudo[103585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:49 devstack sudo[103585]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:49 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-65ae7642-7c29-45a5-bc2b-3a5c47712156 tempest-VolumesSnapshotTestJSON-2116537629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b8e1b8b6-4168-4074-b922-c37788ca28a5" returned: 0 in 0.651s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:49 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-65ae7642-7c29-45a5-bc2b-3a5c47712156 tempest-VolumesSnapshotTestJSON-2116537629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b8e1b8b6-4168-4074-b922-c37788ca28a5.26b60afd-2e7e-41fe-b1df-f90764b798c7 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:49 devstack sudo[103590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b8e1b8b6-4168-4074-b922-c37788ca28a5.26b60afd-2e7e-41fe-b1df-f90764b798c7 Sep 18 21:49:49 devstack sudo[103590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:49 devstack sudo[103590]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:49 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-65ae7642-7c29-45a5-bc2b-3a5c47712156 tempest-VolumesSnapshotTestJSON-2116537629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b8e1b8b6-4168-4074-b922-c37788ca28a5.26b60afd-2e7e-41fe-b1df-f90764b798c7" returned: 0 in 0.385s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:49 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-65ae7642-7c29-45a5-bc2b-3a5c47712156 tempest-VolumesSnapshotTestJSON-2116537629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b8e1b8b6-4168-4074-b922-c37788ca28a5.26b60afd-2e7e-41fe-b1df-f90764b798c7 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:49 devstack sudo[103597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b8e1b8b6-4168-4074-b922-c37788ca28a5.26b60afd-2e7e-41fe-b1df-f90764b798c7 Sep 18 21:49:49 devstack sudo[103597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:49 devstack sudo[103597]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:49 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-65ae7642-7c29-45a5-bc2b-3a5c47712156 tempest-VolumesSnapshotTestJSON-2116537629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b8e1b8b6-4168-4074-b922-c37788ca28a5.26b60afd-2e7e-41fe-b1df-f90764b798c7" returned: 0 in 0.298s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:49 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-65ae7642-7c29-45a5-bc2b-3a5c47712156 tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "cinder-quobyte-26b60afd-2e7e-41fe-b1df-f90764b798c7" released by "_delete_snapshot" :: held 1.832s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:49:49 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-65ae7642-7c29-45a5-bc2b-3a5c47712156 tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "cinder-quobyte-b8e1b8b6-4168-4074-b922-c37788ca28a5" released by "delete_snapshot" :: held 1.858s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:49:49 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-65ae7642-7c29-45a5-bc2b-3a5c47712156 tempest-VolumesSnapshotTestJSON-2116537629 None] Created reservations ['899af82a-d2df-4cec-a07a-441ec93325a9', 'c94c7b30-c16d-4e50-8175-5a441442139a', '92aabd4e-3721-4379-8e7f-74fdd3af3fa7', '74876803-8ef1-4ef2-b7d4-56633832a96a'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:49:50 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-65ae7642-7c29-45a5-bc2b-3a5c47712156 tempest-VolumesSnapshotTestJSON-2116537629 None] Delete snapshot completed successfully. Sep 18 21:49:50 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-65ae7642-7c29-45a5-bc2b-3a5c47712156 tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "cinder-26b60afd-2e7e-41fe-b1df-f90764b798c7-delete_snapshot" released by "delete_snapshot" :: held 2.032s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:49:50 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-4f459bc7-8f7c-4863-a7a9-3649f1b6d50c tempest-VolumesSnapshotTestJSON-2116537629 None] Acquiring lock "cinder-b8e1b8b6-4168-4074-b922-c37788ca28a5-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:49:50 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-4f459bc7-8f7c-4863-a7a9-3649f1b6d50c tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "cinder-b8e1b8b6-4168-4074-b922-c37788ca28a5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:49:50 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-4f459bc7-8f7c-4863-a7a9-3649f1b6d50c tempest-VolumesSnapshotTestJSON-2116537629 None] Acquiring lock "cinder-quobyte-b8e1b8b6-4168-4074-b922-c37788ca28a5" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:49:50 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-4f459bc7-8f7c-4863-a7a9-3649f1b6d50c tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "cinder-quobyte-b8e1b8b6-4168-4074-b922-c37788ca28a5" acquired by "delete_volume" :: waited 0.014s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:49:50 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd159fd8-015b-4f12-ac56-df9b25ac0d99]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:49:50 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-4f459bc7-8f7c-4863-a7a9-3649f1b6d50c tempest-VolumesSnapshotTestJSON-2116537629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b8e1b8b6-4168-4074-b922-c37788ca28a5 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:50 devstack sudo[103601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b8e1b8b6-4168-4074-b922-c37788ca28a5 Sep 18 21:49:50 devstack sudo[103601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:50 devstack sudo[103601]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:50 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-4f459bc7-8f7c-4863-a7a9-3649f1b6d50c tempest-VolumesSnapshotTestJSON-2116537629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b8e1b8b6-4168-4074-b922-c37788ca28a5" returned: 0 in 0.406s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:50 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-4f459bc7-8f7c-4863-a7a9-3649f1b6d50c tempest-VolumesSnapshotTestJSON-2116537629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b8e1b8b6-4168-4074-b922-c37788ca28a5 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:50 devstack sudo[103607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b8e1b8b6-4168-4074-b922-c37788ca28a5 Sep 18 21:49:50 devstack sudo[103607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:51 devstack sudo[103607]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:51 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-4f459bc7-8f7c-4863-a7a9-3649f1b6d50c tempest-VolumesSnapshotTestJSON-2116537629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b8e1b8b6-4168-4074-b922-c37788ca28a5" returned: 0 in 0.302s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:51 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-4f459bc7-8f7c-4863-a7a9-3649f1b6d50c tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "cinder-quobyte-b8e1b8b6-4168-4074-b922-c37788ca28a5" released by "delete_volume" :: held 0.813s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:49:51 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-4f459bc7-8f7c-4863-a7a9-3649f1b6d50c tempest-VolumesSnapshotTestJSON-2116537629 None] Created reservations ['1acb4bc6-e41d-4f9f-a150-e90792b32522', '80f06e94-f9b7-4a3c-bcf1-5ec9572bc5c9', '67a7c36e-8fb4-49e2-bfdb-b550d3833503', '567264ba-38ed-491d-a8b0-59389c3ee15b'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:49:51 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-4f459bc7-8f7c-4863-a7a9-3649f1b6d50c tempest-VolumesSnapshotTestJSON-2116537629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:49:51 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-4f459bc7-8f7c-4863-a7a9-3649f1b6d50c tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:49:51 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-4f459bc7-8f7c-4863-a7a9-3649f1b6d50c tempest-VolumesSnapshotTestJSON-2116537629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:49:51 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-4f459bc7-8f7c-4863-a7a9-3649f1b6d50c tempest-VolumesSnapshotTestJSON-2116537629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:49:51 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-4f459bc7-8f7c-4863-a7a9-3649f1b6d50c tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:49:51 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-4f459bc7-8f7c-4863-a7a9-3649f1b6d50c tempest-VolumesSnapshotTestJSON-2116537629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:51 devstack sudo[103610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:49:51 devstack sudo[103610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:51 devstack sudo[103610]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:51 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-4f459bc7-8f7c-4863-a7a9-3649f1b6d50c tempest-VolumesSnapshotTestJSON-2116537629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.286s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:51 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-4f459bc7-8f7c-4863-a7a9-3649f1b6d50c tempest-VolumesSnapshotTestJSON-2116537629 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:49:51 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-4f459bc7-8f7c-4863-a7a9-3649f1b6d50c tempest-VolumesSnapshotTestJSON-2116537629 None] Deleted volume successfully. Sep 18 21:49:51 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-4f459bc7-8f7c-4863-a7a9-3649f1b6d50c tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "cinder-b8e1b8b6-4168-4074-b922-c37788ca28a5-delete_volume" released by "delete_volume" :: held 1.349s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:49:51 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4dc7948-a682-4e92-a186-3c46bcf5a4f3 tempest-VolumesSnapshotTestJSON-2116537629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:49:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f4dc7948-a682-4e92-a186-3c46bcf5a4f3 tempest-VolumesSnapshotTestJSON-2116537629 None] Flow 'volume_create_manager' (07e11ccd-e49c-4bdb-99ee-fb2e57b81af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:49:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f4dc7948-a682-4e92-a186-3c46bcf5a4f3 tempest-VolumesSnapshotTestJSON-2116537629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dffd647-f63b-43b4-b183-88273502fe36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:49:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f4dc7948-a682-4e92-a186-3c46bcf5a4f3 tempest-VolumesSnapshotTestJSON-2116537629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dffd647-f63b-43b4-b183-88273502fe36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:49:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1889713706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3de922fa-8848-4554-9193-2f1ebada8138,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56bc1d47940d4119a14cf1970728710e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:49:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:49:52Z,use_quota=True,user_id='8ace514290c84ec1a763bcbe1fade50d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:49:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f4dc7948-a682-4e92-a186-3c46bcf5a4f3 tempest-VolumesSnapshotTestJSON-2116537629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9645678d-bc41-4d04-99ae-a37307f176ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:49:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f4dc7948-a682-4e92-a186-3c46bcf5a4f3 tempest-VolumesSnapshotTestJSON-2116537629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9645678d-bc41-4d04-99ae-a37307f176ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:49:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f4dc7948-a682-4e92-a186-3c46bcf5a4f3 tempest-VolumesSnapshotTestJSON-2116537629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9239e6e4-0b28-43c4-9e1d-7143f9c13f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:49:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f4dc7948-a682-4e92-a186-3c46bcf5a4f3 tempest-VolumesSnapshotTestJSON-2116537629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9239e6e4-0b28-43c4-9e1d-7143f9c13f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3de922fa-8848-4554-9193-2f1ebada8138', 'volume_name': 'volume-3de922fa-8848-4554-9193-2f1ebada8138', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:49:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f4dc7948-a682-4e92-a186-3c46bcf5a4f3 tempest-VolumesSnapshotTestJSON-2116537629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16539d4c-5c7a-4646-bf61-ca52a7dc64f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:49:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f4dc7948-a682-4e92-a186-3c46bcf5a4f3 tempest-VolumesSnapshotTestJSON-2116537629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16539d4c-5c7a-4646-bf61-ca52a7dc64f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:49:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f4dc7948-a682-4e92-a186-3c46bcf5a4f3 tempest-VolumesSnapshotTestJSON-2116537629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (633e5b2f-1c82-4636-b419-f227a8bac950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:49:52 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-f4dc7948-a682-4e92-a186-3c46bcf5a4f3 tempest-VolumesSnapshotTestJSON-2116537629 None] Volume 3de922fa-8848-4554-9193-2f1ebada8138: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3de922fa-8848-4554-9193-2f1ebada8138', 'volume_size': 1} Sep 18 21:49:52 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-f4dc7948-a682-4e92-a186-3c46bcf5a4f3 tempest-VolumesSnapshotTestJSON-2116537629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:49:52 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-f4dc7948-a682-4e92-a186-3c46bcf5a4f3 tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:49:52 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-f4dc7948-a682-4e92-a186-3c46bcf5a4f3 tempest-VolumesSnapshotTestJSON-2116537629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:49:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1889713706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3de922fa-8848-4554-9193-2f1ebada8138,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56bc1d47940d4119a14cf1970728710e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:49:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:49:52Z,use_quota=True,user_id='8ace514290c84ec1a763bcbe1fade50d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:49:52 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-f4dc7948-a682-4e92-a186-3c46bcf5a4f3 tempest-VolumesSnapshotTestJSON-2116537629 None] Creating volume 3de922fa-8848-4554-9193-2f1ebada8138 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:49:52 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-f4dc7948-a682-4e92-a186-3c46bcf5a4f3 tempest-VolumesSnapshotTestJSON-2116537629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:49:52 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-f4dc7948-a682-4e92-a186-3c46bcf5a4f3 tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:49:52 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-f4dc7948-a682-4e92-a186-3c46bcf5a4f3 tempest-VolumesSnapshotTestJSON-2116537629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:49:52 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-f4dc7948-a682-4e92-a186-3c46bcf5a4f3 tempest-VolumesSnapshotTestJSON-2116537629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:49:52 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-f4dc7948-a682-4e92-a186-3c46bcf5a4f3 tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:49:52 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-f4dc7948-a682-4e92-a186-3c46bcf5a4f3 tempest-VolumesSnapshotTestJSON-2116537629 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:49:52 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-f4dc7948-a682-4e92-a186-3c46bcf5a4f3 tempest-VolumesSnapshotTestJSON-2116537629 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:49:52 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f4dc7948-a682-4e92-a186-3c46bcf5a4f3 tempest-VolumesSnapshotTestJSON-2116537629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3de922fa-8848-4554-9193-2f1ebada8138 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:52 devstack sudo[103613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3de922fa-8848-4554-9193-2f1ebada8138 1073741824 Sep 18 21:49:52 devstack sudo[103613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:52 devstack sudo[103613]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:52 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f4dc7948-a682-4e92-a186-3c46bcf5a4f3 tempest-VolumesSnapshotTestJSON-2116537629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3de922fa-8848-4554-9193-2f1ebada8138 1073741824" returned: 0 in 0.440s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:52 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f4dc7948-a682-4e92-a186-3c46bcf5a4f3 tempest-VolumesSnapshotTestJSON-2116537629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3de922fa-8848-4554-9193-2f1ebada8138 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:52 devstack sudo[103619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3de922fa-8848-4554-9193-2f1ebada8138 Sep 18 21:49:52 devstack sudo[103619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:52 devstack sudo[103619]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:52 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f4dc7948-a682-4e92-a186-3c46bcf5a4f3 tempest-VolumesSnapshotTestJSON-2116537629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3de922fa-8848-4554-9193-2f1ebada8138" returned: 0 in 0.258s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:52 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-f4dc7948-a682-4e92-a186-3c46bcf5a4f3 tempest-VolumesSnapshotTestJSON-2116537629 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:49:52 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-f4dc7948-a682-4e92-a186-3c46bcf5a4f3 tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:49:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f4dc7948-a682-4e92-a186-3c46bcf5a4f3 tempest-VolumesSnapshotTestJSON-2116537629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (633e5b2f-1c82-4636-b419-f227a8bac950) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3de922fa-8848-4554-9193-2f1ebada8138', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:49:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f4dc7948-a682-4e92-a186-3c46bcf5a4f3 tempest-VolumesSnapshotTestJSON-2116537629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f753f8f4-314b-4433-898e-6314a83d7001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:49:52 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-f4dc7948-a682-4e92-a186-3c46bcf5a4f3 tempest-VolumesSnapshotTestJSON-2116537629 None] Volume volume-3de922fa-8848-4554-9193-2f1ebada8138 (3de922fa-8848-4554-9193-2f1ebada8138): created successfully Sep 18 21:49:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f4dc7948-a682-4e92-a186-3c46bcf5a4f3 tempest-VolumesSnapshotTestJSON-2116537629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f753f8f4-314b-4433-898e-6314a83d7001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:49:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f4dc7948-a682-4e92-a186-3c46bcf5a4f3 tempest-VolumesSnapshotTestJSON-2116537629 None] Flow 'volume_create_manager' (07e11ccd-e49c-4bdb-99ee-fb2e57b81af5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:49:52 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-f4dc7948-a682-4e92-a186-3c46bcf5a4f3 tempest-VolumesSnapshotTestJSON-2116537629 None] Created volume successfully. Sep 18 21:49:53 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-5ce54d4b-407b-4e65-872c-87abdf9c3519 tempest-VolumesSnapshotTestJSON-2116537629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:49:53 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-5ce54d4b-407b-4e65-872c-87abdf9c3519 tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:49:53 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-5ce54d4b-407b-4e65-872c-87abdf9c3519 tempest-VolumesSnapshotTestJSON-2116537629 None] Creating offline snapshot 00e52ca3-9551-4665-b22b-09c417a5121d of volume 3de922fa-8848-4554-9193-2f1ebada8138 {{(pid=86136) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 21:49:53 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[712ee858-3954-4f48-82ed-901bf87c84fd]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:49:53 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5ce54d4b-407b-4e65-872c-87abdf9c3519 tempest-VolumesSnapshotTestJSON-2116537629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3de922fa-8848-4554-9193-2f1ebada8138 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:53 devstack sudo[103622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3de922fa-8848-4554-9193-2f1ebada8138 Sep 18 21:49:53 devstack sudo[103622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:53 devstack sudo[103622]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:53 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5ce54d4b-407b-4e65-872c-87abdf9c3519 tempest-VolumesSnapshotTestJSON-2116537629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3de922fa-8848-4554-9193-2f1ebada8138" returned: 0 in 0.445s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:53 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5ce54d4b-407b-4e65-872c-87abdf9c3519 tempest-VolumesSnapshotTestJSON-2116537629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3de922fa-8848-4554-9193-2f1ebada8138,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3de922fa-8848-4554-9193-2f1ebada8138.00e52ca3-9551-4665-b22b-09c417a5121d 1G {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:53 devstack sudo[103627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3de922fa-8848-4554-9193-2f1ebada8138,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3de922fa-8848-4554-9193-2f1ebada8138.00e52ca3-9551-4665-b22b-09c417a5121d 1G Sep 18 21:49:53 devstack sudo[103627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:54 devstack sudo[103627]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:54 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5ce54d4b-407b-4e65-872c-87abdf9c3519 tempest-VolumesSnapshotTestJSON-2116537629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3de922fa-8848-4554-9193-2f1ebada8138,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3de922fa-8848-4554-9193-2f1ebada8138.00e52ca3-9551-4665-b22b-09c417a5121d 1G" returned: 0 in 0.441s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:54 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5ce54d4b-407b-4e65-872c-87abdf9c3519 tempest-VolumesSnapshotTestJSON-2116537629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3de922fa-8848-4554-9193-2f1ebada8138 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3de922fa-8848-4554-9193-2f1ebada8138.00e52ca3-9551-4665-b22b-09c417a5121d {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:54 devstack sudo[103633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3de922fa-8848-4554-9193-2f1ebada8138 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3de922fa-8848-4554-9193-2f1ebada8138.00e52ca3-9551-4665-b22b-09c417a5121d Sep 18 21:49:54 devstack sudo[103633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:54 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c7b2959-8190-4693-bd17-f6a517b39c05 tempest-SnapshotDependencyTests-1071981765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:49:54 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-4c7b2959-8190-4693-bd17-f6a517b39c05 tempest-SnapshotDependencyTests-1071981765 None] Flow 'volume_create_manager' (2e260738-27f2-4ce5-ac60-589f6035a68e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:49:54 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-4c7b2959-8190-4693-bd17-f6a517b39c05 tempest-SnapshotDependencyTests-1071981765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a069a412-b1e2-4c57-8f0b-fbd9dde36f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:49:54 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-4c7b2959-8190-4693-bd17-f6a517b39c05 tempest-SnapshotDependencyTests-1071981765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a069a412-b1e2-4c57-8f0b-fbd9dde36f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:49:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1119026836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3591e082a844528a636d1af8610ec47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:49:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:49:54Z,use_quota=True,user_id='1e585bfd1e5f42de92f0c5a558b59165',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:49:54 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-4c7b2959-8190-4693-bd17-f6a517b39c05 tempest-SnapshotDependencyTests-1071981765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24ffd6db-4036-4fa6-90c1-65357eb847f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:49:54 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-4c7b2959-8190-4693-bd17-f6a517b39c05 tempest-SnapshotDependencyTests-1071981765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24ffd6db-4036-4fa6-90c1-65357eb847f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:49:54 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-4c7b2959-8190-4693-bd17-f6a517b39c05 tempest-SnapshotDependencyTests-1071981765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdda02fc-6c3a-4021-98ac-c31fdb44b284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:49:54 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-4c7b2959-8190-4693-bd17-f6a517b39c05 tempest-SnapshotDependencyTests-1071981765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdda02fc-6c3a-4021-98ac-c31fdb44b284) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a', 'volume_name': 'volume-a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:49:54 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-4c7b2959-8190-4693-bd17-f6a517b39c05 tempest-SnapshotDependencyTests-1071981765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (590f1c21-1401-4566-984b-a4e1a1e85477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:49:54 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-4c7b2959-8190-4693-bd17-f6a517b39c05 tempest-SnapshotDependencyTests-1071981765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (590f1c21-1401-4566-984b-a4e1a1e85477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:49:54 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-4c7b2959-8190-4693-bd17-f6a517b39c05 tempest-SnapshotDependencyTests-1071981765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3219094e-5d9a-4edf-8880-15f06c4c9c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:49:54 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-4c7b2959-8190-4693-bd17-f6a517b39c05 tempest-SnapshotDependencyTests-1071981765 None] Volume a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a', 'volume_size': 1} Sep 18 21:49:54 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-4c7b2959-8190-4693-bd17-f6a517b39c05 tempest-SnapshotDependencyTests-1071981765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:49:54 devstack sudo[103633]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:54 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5ce54d4b-407b-4e65-872c-87abdf9c3519 tempest-VolumesSnapshotTestJSON-2116537629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3de922fa-8848-4554-9193-2f1ebada8138 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3de922fa-8848-4554-9193-2f1ebada8138.00e52ca3-9551-4665-b22b-09c417a5121d" returned: 0 in 0.284s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:54 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-5ce54d4b-407b-4e65-872c-87abdf9c3519 tempest-VolumesSnapshotTestJSON-2116537629 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3de922fa-8848-4554-9193-2f1ebada8138.00e52ca3-9551-4665-b22b-09c417a5121d is being set with open permissions: ugo+rw Sep 18 21:49:54 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5ce54d4b-407b-4e65-872c-87abdf9c3519 tempest-VolumesSnapshotTestJSON-2116537629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3de922fa-8848-4554-9193-2f1ebada8138.00e52ca3-9551-4665-b22b-09c417a5121d {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:54 devstack sudo[103638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3de922fa-8848-4554-9193-2f1ebada8138.00e52ca3-9551-4665-b22b-09c417a5121d Sep 18 21:49:54 devstack sudo[103638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:54 devstack sudo[103638]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:54 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5ce54d4b-407b-4e65-872c-87abdf9c3519 tempest-VolumesSnapshotTestJSON-2116537629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3de922fa-8848-4554-9193-2f1ebada8138.00e52ca3-9551-4665-b22b-09c417a5121d" returned: 0 in 0.248s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:54 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5ce54d4b-407b-4e65-872c-87abdf9c3519 tempest-VolumesSnapshotTestJSON-2116537629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3de922fa-8848-4554-9193-2f1ebada8138.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:54 devstack sudo[103641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3de922fa-8848-4554-9193-2f1ebada8138.info Sep 18 21:49:54 devstack sudo[103641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:55 devstack sudo[103641]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5ce54d4b-407b-4e65-872c-87abdf9c3519 tempest-VolumesSnapshotTestJSON-2116537629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3de922fa-8848-4554-9193-2f1ebada8138.info" returned: 0 in 0.250s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:55 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-5ce54d4b-407b-4e65-872c-87abdf9c3519 tempest-VolumesSnapshotTestJSON-2116537629 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3de922fa-8848-4554-9193-2f1ebada8138.info is being set with open permissions: ugo+rw Sep 18 21:49:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5ce54d4b-407b-4e65-872c-87abdf9c3519 tempest-VolumesSnapshotTestJSON-2116537629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3de922fa-8848-4554-9193-2f1ebada8138.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:55 devstack sudo[103644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3de922fa-8848-4554-9193-2f1ebada8138.info Sep 18 21:49:55 devstack sudo[103644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:55 devstack sudo[103644]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5ce54d4b-407b-4e65-872c-87abdf9c3519 tempest-VolumesSnapshotTestJSON-2116537629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3de922fa-8848-4554-9193-2f1ebada8138.info" returned: 0 in 0.243s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-5ce54d4b-407b-4e65-872c-87abdf9c3519 tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.006s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:49:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-4c7b2959-8190-4693-bd17-f6a517b39c05 tempest-SnapshotDependencyTests-1071981765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.899s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:49:55 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-4c7b2959-8190-4693-bd17-f6a517b39c05 tempest-SnapshotDependencyTests-1071981765 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:49:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1119026836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3591e082a844528a636d1af8610ec47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:49:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:49:54Z,use_quota=True,user_id='1e585bfd1e5f42de92f0c5a558b59165',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:49:55 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-4c7b2959-8190-4693-bd17-f6a517b39c05 tempest-SnapshotDependencyTests-1071981765 None] Creating volume a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:49:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-4c7b2959-8190-4693-bd17-f6a517b39c05 tempest-SnapshotDependencyTests-1071981765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:49:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-4c7b2959-8190-4693-bd17-f6a517b39c05 tempest-SnapshotDependencyTests-1071981765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:49:55 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-4c7b2959-8190-4693-bd17-f6a517b39c05 tempest-SnapshotDependencyTests-1071981765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:49:55 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-4c7b2959-8190-4693-bd17-f6a517b39c05 tempest-SnapshotDependencyTests-1071981765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:49:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-4c7b2959-8190-4693-bd17-f6a517b39c05 tempest-SnapshotDependencyTests-1071981765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:49:55 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-4c7b2959-8190-4693-bd17-f6a517b39c05 tempest-SnapshotDependencyTests-1071981765 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:49:55 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-4c7b2959-8190-4693-bd17-f6a517b39c05 tempest-SnapshotDependencyTests-1071981765 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:49:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-4c7b2959-8190-4693-bd17-f6a517b39c05 tempest-SnapshotDependencyTests-1071981765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:55 devstack sudo[103647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a 1073741824 Sep 18 21:49:55 devstack sudo[103647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:55 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-5ce54d4b-407b-4e65-872c-87abdf9c3519 tempest-VolumesSnapshotTestJSON-2116537629 None] Create snapshot completed successfully Sep 18 21:49:55 devstack sudo[103647]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-4c7b2959-8190-4693-bd17-f6a517b39c05 tempest-SnapshotDependencyTests-1071981765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a 1073741824" returned: 0 in 0.413s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-4c7b2959-8190-4693-bd17-f6a517b39c05 tempest-SnapshotDependencyTests-1071981765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:55 devstack sudo[103653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a Sep 18 21:49:55 devstack sudo[103653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:55 devstack sudo[103653]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-4c7b2959-8190-4693-bd17-f6a517b39c05 tempest-SnapshotDependencyTests-1071981765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a" returned: 0 in 0.251s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:55 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-4c7b2959-8190-4693-bd17-f6a517b39c05 tempest-SnapshotDependencyTests-1071981765 None] <== create_volume: return (701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:49:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-4c7b2959-8190-4693-bd17-f6a517b39c05 tempest-SnapshotDependencyTests-1071981765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:49:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-4c7b2959-8190-4693-bd17-f6a517b39c05 tempest-SnapshotDependencyTests-1071981765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3219094e-5d9a-4edf-8880-15f06c4c9c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:49:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-4c7b2959-8190-4693-bd17-f6a517b39c05 tempest-SnapshotDependencyTests-1071981765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7f2ed58-2f68-49d5-b394-7469827a8268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:49:56 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-4c7b2959-8190-4693-bd17-f6a517b39c05 tempest-SnapshotDependencyTests-1071981765 None] Volume volume-a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a (a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a): created successfully Sep 18 21:49:56 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-4c7b2959-8190-4693-bd17-f6a517b39c05 tempest-SnapshotDependencyTests-1071981765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7f2ed58-2f68-49d5-b394-7469827a8268) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:49:56 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-4c7b2959-8190-4693-bd17-f6a517b39c05 tempest-SnapshotDependencyTests-1071981765 None] Flow 'volume_create_manager' (2e260738-27f2-4ce5-ac60-589f6035a68e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:49:56 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-4c7b2959-8190-4693-bd17-f6a517b39c05 tempest-SnapshotDependencyTests-1071981765 None] Created volume successfully. Sep 18 21:49:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-3d8ea400-1654-4fec-94cd-86e94d45b170 tempest-SnapshotDependencyTests-1071981765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:49:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-3d8ea400-1654-4fec-94cd-86e94d45b170 tempest-SnapshotDependencyTests-1071981765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:49:56 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-3d8ea400-1654-4fec-94cd-86e94d45b170 tempest-SnapshotDependencyTests-1071981765 None] Creating offline snapshot 66baa1c6-3ad2-4596-b2b5-e17471655c86 of volume a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a {{(pid=86136) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 21:49:56 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[c91ba5ea-8d3c-4018-b3ae-e691d58e9124]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:49:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3d8ea400-1654-4fec-94cd-86e94d45b170 tempest-SnapshotDependencyTests-1071981765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:56 devstack sudo[103656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a Sep 18 21:49:56 devstack sudo[103656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:56 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-f78b63a1-ab6a-4c26-ba3d-ed176a23ba5b tempest-VolumesSnapshotTestJSON-2116537629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:49:56 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f78b63a1-ab6a-4c26-ba3d-ed176a23ba5b tempest-VolumesSnapshotTestJSON-2116537629 None] Flow 'volume_create_manager' (6fd36c78-6603-481a-a8e4-b5ee7d17b11e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:49:56 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f78b63a1-ab6a-4c26-ba3d-ed176a23ba5b tempest-VolumesSnapshotTestJSON-2116537629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bf7b6e2-aa9b-4ff8-8b6d-59c6769c6bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:49:56 devstack sudo[103656]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:57 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f78b63a1-ab6a-4c26-ba3d-ed176a23ba5b tempest-VolumesSnapshotTestJSON-2116537629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bf7b6e2-aa9b-4ff8-8b6d-59c6769c6bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:49:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-419884888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48823379-d7b0-4cc9-a803-83db6f22b8a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56bc1d47940d4119a14cf1970728710e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:49:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=00e52ca3-9551-4665-b22b-09c417a5121d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:49:57Z,use_quota=True,user_id='8ace514290c84ec1a763bcbe1fade50d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:49:57 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f78b63a1-ab6a-4c26-ba3d-ed176a23ba5b tempest-VolumesSnapshotTestJSON-2116537629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb5807c1-d365-422a-b70c-85f2b5059b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:49:57 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f78b63a1-ab6a-4c26-ba3d-ed176a23ba5b tempest-VolumesSnapshotTestJSON-2116537629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb5807c1-d365-422a-b70c-85f2b5059b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:49:57 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f78b63a1-ab6a-4c26-ba3d-ed176a23ba5b tempest-VolumesSnapshotTestJSON-2116537629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (619a3c20-1685-4250-b93a-54160ce6f791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:49:57 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f78b63a1-ab6a-4c26-ba3d-ed176a23ba5b tempest-VolumesSnapshotTestJSON-2116537629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (619a3c20-1685-4250-b93a-54160ce6f791) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '48823379-d7b0-4cc9-a803-83db6f22b8a2', 'volume_name': 'volume-48823379-d7b0-4cc9-a803-83db6f22b8a2', 'volume_size': 1, 'snapshot_id': '00e52ca3-9551-4665-b22b-09c417a5121d'}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:49:57 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f78b63a1-ab6a-4c26-ba3d-ed176a23ba5b tempest-VolumesSnapshotTestJSON-2116537629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b782625-36a4-411f-b313-65a9a2d3c444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:49:57 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f78b63a1-ab6a-4c26-ba3d-ed176a23ba5b tempest-VolumesSnapshotTestJSON-2116537629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b782625-36a4-411f-b313-65a9a2d3c444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:49:57 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f78b63a1-ab6a-4c26-ba3d-ed176a23ba5b tempest-VolumesSnapshotTestJSON-2116537629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7b12790-66b6-457e-8ed7-96f362ac1edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:49:57 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-f78b63a1-ab6a-4c26-ba3d-ed176a23ba5b tempest-VolumesSnapshotTestJSON-2116537629 None] Volume 48823379-d7b0-4cc9-a803-83db6f22b8a2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-48823379-d7b0-4cc9-a803-83db6f22b8a2', 'volume_size': 1, 'snapshot_id': '00e52ca3-9551-4665-b22b-09c417a5121d'} Sep 18 21:49:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3d8ea400-1654-4fec-94cd-86e94d45b170 tempest-SnapshotDependencyTests-1071981765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a" returned: 0 in 0.426s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3d8ea400-1654-4fec-94cd-86e94d45b170 tempest-SnapshotDependencyTests-1071981765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a.66baa1c6-3ad2-4596-b2b5-e17471655c86 1G {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-f78b63a1-ab6a-4c26-ba3d-ed176a23ba5b tempest-VolumesSnapshotTestJSON-2116537629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:49:57 devstack sudo[103661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a.66baa1c6-3ad2-4596-b2b5-e17471655c86 1G Sep 18 21:49:57 devstack sudo[103661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:57 devstack sudo[103661]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3d8ea400-1654-4fec-94cd-86e94d45b170 tempest-SnapshotDependencyTests-1071981765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a.66baa1c6-3ad2-4596-b2b5-e17471655c86 1G" returned: 0 in 0.384s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3d8ea400-1654-4fec-94cd-86e94d45b170 tempest-SnapshotDependencyTests-1071981765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a.66baa1c6-3ad2-4596-b2b5-e17471655c86 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:57 devstack sudo[103666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a.66baa1c6-3ad2-4596-b2b5-e17471655c86 Sep 18 21:49:57 devstack sudo[103666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:57 devstack sudo[103666]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3d8ea400-1654-4fec-94cd-86e94d45b170 tempest-SnapshotDependencyTests-1071981765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a.66baa1c6-3ad2-4596-b2b5-e17471655c86" returned: 0 in 0.283s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:57 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-3d8ea400-1654-4fec-94cd-86e94d45b170 tempest-SnapshotDependencyTests-1071981765 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a.66baa1c6-3ad2-4596-b2b5-e17471655c86 is being set with open permissions: ugo+rw Sep 18 21:49:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3d8ea400-1654-4fec-94cd-86e94d45b170 tempest-SnapshotDependencyTests-1071981765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a.66baa1c6-3ad2-4596-b2b5-e17471655c86 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:57 devstack sudo[103671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a.66baa1c6-3ad2-4596-b2b5-e17471655c86 Sep 18 21:49:57 devstack sudo[103671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:57 devstack sudo[103671]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3d8ea400-1654-4fec-94cd-86e94d45b170 tempest-SnapshotDependencyTests-1071981765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a.66baa1c6-3ad2-4596-b2b5-e17471655c86" returned: 0 in 0.250s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3d8ea400-1654-4fec-94cd-86e94d45b170 tempest-SnapshotDependencyTests-1071981765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:58 devstack sudo[103674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a.info Sep 18 21:49:58 devstack sudo[103674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:58 devstack sudo[103674]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3d8ea400-1654-4fec-94cd-86e94d45b170 tempest-SnapshotDependencyTests-1071981765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a.info" returned: 0 in 0.242s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:58 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-3d8ea400-1654-4fec-94cd-86e94d45b170 tempest-SnapshotDependencyTests-1071981765 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a.info is being set with open permissions: ugo+rw Sep 18 21:49:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3d8ea400-1654-4fec-94cd-86e94d45b170 tempest-SnapshotDependencyTests-1071981765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:58 devstack sudo[103677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a.info Sep 18 21:49:58 devstack sudo[103677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:58 devstack sudo[103677]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3d8ea400-1654-4fec-94cd-86e94d45b170 tempest-SnapshotDependencyTests-1071981765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a.info" returned: 0 in 0.235s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-3d8ea400-1654-4fec-94cd-86e94d45b170 tempest-SnapshotDependencyTests-1071981765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.911s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:49:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-f78b63a1-ab6a-4c26-ba3d-ed176a23ba5b tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.430s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:49:58 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-f78b63a1-ab6a-4c26-ba3d-ed176a23ba5b tempest-VolumesSnapshotTestJSON-2116537629 None] Acquiring lock "cinder-quobyte-00e52ca3-9551-4665-b22b-09c417a5121d-48823379-d7b0-4cc9-a803-83db6f22b8a2" by "_create_volume_from_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:49:58 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-f78b63a1-ab6a-4c26-ba3d-ed176a23ba5b tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "cinder-quobyte-00e52ca3-9551-4665-b22b-09c417a5121d-48823379-d7b0-4cc9-a803-83db6f22b8a2" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:49:58 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-f78b63a1-ab6a-4c26-ba3d-ed176a23ba5b tempest-VolumesSnapshotTestJSON-2116537629 None] Creating volume 48823379-d7b0-4cc9-a803-83db6f22b8a2 from snapshot 00e52ca3-9551-4665-b22b-09c417a5121d {{(pid=86136) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 18 21:49:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-f78b63a1-ab6a-4c26-ba3d-ed176a23ba5b tempest-VolumesSnapshotTestJSON-2116537629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:49:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-f78b63a1-ab6a-4c26-ba3d-ed176a23ba5b tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:49:58 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-f78b63a1-ab6a-4c26-ba3d-ed176a23ba5b tempest-VolumesSnapshotTestJSON-2116537629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:49:58 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-f78b63a1-ab6a-4c26-ba3d-ed176a23ba5b tempest-VolumesSnapshotTestJSON-2116537629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:49:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-f78b63a1-ab6a-4c26-ba3d-ed176a23ba5b tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:49:58 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-f78b63a1-ab6a-4c26-ba3d-ed176a23ba5b tempest-VolumesSnapshotTestJSON-2116537629 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:49:58 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-f78b63a1-ab6a-4c26-ba3d-ed176a23ba5b tempest-VolumesSnapshotTestJSON-2116537629 None] Acquiring lock "cinder-quobyte-48823379-d7b0-4cc9-a803-83db6f22b8a2" by "_copy_volume_from_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:49:58 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-3d8ea400-1654-4fec-94cd-86e94d45b170 tempest-SnapshotDependencyTests-1071981765 None] Create snapshot completed successfully Sep 18 21:49:58 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-f78b63a1-ab6a-4c26-ba3d-ed176a23ba5b tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "cinder-quobyte-48823379-d7b0-4cc9-a803-83db6f22b8a2" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:49:58 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-f78b63a1-ab6a-4c26-ba3d-ed176a23ba5b tempest-VolumesSnapshotTestJSON-2116537629 None] snapshot: 00e52ca3-9551-4665-b22b-09c417a5121d, volume: 48823379-d7b0-4cc9-a803-83db6f22b8a2, {{(pid=86136) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 18 21:49:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-f78b63a1-ab6a-4c26-ba3d-ed176a23ba5b tempest-VolumesSnapshotTestJSON-2116537629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:49:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-f78b63a1-ab6a-4c26-ba3d-ed176a23ba5b tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:49:58 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-f78b63a1-ab6a-4c26-ba3d-ed176a23ba5b tempest-VolumesSnapshotTestJSON-2116537629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:49:58 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-f78b63a1-ab6a-4c26-ba3d-ed176a23ba5b tempest-VolumesSnapshotTestJSON-2116537629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:49:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-f78b63a1-ab6a-4c26-ba3d-ed176a23ba5b tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:49:58 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8373d17-ffb4-4cc4-bc4e-3fea096574ac]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:49:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f78b63a1-ab6a-4c26-ba3d-ed176a23ba5b tempest-VolumesSnapshotTestJSON-2116537629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3de922fa-8848-4554-9193-2f1ebada8138.00e52ca3-9551-4665-b22b-09c417a5121d {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:58 devstack sudo[103680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3de922fa-8848-4554-9193-2f1ebada8138.00e52ca3-9551-4665-b22b-09c417a5121d Sep 18 21:49:58 devstack sudo[103680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:58 devstack sudo[103680]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f78b63a1-ab6a-4c26-ba3d-ed176a23ba5b tempest-VolumesSnapshotTestJSON-2116537629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3de922fa-8848-4554-9193-2f1ebada8138.00e52ca3-9551-4665-b22b-09c417a5121d" returned: 0 in 0.393s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:58 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-f78b63a1-ab6a-4c26-ba3d-ed176a23ba5b tempest-VolumesSnapshotTestJSON-2116537629 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3de922fa-8848-4554-9193-2f1ebada8138(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86136) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 21:49:58 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[9409f25f-4fa9-4e1f-be24-4ce8fc7de940]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:49:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f78b63a1-ab6a-4c26-ba3d-ed176a23ba5b tempest-VolumesSnapshotTestJSON-2116537629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3de922fa-8848-4554-9193-2f1ebada8138 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:59 devstack sudo[103685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3de922fa-8848-4554-9193-2f1ebada8138 Sep 18 21:49:59 devstack sudo[103685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:49:59 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-578c289e-68c2-4ad1-86c4-b20c4a239e0f tempest-SnapshotDependencyTests-1071981765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:49:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-578c289e-68c2-4ad1-86c4-b20c4a239e0f tempest-SnapshotDependencyTests-1071981765 None] Flow 'volume_create_manager' (cc81fa53-9ab7-4023-be5f-98129a7b5c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:49:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-578c289e-68c2-4ad1-86c4-b20c4a239e0f tempest-SnapshotDependencyTests-1071981765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6da28401-5ba4-438c-ac6c-12513715f28a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:49:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-578c289e-68c2-4ad1-86c4-b20c4a239e0f tempest-SnapshotDependencyTests-1071981765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6da28401-5ba4-438c-ac6c-12513715f28a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:49:59Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdd5dd46-c287-489f-a18e-43b69f69ff25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3591e082a844528a636d1af8610ec47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:49:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=66baa1c6-3ad2-4596-b2b5-e17471655c86,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:49:59Z,use_quota=True,user_id='1e585bfd1e5f42de92f0c5a558b59165',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:49:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-578c289e-68c2-4ad1-86c4-b20c4a239e0f tempest-SnapshotDependencyTests-1071981765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2eb844f-067f-437e-868a-0c8b9c124a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:49:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-578c289e-68c2-4ad1-86c4-b20c4a239e0f tempest-SnapshotDependencyTests-1071981765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2eb844f-067f-437e-868a-0c8b9c124a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:49:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-578c289e-68c2-4ad1-86c4-b20c4a239e0f tempest-SnapshotDependencyTests-1071981765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a05c47f0-fa71-41a3-aa80-18599cbf59f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:49:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-578c289e-68c2-4ad1-86c4-b20c4a239e0f tempest-SnapshotDependencyTests-1071981765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a05c47f0-fa71-41a3-aa80-18599cbf59f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fdd5dd46-c287-489f-a18e-43b69f69ff25', 'volume_name': 'volume-fdd5dd46-c287-489f-a18e-43b69f69ff25', 'volume_size': 1, 'snapshot_id': '66baa1c6-3ad2-4596-b2b5-e17471655c86'}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:49:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-578c289e-68c2-4ad1-86c4-b20c4a239e0f tempest-SnapshotDependencyTests-1071981765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b020a673-8266-4767-8080-9a3c5af5a016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:49:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-578c289e-68c2-4ad1-86c4-b20c4a239e0f tempest-SnapshotDependencyTests-1071981765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b020a673-8266-4767-8080-9a3c5af5a016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:49:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-578c289e-68c2-4ad1-86c4-b20c4a239e0f tempest-SnapshotDependencyTests-1071981765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee68d8e9-4543-4c2d-b338-358743acce58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:49:59 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-578c289e-68c2-4ad1-86c4-b20c4a239e0f tempest-SnapshotDependencyTests-1071981765 None] Volume fdd5dd46-c287-489f-a18e-43b69f69ff25: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fdd5dd46-c287-489f-a18e-43b69f69ff25', 'volume_size': 1, 'snapshot_id': '66baa1c6-3ad2-4596-b2b5-e17471655c86'} Sep 18 21:49:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-578c289e-68c2-4ad1-86c4-b20c4a239e0f tempest-SnapshotDependencyTests-1071981765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:49:59 devstack sudo[103685]: pam_unix(sudo:session): session closed for user root Sep 18 21:49:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f78b63a1-ab6a-4c26-ba3d-ed176a23ba5b tempest-VolumesSnapshotTestJSON-2116537629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3de922fa-8848-4554-9193-2f1ebada8138" returned: 0 in 0.382s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:49:59 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-f78b63a1-ab6a-4c26-ba3d-ed176a23ba5b tempest-VolumesSnapshotTestJSON-2116537629 None] will copy from snapshot at /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3de922fa-8848-4554-9193-2f1ebada8138 {{(pid=86136) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 18 21:49:59 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-f78b63a1-ab6a-4c26-ba3d-ed176a23ba5b tempest-VolumesSnapshotTestJSON-2116537629 None] Creating direct copy from snapshot {{(pid=86136) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 18 21:49:59 devstack cinder-volume[86136]: DEBUG cinder.utils [None req-f78b63a1-ab6a-4c26-ba3d-ed176a23ba5b tempest-VolumesSnapshotTestJSON-2116537629 None] Path /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-48823379-d7b0-4cc9-a803-83db6f22b8a2 not found in is_blk_device check {{(pid=86136) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 18 21:49:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f78b63a1-ab6a-4c26-ba3d-ed176a23ba5b tempest-VolumesSnapshotTestJSON-2116537629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3de922fa-8848-4554-9193-2f1ebada8138 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-48823379-d7b0-4cc9-a803-83db6f22b8a2 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:49:59 devstack sudo[103690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3de922fa-8848-4554-9193-2f1ebada8138 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-48823379-d7b0-4cc9-a803-83db6f22b8a2 Sep 18 21:49:59 devstack sudo[103690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:50:05 devstack cinder-volume[86136]: DEBUG oslo_service.periodic_task [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86136) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 21:50:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:50:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:50:05 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:50:05 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:50:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:50:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:50:05 devstack sudo[103704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:50:05 devstack sudo[103704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:50:05 devstack sudo[103690]: pam_unix(sudo:session): session closed for user root Sep 18 21:50:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f78b63a1-ab6a-4c26-ba3d-ed176a23ba5b tempest-VolumesSnapshotTestJSON-2116537629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3de922fa-8848-4554-9193-2f1ebada8138 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-48823379-d7b0-4cc9-a803-83db6f22b8a2" returned: 0 in 5.935s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:50:05 devstack cinder-volume[86136]: DEBUG cinder.image.image_utils [None req-f78b63a1-ab6a-4c26-ba3d-ed176a23ba5b tempest-VolumesSnapshotTestJSON-2116537629 None] Image conversion details: src /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3de922fa-8848-4554-9193-2f1ebada8138, size 1024.00 MB, duration 5.94 sec, destination /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-48823379-d7b0-4cc9-a803-83db6f22b8a2 {{(pid=86136) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 18 21:50:05 devstack cinder-volume[86136]: INFO cinder.image.image_utils [None req-f78b63a1-ab6a-4c26-ba3d-ed176a23ba5b tempest-VolumesSnapshotTestJSON-2116537629 None] Converted 1024.00 MB image at 172.49 MB/s Sep 18 21:50:05 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-f78b63a1-ab6a-4c26-ba3d-ed176a23ba5b tempest-VolumesSnapshotTestJSON-2116537629 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-48823379-d7b0-4cc9-a803-83db6f22b8a2 is being set with open permissions: ugo+rw Sep 18 21:50:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f78b63a1-ab6a-4c26-ba3d-ed176a23ba5b tempest-VolumesSnapshotTestJSON-2116537629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-48823379-d7b0-4cc9-a803-83db6f22b8a2 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:50:05 devstack sudo[103706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-48823379-d7b0-4cc9-a803-83db6f22b8a2 Sep 18 21:50:05 devstack sudo[103706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:50:05 devstack sudo[103704]: pam_unix(sudo:session): session closed for user root Sep 18 21:50:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.274s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:50:05 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:50:05 devstack cinder-volume[86136]: DEBUG oslo_service.periodic_task [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Running periodic task VolumeManager._thread_info {{(pid=86136) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 21:50:05 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] thread count: 28 {{(pid=86136) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 18 21:50:05 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] thread info: [<_MainThread(MainThread, started 138548347871360)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86136) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 18 21:50:05 devstack sudo[103706]: pam_unix(sudo:session): session closed for user root Sep 18 21:50:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f78b63a1-ab6a-4c26-ba3d-ed176a23ba5b tempest-VolumesSnapshotTestJSON-2116537629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-48823379-d7b0-4cc9-a803-83db6f22b8a2" returned: 0 in 0.244s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:50:05 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-f78b63a1-ab6a-4c26-ba3d-ed176a23ba5b tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "cinder-quobyte-48823379-d7b0-4cc9-a803-83db6f22b8a2" released by "_copy_volume_from_snapshot" :: held 7.038s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:50:05 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-f78b63a1-ab6a-4c26-ba3d-ed176a23ba5b tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "cinder-quobyte-00e52ca3-9551-4665-b22b-09c417a5121d-48823379-d7b0-4cc9-a803-83db6f22b8a2" released by "_create_volume_from_snapshot" :: held 7.104s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:50:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-f78b63a1-ab6a-4c26-ba3d-ed176a23ba5b tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.125s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:50:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-578c289e-68c2-4ad1-86c4-b20c4a239e0f tempest-SnapshotDependencyTests-1071981765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 6.268s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:50:05 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-578c289e-68c2-4ad1-86c4-b20c4a239e0f tempest-SnapshotDependencyTests-1071981765 None] Acquiring lock "cinder-quobyte-66baa1c6-3ad2-4596-b2b5-e17471655c86-fdd5dd46-c287-489f-a18e-43b69f69ff25" by "_create_volume_from_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:50:05 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-578c289e-68c2-4ad1-86c4-b20c4a239e0f tempest-SnapshotDependencyTests-1071981765 None] Lock "cinder-quobyte-66baa1c6-3ad2-4596-b2b5-e17471655c86-fdd5dd46-c287-489f-a18e-43b69f69ff25" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:50:05 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-578c289e-68c2-4ad1-86c4-b20c4a239e0f tempest-SnapshotDependencyTests-1071981765 None] Creating volume fdd5dd46-c287-489f-a18e-43b69f69ff25 from snapshot 66baa1c6-3ad2-4596-b2b5-e17471655c86 {{(pid=86136) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 18 21:50:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-578c289e-68c2-4ad1-86c4-b20c4a239e0f tempest-SnapshotDependencyTests-1071981765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:50:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-578c289e-68c2-4ad1-86c4-b20c4a239e0f tempest-SnapshotDependencyTests-1071981765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:50:05 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-578c289e-68c2-4ad1-86c4-b20c4a239e0f tempest-SnapshotDependencyTests-1071981765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:50:05 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-578c289e-68c2-4ad1-86c4-b20c4a239e0f tempest-SnapshotDependencyTests-1071981765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:50:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-578c289e-68c2-4ad1-86c4-b20c4a239e0f tempest-SnapshotDependencyTests-1071981765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:50:05 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-578c289e-68c2-4ad1-86c4-b20c4a239e0f tempest-SnapshotDependencyTests-1071981765 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:50:05 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-578c289e-68c2-4ad1-86c4-b20c4a239e0f tempest-SnapshotDependencyTests-1071981765 None] Acquiring lock "cinder-quobyte-fdd5dd46-c287-489f-a18e-43b69f69ff25" by "_copy_volume_from_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:50:05 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f78b63a1-ab6a-4c26-ba3d-ed176a23ba5b tempest-VolumesSnapshotTestJSON-2116537629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7b12790-66b6-457e-8ed7-96f362ac1edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48823379-d7b0-4cc9-a803-83db6f22b8a2', 'volume_size': 1, 'snapshot_id': '00e52ca3-9551-4665-b22b-09c417a5121d'}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:50:05 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f78b63a1-ab6a-4c26-ba3d-ed176a23ba5b tempest-VolumesSnapshotTestJSON-2116537629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (099c4721-1b6f-45d1-a6bd-b898961971e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:50:05 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-578c289e-68c2-4ad1-86c4-b20c4a239e0f tempest-SnapshotDependencyTests-1071981765 None] Lock "cinder-quobyte-fdd5dd46-c287-489f-a18e-43b69f69ff25" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:50:05 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-578c289e-68c2-4ad1-86c4-b20c4a239e0f tempest-SnapshotDependencyTests-1071981765 None] snapshot: 66baa1c6-3ad2-4596-b2b5-e17471655c86, volume: fdd5dd46-c287-489f-a18e-43b69f69ff25, {{(pid=86136) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 18 21:50:05 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-f78b63a1-ab6a-4c26-ba3d-ed176a23ba5b tempest-VolumesSnapshotTestJSON-2116537629 None] Volume volume-48823379-d7b0-4cc9-a803-83db6f22b8a2 (48823379-d7b0-4cc9-a803-83db6f22b8a2): created successfully Sep 18 21:50:05 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f78b63a1-ab6a-4c26-ba3d-ed176a23ba5b tempest-VolumesSnapshotTestJSON-2116537629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (099c4721-1b6f-45d1-a6bd-b898961971e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:50:05 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f78b63a1-ab6a-4c26-ba3d-ed176a23ba5b tempest-VolumesSnapshotTestJSON-2116537629 None] Flow 'volume_create_manager' (6fd36c78-6603-481a-a8e4-b5ee7d17b11e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:50:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-578c289e-68c2-4ad1-86c4-b20c4a239e0f tempest-SnapshotDependencyTests-1071981765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:50:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-578c289e-68c2-4ad1-86c4-b20c4a239e0f tempest-SnapshotDependencyTests-1071981765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:50:05 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-578c289e-68c2-4ad1-86c4-b20c4a239e0f tempest-SnapshotDependencyTests-1071981765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:50:05 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-578c289e-68c2-4ad1-86c4-b20c4a239e0f tempest-SnapshotDependencyTests-1071981765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:50:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-578c289e-68c2-4ad1-86c4-b20c4a239e0f tempest-SnapshotDependencyTests-1071981765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:50:05 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[b08bf50b-16f2-437e-843f-dc5a8fa81585]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:50:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-578c289e-68c2-4ad1-86c4-b20c4a239e0f tempest-SnapshotDependencyTests-1071981765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a.66baa1c6-3ad2-4596-b2b5-e17471655c86 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:50:05 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-f78b63a1-ab6a-4c26-ba3d-ed176a23ba5b tempest-VolumesSnapshotTestJSON-2116537629 None] Created volume successfully. Sep 18 21:50:05 devstack sudo[103710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a.66baa1c6-3ad2-4596-b2b5-e17471655c86 Sep 18 21:50:05 devstack sudo[103710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:50:06 devstack sudo[103710]: pam_unix(sudo:session): session closed for user root Sep 18 21:50:06 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-578c289e-68c2-4ad1-86c4-b20c4a239e0f tempest-SnapshotDependencyTests-1071981765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a.66baa1c6-3ad2-4596-b2b5-e17471655c86" returned: 0 in 0.353s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:50:06 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-578c289e-68c2-4ad1-86c4-b20c4a239e0f tempest-SnapshotDependencyTests-1071981765 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86136) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 21:50:06 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ff5dd8-0cd6-482d-97eb-81e4c4f1756e]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:50:06 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-578c289e-68c2-4ad1-86c4-b20c4a239e0f tempest-SnapshotDependencyTests-1071981765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:50:06 devstack sudo[103716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a Sep 18 21:50:06 devstack sudo[103716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:50:06 devstack sudo[103716]: pam_unix(sudo:session): session closed for user root Sep 18 21:50:06 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-578c289e-68c2-4ad1-86c4-b20c4a239e0f tempest-SnapshotDependencyTests-1071981765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a" returned: 0 in 0.353s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:50:06 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-578c289e-68c2-4ad1-86c4-b20c4a239e0f tempest-SnapshotDependencyTests-1071981765 None] will copy from snapshot at /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a {{(pid=86136) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 18 21:50:06 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-578c289e-68c2-4ad1-86c4-b20c4a239e0f tempest-SnapshotDependencyTests-1071981765 None] Creating direct copy from snapshot {{(pid=86136) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 18 21:50:06 devstack cinder-volume[86136]: DEBUG cinder.utils [None req-578c289e-68c2-4ad1-86c4-b20c4a239e0f tempest-SnapshotDependencyTests-1071981765 None] Path /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fdd5dd46-c287-489f-a18e-43b69f69ff25 not found in is_blk_device check {{(pid=86136) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 18 21:50:06 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-578c289e-68c2-4ad1-86c4-b20c4a239e0f tempest-SnapshotDependencyTests-1071981765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fdd5dd46-c287-489f-a18e-43b69f69ff25 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:50:06 devstack sudo[103721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fdd5dd46-c287-489f-a18e-43b69f69ff25 Sep 18 21:50:06 devstack sudo[103721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:50:06 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d69477c5-ba56-4c7b-9494-f84b4db51e6c tempest-VolumesSnapshotTestJSON-2116537629 None] Acquiring lock "cinder-48823379-d7b0-4cc9-a803-83db6f22b8a2-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:50:06 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d69477c5-ba56-4c7b-9494-f84b4db51e6c tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "cinder-48823379-d7b0-4cc9-a803-83db6f22b8a2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:50:06 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d69477c5-ba56-4c7b-9494-f84b4db51e6c tempest-VolumesSnapshotTestJSON-2116537629 None] Acquiring lock "cinder-quobyte-48823379-d7b0-4cc9-a803-83db6f22b8a2" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:50:06 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d69477c5-ba56-4c7b-9494-f84b4db51e6c tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "cinder-quobyte-48823379-d7b0-4cc9-a803-83db6f22b8a2" acquired by "delete_volume" :: waited 0.018s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:50:06 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[c77578c3-c9bc-449a-805a-5f89a01f0652]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:50:06 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d69477c5-ba56-4c7b-9494-f84b4db51e6c tempest-VolumesSnapshotTestJSON-2116537629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-48823379-d7b0-4cc9-a803-83db6f22b8a2 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:50:06 devstack sudo[103726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-48823379-d7b0-4cc9-a803-83db6f22b8a2 Sep 18 21:50:06 devstack sudo[103726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:50:07 devstack sudo[103726]: pam_unix(sudo:session): session closed for user root Sep 18 21:50:07 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d69477c5-ba56-4c7b-9494-f84b4db51e6c tempest-VolumesSnapshotTestJSON-2116537629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-48823379-d7b0-4cc9-a803-83db6f22b8a2" returned: 0 in 0.462s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:50:07 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d69477c5-ba56-4c7b-9494-f84b4db51e6c tempest-VolumesSnapshotTestJSON-2116537629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-48823379-d7b0-4cc9-a803-83db6f22b8a2 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:50:07 devstack sudo[103739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-48823379-d7b0-4cc9-a803-83db6f22b8a2 Sep 18 21:50:07 devstack sudo[103739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:50:07 devstack sudo[103739]: pam_unix(sudo:session): session closed for user root Sep 18 21:50:07 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d69477c5-ba56-4c7b-9494-f84b4db51e6c tempest-VolumesSnapshotTestJSON-2116537629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-48823379-d7b0-4cc9-a803-83db6f22b8a2" returned: 0 in 0.332s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:50:07 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d69477c5-ba56-4c7b-9494-f84b4db51e6c tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "cinder-quobyte-48823379-d7b0-4cc9-a803-83db6f22b8a2" released by "delete_volume" :: held 0.854s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:50:07 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-d69477c5-ba56-4c7b-9494-f84b4db51e6c tempest-VolumesSnapshotTestJSON-2116537629 None] Created reservations ['d063f192-ada6-4df3-86cc-699c72cb420a', 'a4432ac8-e858-4cda-9d90-5d7fc3dcd00f', '8fdef2f3-905e-4e18-a6a4-ecf1103c4e17', '43edb962-8681-406d-9073-a102fec2fd31'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:50:07 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-d69477c5-ba56-4c7b-9494-f84b4db51e6c tempest-VolumesSnapshotTestJSON-2116537629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:50:07 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-d69477c5-ba56-4c7b-9494-f84b4db51e6c tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:50:07 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-d69477c5-ba56-4c7b-9494-f84b4db51e6c tempest-VolumesSnapshotTestJSON-2116537629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:50:07 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-d69477c5-ba56-4c7b-9494-f84b4db51e6c tempest-VolumesSnapshotTestJSON-2116537629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:50:07 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-d69477c5-ba56-4c7b-9494-f84b4db51e6c tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:50:07 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d69477c5-ba56-4c7b-9494-f84b4db51e6c tempest-VolumesSnapshotTestJSON-2116537629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:50:07 devstack sudo[103742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:50:07 devstack sudo[103742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:50:08 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-49fc4b2f-21bf-4111-adda-b6844a9b2bc7 tempest-VolumesSnapshotTestJSON-2116537629 None] Acquiring lock "cinder-00e52ca3-9551-4665-b22b-09c417a5121d-delete_snapshot" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:50:08 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-49fc4b2f-21bf-4111-adda-b6844a9b2bc7 tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "cinder-00e52ca3-9551-4665-b22b-09c417a5121d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:50:08 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-49fc4b2f-21bf-4111-adda-b6844a9b2bc7 tempest-VolumesSnapshotTestJSON-2116537629 None] Acquiring lock "cinder-quobyte-3de922fa-8848-4554-9193-2f1ebada8138" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:50:08 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-49fc4b2f-21bf-4111-adda-b6844a9b2bc7 tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "cinder-quobyte-3de922fa-8848-4554-9193-2f1ebada8138" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:50:08 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-49fc4b2f-21bf-4111-adda-b6844a9b2bc7 tempest-VolumesSnapshotTestJSON-2116537629 None] Acquiring lock "cinder-quobyte-00e52ca3-9551-4665-b22b-09c417a5121d" by "_delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:50:08 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-49fc4b2f-21bf-4111-adda-b6844a9b2bc7 tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "cinder-quobyte-00e52ca3-9551-4665-b22b-09c417a5121d" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:50:08 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-49fc4b2f-21bf-4111-adda-b6844a9b2bc7 tempest-VolumesSnapshotTestJSON-2116537629 None] Deleting offline snapshot 00e52ca3-9551-4665-b22b-09c417a5121d of volume 3de922fa-8848-4554-9193-2f1ebada8138 {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 21:50:08 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-49fc4b2f-21bf-4111-adda-b6844a9b2bc7 tempest-VolumesSnapshotTestJSON-2116537629 None] snapshot_file for this snap is: volume-3de922fa-8848-4554-9193-2f1ebada8138.00e52ca3-9551-4665-b22b-09c417a5121d {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 21:50:08 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f58deb8-af20-4d2a-89f3-fbe33ecff3b7]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:50:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-49fc4b2f-21bf-4111-adda-b6844a9b2bc7 tempest-VolumesSnapshotTestJSON-2116537629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3de922fa-8848-4554-9193-2f1ebada8138.00e52ca3-9551-4665-b22b-09c417a5121d {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:50:08 devstack sudo[103742]: pam_unix(sudo:session): session closed for user root Sep 18 21:50:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d69477c5-ba56-4c7b-9494-f84b4db51e6c tempest-VolumesSnapshotTestJSON-2116537629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.402s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:50:08 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-d69477c5-ba56-4c7b-9494-f84b4db51e6c tempest-VolumesSnapshotTestJSON-2116537629 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:50:08 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-d69477c5-ba56-4c7b-9494-f84b4db51e6c tempest-VolumesSnapshotTestJSON-2116537629 None] Deleted volume successfully. Sep 18 21:50:08 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d69477c5-ba56-4c7b-9494-f84b4db51e6c tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "cinder-48823379-d7b0-4cc9-a803-83db6f22b8a2-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:50:08 devstack sudo[103745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3de922fa-8848-4554-9193-2f1ebada8138.00e52ca3-9551-4665-b22b-09c417a5121d Sep 18 21:50:08 devstack sudo[103745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:50:08 devstack sudo[103745]: pam_unix(sudo:session): session closed for user root Sep 18 21:50:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-49fc4b2f-21bf-4111-adda-b6844a9b2bc7 tempest-VolumesSnapshotTestJSON-2116537629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3de922fa-8848-4554-9193-2f1ebada8138.00e52ca3-9551-4665-b22b-09c417a5121d" returned: 0 in 0.810s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:50:09 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-49fc4b2f-21bf-4111-adda-b6844a9b2bc7 tempest-VolumesSnapshotTestJSON-2116537629 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3de922fa-8848-4554-9193-2f1ebada8138(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86136) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 21:50:09 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[45504104-00c6-4c98-8483-2dd07b5cd628]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:50:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-49fc4b2f-21bf-4111-adda-b6844a9b2bc7 tempest-VolumesSnapshotTestJSON-2116537629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3de922fa-8848-4554-9193-2f1ebada8138 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:50:09 devstack sudo[103754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3de922fa-8848-4554-9193-2f1ebada8138 Sep 18 21:50:09 devstack sudo[103754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:50:10 devstack sudo[103754]: pam_unix(sudo:session): session closed for user root Sep 18 21:50:10 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-49fc4b2f-21bf-4111-adda-b6844a9b2bc7 tempest-VolumesSnapshotTestJSON-2116537629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3de922fa-8848-4554-9193-2f1ebada8138" returned: 0 in 1.046s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:50:10 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-49fc4b2f-21bf-4111-adda-b6844a9b2bc7 tempest-VolumesSnapshotTestJSON-2116537629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3de922fa-8848-4554-9193-2f1ebada8138.00e52ca3-9551-4665-b22b-09c417a5121d {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:50:10 devstack sudo[103759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3de922fa-8848-4554-9193-2f1ebada8138.00e52ca3-9551-4665-b22b-09c417a5121d Sep 18 21:50:10 devstack sudo[103759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:50:10 devstack sudo[103759]: pam_unix(sudo:session): session closed for user root Sep 18 21:50:10 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-49fc4b2f-21bf-4111-adda-b6844a9b2bc7 tempest-VolumesSnapshotTestJSON-2116537629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3de922fa-8848-4554-9193-2f1ebada8138.00e52ca3-9551-4665-b22b-09c417a5121d" returned: 0 in 0.738s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:50:10 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-49fc4b2f-21bf-4111-adda-b6844a9b2bc7 tempest-VolumesSnapshotTestJSON-2116537629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3de922fa-8848-4554-9193-2f1ebada8138.00e52ca3-9551-4665-b22b-09c417a5121d {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:50:10 devstack sudo[103765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3de922fa-8848-4554-9193-2f1ebada8138.00e52ca3-9551-4665-b22b-09c417a5121d Sep 18 21:50:10 devstack sudo[103765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:50:11 devstack sudo[103765]: pam_unix(sudo:session): session closed for user root Sep 18 21:50:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-49fc4b2f-21bf-4111-adda-b6844a9b2bc7 tempest-VolumesSnapshotTestJSON-2116537629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3de922fa-8848-4554-9193-2f1ebada8138.00e52ca3-9551-4665-b22b-09c417a5121d" returned: 0 in 0.338s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:50:11 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-49fc4b2f-21bf-4111-adda-b6844a9b2bc7 tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "cinder-quobyte-00e52ca3-9551-4665-b22b-09c417a5121d" released by "_delete_snapshot" :: held 3.163s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:50:11 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-49fc4b2f-21bf-4111-adda-b6844a9b2bc7 tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "cinder-quobyte-3de922fa-8848-4554-9193-2f1ebada8138" released by "delete_snapshot" :: held 3.188s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:50:11 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-49fc4b2f-21bf-4111-adda-b6844a9b2bc7 tempest-VolumesSnapshotTestJSON-2116537629 None] Created reservations ['f2f40249-595c-40f0-8923-bf9d0380d478', '2c809282-5435-4855-90b4-d7bc655fce20', '815a74f6-76ab-42d7-b0ff-bb0fb6f9d292', '74053833-3ed9-44dc-98df-f152429d43c8'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:50:11 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-49fc4b2f-21bf-4111-adda-b6844a9b2bc7 tempest-VolumesSnapshotTestJSON-2116537629 None] Delete snapshot completed successfully. Sep 18 21:50:11 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-49fc4b2f-21bf-4111-adda-b6844a9b2bc7 tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "cinder-00e52ca3-9551-4665-b22b-09c417a5121d-delete_snapshot" released by "delete_snapshot" :: held 3.419s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:50:12 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-c23744a3-2454-415b-b6f7-64e78e0d44da tempest-VolumesSnapshotTestJSON-2116537629 None] Acquiring lock "cinder-3de922fa-8848-4554-9193-2f1ebada8138-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:50:12 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-c23744a3-2454-415b-b6f7-64e78e0d44da tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "cinder-3de922fa-8848-4554-9193-2f1ebada8138-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:50:12 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-c23744a3-2454-415b-b6f7-64e78e0d44da tempest-VolumesSnapshotTestJSON-2116537629 None] Acquiring lock "cinder-quobyte-3de922fa-8848-4554-9193-2f1ebada8138" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:50:12 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-c23744a3-2454-415b-b6f7-64e78e0d44da tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "cinder-quobyte-3de922fa-8848-4554-9193-2f1ebada8138" acquired by "delete_volume" :: waited 0.023s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:50:12 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbfd6b9c-0156-425e-b2a5-5c7b595df37a]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:50:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c23744a3-2454-415b-b6f7-64e78e0d44da tempest-VolumesSnapshotTestJSON-2116537629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3de922fa-8848-4554-9193-2f1ebada8138 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:50:12 devstack sudo[103768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3de922fa-8848-4554-9193-2f1ebada8138 Sep 18 21:50:12 devstack sudo[103768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:50:13 devstack sudo[103768]: pam_unix(sudo:session): session closed for user root Sep 18 21:50:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c23744a3-2454-415b-b6f7-64e78e0d44da tempest-VolumesSnapshotTestJSON-2116537629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3de922fa-8848-4554-9193-2f1ebada8138" returned: 0 in 0.575s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:50:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c23744a3-2454-415b-b6f7-64e78e0d44da tempest-VolumesSnapshotTestJSON-2116537629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3de922fa-8848-4554-9193-2f1ebada8138 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:50:13 devstack sudo[103774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3de922fa-8848-4554-9193-2f1ebada8138 Sep 18 21:50:13 devstack sudo[103774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:50:13 devstack sudo[103721]: pam_unix(sudo:session): session closed for user root Sep 18 21:50:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-578c289e-68c2-4ad1-86c4-b20c4a239e0f tempest-SnapshotDependencyTests-1071981765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fdd5dd46-c287-489f-a18e-43b69f69ff25" returned: 0 in 6.839s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:50:13 devstack cinder-volume[86136]: DEBUG cinder.image.image_utils [None req-578c289e-68c2-4ad1-86c4-b20c4a239e0f tempest-SnapshotDependencyTests-1071981765 None] Image conversion details: src /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a, size 1024.00 MB, duration 6.84 sec, destination /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fdd5dd46-c287-489f-a18e-43b69f69ff25 {{(pid=86136) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 18 21:50:13 devstack cinder-volume[86136]: INFO cinder.image.image_utils [None req-578c289e-68c2-4ad1-86c4-b20c4a239e0f tempest-SnapshotDependencyTests-1071981765 None] Converted 1024.00 MB image at 149.70 MB/s Sep 18 21:50:13 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-578c289e-68c2-4ad1-86c4-b20c4a239e0f tempest-SnapshotDependencyTests-1071981765 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fdd5dd46-c287-489f-a18e-43b69f69ff25 is being set with open permissions: ugo+rw Sep 18 21:50:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-578c289e-68c2-4ad1-86c4-b20c4a239e0f tempest-SnapshotDependencyTests-1071981765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fdd5dd46-c287-489f-a18e-43b69f69ff25 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:50:13 devstack sudo[103776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fdd5dd46-c287-489f-a18e-43b69f69ff25 Sep 18 21:50:13 devstack sudo[103776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:50:13 devstack sudo[103774]: pam_unix(sudo:session): session closed for user root Sep 18 21:50:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c23744a3-2454-415b-b6f7-64e78e0d44da tempest-VolumesSnapshotTestJSON-2116537629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-3de922fa-8848-4554-9193-2f1ebada8138" returned: 0 in 0.255s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:50:13 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-c23744a3-2454-415b-b6f7-64e78e0d44da tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "cinder-quobyte-3de922fa-8848-4554-9193-2f1ebada8138" released by "delete_volume" :: held 0.936s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:50:13 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-c23744a3-2454-415b-b6f7-64e78e0d44da tempest-VolumesSnapshotTestJSON-2116537629 None] Created reservations ['ddfb6fef-ac1e-4ca1-be23-295f7a432c3c', '7ac363fc-03be-4707-a305-3cc6216dfaf5', '87f1a612-8b21-4777-9750-e36ef058c5eb', '07bad13b-fb85-4c53-a5f4-ff065ce5b5e3'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:50:13 devstack sudo[103776]: pam_unix(sudo:session): session closed for user root Sep 18 21:50:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-578c289e-68c2-4ad1-86c4-b20c4a239e0f tempest-SnapshotDependencyTests-1071981765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fdd5dd46-c287-489f-a18e-43b69f69ff25" returned: 0 in 0.260s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:50:13 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-578c289e-68c2-4ad1-86c4-b20c4a239e0f tempest-SnapshotDependencyTests-1071981765 None] Lock "cinder-quobyte-fdd5dd46-c287-489f-a18e-43b69f69ff25" released by "_copy_volume_from_snapshot" :: held 7.895s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:50:13 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-578c289e-68c2-4ad1-86c4-b20c4a239e0f tempest-SnapshotDependencyTests-1071981765 None] Lock "cinder-quobyte-66baa1c6-3ad2-4596-b2b5-e17471655c86-fdd5dd46-c287-489f-a18e-43b69f69ff25" released by "_create_volume_from_snapshot" :: held 7.991s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:50:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-578c289e-68c2-4ad1-86c4-b20c4a239e0f tempest-SnapshotDependencyTests-1071981765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.012s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:50:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c23744a3-2454-415b-b6f7-64e78e0d44da tempest-VolumesSnapshotTestJSON-2116537629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:50:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c23744a3-2454-415b-b6f7-64e78e0d44da tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:50:13 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-c23744a3-2454-415b-b6f7-64e78e0d44da tempest-VolumesSnapshotTestJSON-2116537629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:50:13 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-c23744a3-2454-415b-b6f7-64e78e0d44da tempest-VolumesSnapshotTestJSON-2116537629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:50:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c23744a3-2454-415b-b6f7-64e78e0d44da tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:50:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c23744a3-2454-415b-b6f7-64e78e0d44da tempest-VolumesSnapshotTestJSON-2116537629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:50:13 devstack sudo[103780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:50:13 devstack sudo[103780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:50:13 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-578c289e-68c2-4ad1-86c4-b20c4a239e0f tempest-SnapshotDependencyTests-1071981765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee68d8e9-4543-4c2d-b338-358743acce58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdd5dd46-c287-489f-a18e-43b69f69ff25', 'volume_size': 1, 'snapshot_id': '66baa1c6-3ad2-4596-b2b5-e17471655c86'}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:50:13 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-578c289e-68c2-4ad1-86c4-b20c4a239e0f tempest-SnapshotDependencyTests-1071981765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10abbf20-bd0b-428a-8171-06e05e0c7a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:50:13 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-578c289e-68c2-4ad1-86c4-b20c4a239e0f tempest-SnapshotDependencyTests-1071981765 None] Volume volume-fdd5dd46-c287-489f-a18e-43b69f69ff25 (fdd5dd46-c287-489f-a18e-43b69f69ff25): created successfully Sep 18 21:50:13 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-578c289e-68c2-4ad1-86c4-b20c4a239e0f tempest-SnapshotDependencyTests-1071981765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10abbf20-bd0b-428a-8171-06e05e0c7a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:50:13 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-578c289e-68c2-4ad1-86c4-b20c4a239e0f tempest-SnapshotDependencyTests-1071981765 None] Flow 'volume_create_manager' (cc81fa53-9ab7-4023-be5f-98129a7b5c29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:50:13 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-578c289e-68c2-4ad1-86c4-b20c4a239e0f tempest-SnapshotDependencyTests-1071981765 None] Created volume successfully. Sep 18 21:50:13 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-e4ce2518-6a9f-4780-a0bb-6da805d96085 tempest-VolumesSnapshotTestJSON-2116537629 None] Acquiring lock "cinder-44e67452-6317-4ed4-a3f9-4a8d8eabcfc5-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:50:13 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-e4ce2518-6a9f-4780-a0bb-6da805d96085 tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "cinder-44e67452-6317-4ed4-a3f9-4a8d8eabcfc5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:50:13 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-e4ce2518-6a9f-4780-a0bb-6da805d96085 tempest-VolumesSnapshotTestJSON-2116537629 None] Acquiring lock "cinder-quobyte-44e67452-6317-4ed4-a3f9-4a8d8eabcfc5" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:50:13 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-e4ce2518-6a9f-4780-a0bb-6da805d96085 tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "cinder-quobyte-44e67452-6317-4ed4-a3f9-4a8d8eabcfc5" acquired by "delete_volume" :: waited 0.016s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:50:13 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[b69f6ff7-9db4-4cdb-a57c-37624fe0ea7a]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:50:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e4ce2518-6a9f-4780-a0bb-6da805d96085 tempest-VolumesSnapshotTestJSON-2116537629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-44e67452-6317-4ed4-a3f9-4a8d8eabcfc5 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:50:13 devstack sudo[103780]: pam_unix(sudo:session): session closed for user root Sep 18 21:50:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c23744a3-2454-415b-b6f7-64e78e0d44da tempest-VolumesSnapshotTestJSON-2116537629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.245s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:50:13 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-c23744a3-2454-415b-b6f7-64e78e0d44da tempest-VolumesSnapshotTestJSON-2116537629 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:50:13 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-c23744a3-2454-415b-b6f7-64e78e0d44da tempest-VolumesSnapshotTestJSON-2116537629 None] Deleted volume successfully. Sep 18 21:50:13 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-c23744a3-2454-415b-b6f7-64e78e0d44da tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "cinder-3de922fa-8848-4554-9193-2f1ebada8138-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:50:14 devstack sudo[103783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-44e67452-6317-4ed4-a3f9-4a8d8eabcfc5 Sep 18 21:50:14 devstack sudo[103783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:50:14 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-28298376-6b12-495b-b660-dba6b266537e tempest-SnapshotDependencyTests-1071981765 None] Acquiring lock "cinder-66baa1c6-3ad2-4596-b2b5-e17471655c86-delete_snapshot" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:50:14 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-28298376-6b12-495b-b660-dba6b266537e tempest-SnapshotDependencyTests-1071981765 None] Lock "cinder-66baa1c6-3ad2-4596-b2b5-e17471655c86-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:50:14 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-28298376-6b12-495b-b660-dba6b266537e tempest-SnapshotDependencyTests-1071981765 None] Acquiring lock "cinder-quobyte-a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:50:14 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-28298376-6b12-495b-b660-dba6b266537e tempest-SnapshotDependencyTests-1071981765 None] Lock "cinder-quobyte-a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:50:14 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-28298376-6b12-495b-b660-dba6b266537e tempest-SnapshotDependencyTests-1071981765 None] Acquiring lock "cinder-quobyte-66baa1c6-3ad2-4596-b2b5-e17471655c86" by "_delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:50:14 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-28298376-6b12-495b-b660-dba6b266537e tempest-SnapshotDependencyTests-1071981765 None] Lock "cinder-quobyte-66baa1c6-3ad2-4596-b2b5-e17471655c86" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:50:14 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-28298376-6b12-495b-b660-dba6b266537e tempest-SnapshotDependencyTests-1071981765 None] Deleting offline snapshot 66baa1c6-3ad2-4596-b2b5-e17471655c86 of volume a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 21:50:14 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-28298376-6b12-495b-b660-dba6b266537e tempest-SnapshotDependencyTests-1071981765 None] snapshot_file for this snap is: volume-a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a.66baa1c6-3ad2-4596-b2b5-e17471655c86 {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 21:50:14 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[efbf026e-0c10-4917-8672-6f9d6bd9faae]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:50:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-28298376-6b12-495b-b660-dba6b266537e tempest-SnapshotDependencyTests-1071981765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a.66baa1c6-3ad2-4596-b2b5-e17471655c86 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:50:14 devstack sudo[103785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a.66baa1c6-3ad2-4596-b2b5-e17471655c86 Sep 18 21:50:14 devstack sudo[103785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:50:14 devstack sudo[103783]: pam_unix(sudo:session): session closed for user root Sep 18 21:50:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e4ce2518-6a9f-4780-a0bb-6da805d96085 tempest-VolumesSnapshotTestJSON-2116537629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-44e67452-6317-4ed4-a3f9-4a8d8eabcfc5" returned: 0 in 0.413s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:50:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e4ce2518-6a9f-4780-a0bb-6da805d96085 tempest-VolumesSnapshotTestJSON-2116537629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-44e67452-6317-4ed4-a3f9-4a8d8eabcfc5 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:50:14 devstack sudo[103790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-44e67452-6317-4ed4-a3f9-4a8d8eabcfc5 Sep 18 21:50:14 devstack sudo[103790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:50:14 devstack sudo[103785]: pam_unix(sudo:session): session closed for user root Sep 18 21:50:14 devstack sudo[103790]: pam_unix(sudo:session): session closed for user root Sep 18 21:50:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-28298376-6b12-495b-b660-dba6b266537e tempest-SnapshotDependencyTests-1071981765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a.66baa1c6-3ad2-4596-b2b5-e17471655c86" returned: 0 in 0.377s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:50:14 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-28298376-6b12-495b-b660-dba6b266537e tempest-SnapshotDependencyTests-1071981765 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86136) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 21:50:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e4ce2518-6a9f-4780-a0bb-6da805d96085 tempest-VolumesSnapshotTestJSON-2116537629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-44e67452-6317-4ed4-a3f9-4a8d8eabcfc5" returned: 0 in 0.265s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:50:14 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[3755537f-8ce9-4908-b3bf-1b3b7972a793]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:50:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-28298376-6b12-495b-b660-dba6b266537e tempest-SnapshotDependencyTests-1071981765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:50:14 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-e4ce2518-6a9f-4780-a0bb-6da805d96085 tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "cinder-quobyte-44e67452-6317-4ed4-a3f9-4a8d8eabcfc5" released by "delete_volume" :: held 0.755s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:50:14 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-e4ce2518-6a9f-4780-a0bb-6da805d96085 tempest-VolumesSnapshotTestJSON-2116537629 None] Created reservations ['a54270f1-b21e-4653-b35d-ef31e5ae2fcf', '875334e9-9c69-4e2f-84ff-d04020b44222', '35221aa0-571b-4484-873d-1cbb7893af4e', 'f1071b10-d7c7-402c-91be-8b193f04cb4b'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:50:14 devstack sudo[103796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a Sep 18 21:50:14 devstack sudo[103796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:50:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-e4ce2518-6a9f-4780-a0bb-6da805d96085 tempest-VolumesSnapshotTestJSON-2116537629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:50:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-e4ce2518-6a9f-4780-a0bb-6da805d96085 tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:50:14 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-e4ce2518-6a9f-4780-a0bb-6da805d96085 tempest-VolumesSnapshotTestJSON-2116537629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:50:14 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-e4ce2518-6a9f-4780-a0bb-6da805d96085 tempest-VolumesSnapshotTestJSON-2116537629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:50:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-e4ce2518-6a9f-4780-a0bb-6da805d96085 tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:50:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e4ce2518-6a9f-4780-a0bb-6da805d96085 tempest-VolumesSnapshotTestJSON-2116537629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:50:14 devstack sudo[103798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:50:14 devstack sudo[103798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:50:14 devstack sudo[103798]: pam_unix(sudo:session): session closed for user root Sep 18 21:50:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e4ce2518-6a9f-4780-a0bb-6da805d96085 tempest-VolumesSnapshotTestJSON-2116537629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.271s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:50:14 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-e4ce2518-6a9f-4780-a0bb-6da805d96085 tempest-VolumesSnapshotTestJSON-2116537629 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:50:14 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-e4ce2518-6a9f-4780-a0bb-6da805d96085 tempest-VolumesSnapshotTestJSON-2116537629 None] Deleted volume successfully. Sep 18 21:50:14 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-e4ce2518-6a9f-4780-a0bb-6da805d96085 tempest-VolumesSnapshotTestJSON-2116537629 None] Lock "cinder-44e67452-6317-4ed4-a3f9-4a8d8eabcfc5-delete_volume" released by "delete_volume" :: held 1.230s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:50:15 devstack sudo[103796]: pam_unix(sudo:session): session closed for user root Sep 18 21:50:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-28298376-6b12-495b-b660-dba6b266537e tempest-SnapshotDependencyTests-1071981765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a" returned: 0 in 0.547s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:50:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-28298376-6b12-495b-b660-dba6b266537e tempest-SnapshotDependencyTests-1071981765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a.66baa1c6-3ad2-4596-b2b5-e17471655c86 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:50:15 devstack sudo[103805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a.66baa1c6-3ad2-4596-b2b5-e17471655c86 Sep 18 21:50:15 devstack sudo[103805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:50:15 devstack sudo[103805]: pam_unix(sudo:session): session closed for user root Sep 18 21:50:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-28298376-6b12-495b-b660-dba6b266537e tempest-SnapshotDependencyTests-1071981765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a.66baa1c6-3ad2-4596-b2b5-e17471655c86" returned: 0 in 0.337s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:50:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-28298376-6b12-495b-b660-dba6b266537e tempest-SnapshotDependencyTests-1071981765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a.66baa1c6-3ad2-4596-b2b5-e17471655c86 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:50:15 devstack sudo[103810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a.66baa1c6-3ad2-4596-b2b5-e17471655c86 Sep 18 21:50:15 devstack sudo[103810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:50:15 devstack sudo[103810]: pam_unix(sudo:session): session closed for user root Sep 18 21:50:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-28298376-6b12-495b-b660-dba6b266537e tempest-SnapshotDependencyTests-1071981765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a.66baa1c6-3ad2-4596-b2b5-e17471655c86" returned: 0 in 0.268s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:50:15 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-28298376-6b12-495b-b660-dba6b266537e tempest-SnapshotDependencyTests-1071981765 None] Lock "cinder-quobyte-66baa1c6-3ad2-4596-b2b5-e17471655c86" released by "_delete_snapshot" :: held 1.640s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:50:15 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-28298376-6b12-495b-b660-dba6b266537e tempest-SnapshotDependencyTests-1071981765 None] Lock "cinder-quobyte-a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a" released by "delete_snapshot" :: held 1.662s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:50:15 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-28298376-6b12-495b-b660-dba6b266537e tempest-SnapshotDependencyTests-1071981765 None] Created reservations ['88ccdfa5-d270-4f5b-a518-885ccbea55e4', '975400ec-069b-432d-9a08-299a775b6a0c', 'eacd20b4-d880-4fb5-9c74-3c89030a2e56', '4e1f2aa6-7a58-41e6-a28d-b14806065877'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:50:15 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-28298376-6b12-495b-b660-dba6b266537e tempest-SnapshotDependencyTests-1071981765 None] Delete snapshot completed successfully. Sep 18 21:50:15 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-28298376-6b12-495b-b660-dba6b266537e tempest-SnapshotDependencyTests-1071981765 None] Lock "cinder-66baa1c6-3ad2-4596-b2b5-e17471655c86-delete_snapshot" released by "delete_snapshot" :: held 1.805s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:50:16 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-e76a692d-536d-4c2b-a258-756719feefb6 tempest-SnapshotDependencyTests-1071981765 None] Acquiring lock "cinder-a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:50:16 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-e76a692d-536d-4c2b-a258-756719feefb6 tempest-SnapshotDependencyTests-1071981765 None] Lock "cinder-a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:50:16 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-e76a692d-536d-4c2b-a258-756719feefb6 tempest-SnapshotDependencyTests-1071981765 None] Acquiring lock "cinder-quobyte-a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:50:16 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-e76a692d-536d-4c2b-a258-756719feefb6 tempest-SnapshotDependencyTests-1071981765 None] Lock "cinder-quobyte-a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a" acquired by "delete_volume" :: waited 0.017s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:50:16 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[491f203e-5b55-40b7-9489-8f4b7f311596]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:50:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e76a692d-536d-4c2b-a258-756719feefb6 tempest-SnapshotDependencyTests-1071981765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:50:16 devstack sudo[103815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a Sep 18 21:50:16 devstack sudo[103815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:50:16 devstack sudo[103815]: pam_unix(sudo:session): session closed for user root Sep 18 21:50:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e76a692d-536d-4c2b-a258-756719feefb6 tempest-SnapshotDependencyTests-1071981765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a" returned: 0 in 0.369s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:50:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e76a692d-536d-4c2b-a258-756719feefb6 tempest-SnapshotDependencyTests-1071981765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:50:16 devstack sudo[103820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a Sep 18 21:50:16 devstack sudo[103820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:50:16 devstack sudo[103820]: pam_unix(sudo:session): session closed for user root Sep 18 21:50:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e76a692d-536d-4c2b-a258-756719feefb6 tempest-SnapshotDependencyTests-1071981765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a" returned: 0 in 0.250s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:50:17 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-e76a692d-536d-4c2b-a258-756719feefb6 tempest-SnapshotDependencyTests-1071981765 None] Lock "cinder-quobyte-a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a" released by "delete_volume" :: held 0.696s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:50:17 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-e76a692d-536d-4c2b-a258-756719feefb6 tempest-SnapshotDependencyTests-1071981765 None] Created reservations ['c6d996b4-f090-4cf7-92a0-3b1b215ed0d4', 'b08e7793-817d-4009-b31d-d64b029e7e4d', '68dcf07f-4e63-486c-b962-599ce9a99070', '189379ac-1829-40cc-b321-1b3d08ac5678'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:50:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-e76a692d-536d-4c2b-a258-756719feefb6 tempest-SnapshotDependencyTests-1071981765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:50:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-e76a692d-536d-4c2b-a258-756719feefb6 tempest-SnapshotDependencyTests-1071981765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:50:17 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-e76a692d-536d-4c2b-a258-756719feefb6 tempest-SnapshotDependencyTests-1071981765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:50:17 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-e76a692d-536d-4c2b-a258-756719feefb6 tempest-SnapshotDependencyTests-1071981765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:50:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-e76a692d-536d-4c2b-a258-756719feefb6 tempest-SnapshotDependencyTests-1071981765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:50:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e76a692d-536d-4c2b-a258-756719feefb6 tempest-SnapshotDependencyTests-1071981765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:50:17 devstack sudo[103823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:50:17 devstack sudo[103823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:50:17 devstack sudo[103823]: pam_unix(sudo:session): session closed for user root Sep 18 21:50:17 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-0f8579fd-0c5d-429b-a2cd-8ae62632a20f tempest-SnapshotDependencyTests-1071981765 None] Acquiring lock "cinder-fdd5dd46-c287-489f-a18e-43b69f69ff25-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:50:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e76a692d-536d-4c2b-a258-756719feefb6 tempest-SnapshotDependencyTests-1071981765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.281s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:50:17 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-e76a692d-536d-4c2b-a258-756719feefb6 tempest-SnapshotDependencyTests-1071981765 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:50:17 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-e76a692d-536d-4c2b-a258-756719feefb6 tempest-SnapshotDependencyTests-1071981765 None] Deleted volume successfully. Sep 18 21:50:17 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-0f8579fd-0c5d-429b-a2cd-8ae62632a20f tempest-SnapshotDependencyTests-1071981765 None] Lock "cinder-fdd5dd46-c287-489f-a18e-43b69f69ff25-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:50:17 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-e76a692d-536d-4c2b-a258-756719feefb6 tempest-SnapshotDependencyTests-1071981765 None] Lock "cinder-a5cb515c-f5a4-4c82-ae3f-156b64d6dd6a-delete_volume" released by "delete_volume" :: held 1.216s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:50:17 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-0f8579fd-0c5d-429b-a2cd-8ae62632a20f tempest-SnapshotDependencyTests-1071981765 None] Acquiring lock "cinder-quobyte-fdd5dd46-c287-489f-a18e-43b69f69ff25" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:50:17 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-0f8579fd-0c5d-429b-a2cd-8ae62632a20f tempest-SnapshotDependencyTests-1071981765 None] Lock "cinder-quobyte-fdd5dd46-c287-489f-a18e-43b69f69ff25" acquired by "delete_volume" :: waited 0.015s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:50:17 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[94909929-5694-43f2-9f72-58862ff2d9ba]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:50:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0f8579fd-0c5d-429b-a2cd-8ae62632a20f tempest-SnapshotDependencyTests-1071981765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fdd5dd46-c287-489f-a18e-43b69f69ff25 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:50:17 devstack sudo[103826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fdd5dd46-c287-489f-a18e-43b69f69ff25 Sep 18 21:50:17 devstack sudo[103826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:50:17 devstack sudo[103826]: pam_unix(sudo:session): session closed for user root Sep 18 21:50:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0f8579fd-0c5d-429b-a2cd-8ae62632a20f tempest-SnapshotDependencyTests-1071981765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fdd5dd46-c287-489f-a18e-43b69f69ff25" returned: 0 in 0.348s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:50:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0f8579fd-0c5d-429b-a2cd-8ae62632a20f tempest-SnapshotDependencyTests-1071981765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fdd5dd46-c287-489f-a18e-43b69f69ff25 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:50:17 devstack sudo[103831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fdd5dd46-c287-489f-a18e-43b69f69ff25 Sep 18 21:50:17 devstack sudo[103831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:50:18 devstack sudo[103831]: pam_unix(sudo:session): session closed for user root Sep 18 21:50:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0f8579fd-0c5d-429b-a2cd-8ae62632a20f tempest-SnapshotDependencyTests-1071981765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fdd5dd46-c287-489f-a18e-43b69f69ff25" returned: 0 in 0.251s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:50:18 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-0f8579fd-0c5d-429b-a2cd-8ae62632a20f tempest-SnapshotDependencyTests-1071981765 None] Lock "cinder-quobyte-fdd5dd46-c287-489f-a18e-43b69f69ff25" released by "delete_volume" :: held 0.641s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:50:18 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-0f8579fd-0c5d-429b-a2cd-8ae62632a20f tempest-SnapshotDependencyTests-1071981765 None] Created reservations ['102b66ac-0dfc-4ce1-87eb-842535376c38', '2529d5ae-04f9-432f-b106-e5059541fccc', 'e8ce3d41-42b6-4f16-8d28-42334768d3a5', 'd9eac6c9-13d7-4bdd-a66b-a5abc89fc171'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:50:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-0f8579fd-0c5d-429b-a2cd-8ae62632a20f tempest-SnapshotDependencyTests-1071981765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:50:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-0f8579fd-0c5d-429b-a2cd-8ae62632a20f tempest-SnapshotDependencyTests-1071981765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:50:18 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-0f8579fd-0c5d-429b-a2cd-8ae62632a20f tempest-SnapshotDependencyTests-1071981765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:50:18 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-0f8579fd-0c5d-429b-a2cd-8ae62632a20f tempest-SnapshotDependencyTests-1071981765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:50:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-0f8579fd-0c5d-429b-a2cd-8ae62632a20f tempest-SnapshotDependencyTests-1071981765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:50:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0f8579fd-0c5d-429b-a2cd-8ae62632a20f tempest-SnapshotDependencyTests-1071981765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:50:18 devstack sudo[103834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:50:18 devstack sudo[103834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:50:18 devstack sudo[103834]: pam_unix(sudo:session): session closed for user root Sep 18 21:50:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0f8579fd-0c5d-429b-a2cd-8ae62632a20f tempest-SnapshotDependencyTests-1071981765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.286s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:50:18 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-0f8579fd-0c5d-429b-a2cd-8ae62632a20f tempest-SnapshotDependencyTests-1071981765 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:50:18 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-0f8579fd-0c5d-429b-a2cd-8ae62632a20f tempest-SnapshotDependencyTests-1071981765 None] Deleted volume successfully. Sep 18 21:50:18 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-0f8579fd-0c5d-429b-a2cd-8ae62632a20f tempest-SnapshotDependencyTests-1071981765 None] Lock "cinder-fdd5dd46-c287-489f-a18e-43b69f69ff25-delete_volume" released by "delete_volume" :: held 1.200s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:50:21 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-557e5ab0-a8a0-43a8-95e4-4f27af5dbe23 tempest-CinderUnicodeTest-135127743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:50:21 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-557e5ab0-a8a0-43a8-95e4-4f27af5dbe23 tempest-CinderUnicodeTest-135127743 None] Flow 'volume_create_manager' (3a6a1c68-3681-42dc-aeff-8c069571052e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:50:21 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-557e5ab0-a8a0-43a8-95e4-4f27af5dbe23 tempest-CinderUnicodeTest-135127743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86e260e3-3f9d-4afa-8259-6cf6d6891ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:50:21 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-557e5ab0-a8a0-43a8-95e4-4f27af5dbe23 tempest-CinderUnicodeTest-135127743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86e260e3-3f9d-4afa-8259-6cf6d6891ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:50:22Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e23ecd6-4aae-493e-90b6-2eb2adc07001,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59339de28cf74067bab7519e1a1c48b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:50:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:50:22Z,use_quota=True,user_id='c3aa1f724f254ac1805f20604044695f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:50:21 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-557e5ab0-a8a0-43a8-95e4-4f27af5dbe23 tempest-CinderUnicodeTest-135127743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5407ae0d-1262-4c79-9582-f976079a62f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:50:21 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-557e5ab0-a8a0-43a8-95e4-4f27af5dbe23 tempest-CinderUnicodeTest-135127743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5407ae0d-1262-4c79-9582-f976079a62f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:50:21 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-557e5ab0-a8a0-43a8-95e4-4f27af5dbe23 tempest-CinderUnicodeTest-135127743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f23eeea-8d38-4d4c-966a-091b41b8c19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:50:21 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-557e5ab0-a8a0-43a8-95e4-4f27af5dbe23 tempest-CinderUnicodeTest-135127743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f23eeea-8d38-4d4c-966a-091b41b8c19e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e23ecd6-4aae-493e-90b6-2eb2adc07001', 'volume_name': 'volume-0e23ecd6-4aae-493e-90b6-2eb2adc07001', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:50:21 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-557e5ab0-a8a0-43a8-95e4-4f27af5dbe23 tempest-CinderUnicodeTest-135127743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c543b8e-5335-4640-8d7a-f10c78bdc922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:50:21 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-557e5ab0-a8a0-43a8-95e4-4f27af5dbe23 tempest-CinderUnicodeTest-135127743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c543b8e-5335-4640-8d7a-f10c78bdc922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:50:21 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-557e5ab0-a8a0-43a8-95e4-4f27af5dbe23 tempest-CinderUnicodeTest-135127743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc51e1d5-bf48-43b8-a26f-1c4611a1d87a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:50:21 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-557e5ab0-a8a0-43a8-95e4-4f27af5dbe23 tempest-CinderUnicodeTest-135127743 None] Volume 0e23ecd6-4aae-493e-90b6-2eb2adc07001: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e23ecd6-4aae-493e-90b6-2eb2adc07001', 'volume_size': 1} Sep 18 21:50:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-557e5ab0-a8a0-43a8-95e4-4f27af5dbe23 tempest-CinderUnicodeTest-135127743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:50:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-557e5ab0-a8a0-43a8-95e4-4f27af5dbe23 tempest-CinderUnicodeTest-135127743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:50:21 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-557e5ab0-a8a0-43a8-95e4-4f27af5dbe23 tempest-CinderUnicodeTest-135127743 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:50:22Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e23ecd6-4aae-493e-90b6-2eb2adc07001,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59339de28cf74067bab7519e1a1c48b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:50:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:50:22Z,use_quota=True,user_id='c3aa1f724f254ac1805f20604044695f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:50:21 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-557e5ab0-a8a0-43a8-95e4-4f27af5dbe23 tempest-CinderUnicodeTest-135127743 None] Creating volume 0e23ecd6-4aae-493e-90b6-2eb2adc07001 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:50:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-557e5ab0-a8a0-43a8-95e4-4f27af5dbe23 tempest-CinderUnicodeTest-135127743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:50:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-557e5ab0-a8a0-43a8-95e4-4f27af5dbe23 tempest-CinderUnicodeTest-135127743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:50:21 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-557e5ab0-a8a0-43a8-95e4-4f27af5dbe23 tempest-CinderUnicodeTest-135127743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:50:21 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-557e5ab0-a8a0-43a8-95e4-4f27af5dbe23 tempest-CinderUnicodeTest-135127743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:50:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-557e5ab0-a8a0-43a8-95e4-4f27af5dbe23 tempest-CinderUnicodeTest-135127743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:50:21 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-557e5ab0-a8a0-43a8-95e4-4f27af5dbe23 tempest-CinderUnicodeTest-135127743 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:50:21 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-557e5ab0-a8a0-43a8-95e4-4f27af5dbe23 tempest-CinderUnicodeTest-135127743 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:50:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-557e5ab0-a8a0-43a8-95e4-4f27af5dbe23 tempest-CinderUnicodeTest-135127743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-0e23ecd6-4aae-493e-90b6-2eb2adc07001 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:50:21 devstack sudo[103840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-0e23ecd6-4aae-493e-90b6-2eb2adc07001 1073741824 Sep 18 21:50:21 devstack sudo[103840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:50:22 devstack sudo[103840]: pam_unix(sudo:session): session closed for user root Sep 18 21:50:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-557e5ab0-a8a0-43a8-95e4-4f27af5dbe23 tempest-CinderUnicodeTest-135127743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-0e23ecd6-4aae-493e-90b6-2eb2adc07001 1073741824" returned: 0 in 0.470s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:50:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-557e5ab0-a8a0-43a8-95e4-4f27af5dbe23 tempest-CinderUnicodeTest-135127743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-0e23ecd6-4aae-493e-90b6-2eb2adc07001 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:50:22 devstack sudo[103846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-0e23ecd6-4aae-493e-90b6-2eb2adc07001 Sep 18 21:50:22 devstack sudo[103846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:50:22 devstack sudo[103846]: pam_unix(sudo:session): session closed for user root Sep 18 21:50:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-557e5ab0-a8a0-43a8-95e4-4f27af5dbe23 tempest-CinderUnicodeTest-135127743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-0e23ecd6-4aae-493e-90b6-2eb2adc07001" returned: 0 in 0.246s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:50:22 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-557e5ab0-a8a0-43a8-95e4-4f27af5dbe23 tempest-CinderUnicodeTest-135127743 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:50:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-557e5ab0-a8a0-43a8-95e4-4f27af5dbe23 tempest-CinderUnicodeTest-135127743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:50:22 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-557e5ab0-a8a0-43a8-95e4-4f27af5dbe23 tempest-CinderUnicodeTest-135127743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc51e1d5-bf48-43b8-a26f-1c4611a1d87a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e23ecd6-4aae-493e-90b6-2eb2adc07001', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:50:22 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-557e5ab0-a8a0-43a8-95e4-4f27af5dbe23 tempest-CinderUnicodeTest-135127743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f53e28a5-808e-4a50-9808-3eab135cf167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:50:22 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-557e5ab0-a8a0-43a8-95e4-4f27af5dbe23 tempest-CinderUnicodeTest-135127743 None] Volume volume-0e23ecd6-4aae-493e-90b6-2eb2adc07001 (0e23ecd6-4aae-493e-90b6-2eb2adc07001): created successfully Sep 18 21:50:22 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-557e5ab0-a8a0-43a8-95e4-4f27af5dbe23 tempest-CinderUnicodeTest-135127743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f53e28a5-808e-4a50-9808-3eab135cf167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:50:22 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-557e5ab0-a8a0-43a8-95e4-4f27af5dbe23 tempest-CinderUnicodeTest-135127743 None] Flow 'volume_create_manager' (3a6a1c68-3681-42dc-aeff-8c069571052e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:50:22 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-557e5ab0-a8a0-43a8-95e4-4f27af5dbe23 tempest-CinderUnicodeTest-135127743 None] Created volume successfully. Sep 18 21:50:23 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f16c91f-f2bc-43bc-a750-46917d9ed572 tempest-CinderUnicodeTest-135127743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:50:23 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-8f16c91f-f2bc-43bc-a750-46917d9ed572 tempest-CinderUnicodeTest-135127743 None] Flow 'volume_create_manager' (908bc75b-a321-433f-a8bb-b57d22a92d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:50:23 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-8f16c91f-f2bc-43bc-a750-46917d9ed572 tempest-CinderUnicodeTest-135127743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (135449e7-fbf4-4583-b225-9359a340c619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:50:23 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-8f16c91f-f2bc-43bc-a750-46917d9ed572 tempest-CinderUnicodeTest-135127743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (135449e7-fbf4-4583-b225-9359a340c619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:50:23Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-131756864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1104794-732a-4274-8677-db29175749e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59339de28cf74067bab7519e1a1c48b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:50:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:50:23Z,use_quota=True,user_id='c3aa1f724f254ac1805f20604044695f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:50:23 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-8f16c91f-f2bc-43bc-a750-46917d9ed572 tempest-CinderUnicodeTest-135127743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88b08bb6-bd52-4cb3-9e4b-5757577d0825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:50:23 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-8f16c91f-f2bc-43bc-a750-46917d9ed572 tempest-CinderUnicodeTest-135127743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88b08bb6-bd52-4cb3-9e4b-5757577d0825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:50:23 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-8f16c91f-f2bc-43bc-a750-46917d9ed572 tempest-CinderUnicodeTest-135127743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9534d6a3-1ff8-4887-a1be-9a819982c08f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:50:23 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-8f16c91f-f2bc-43bc-a750-46917d9ed572 tempest-CinderUnicodeTest-135127743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9534d6a3-1ff8-4887-a1be-9a819982c08f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1104794-732a-4274-8677-db29175749e1', 'volume_name': 'volume-b1104794-732a-4274-8677-db29175749e1', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:50:23 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-8f16c91f-f2bc-43bc-a750-46917d9ed572 tempest-CinderUnicodeTest-135127743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e12642c-4790-4d4c-8e2c-7dbf38eb80f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:50:23 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-8f16c91f-f2bc-43bc-a750-46917d9ed572 tempest-CinderUnicodeTest-135127743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e12642c-4790-4d4c-8e2c-7dbf38eb80f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:50:23 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-8f16c91f-f2bc-43bc-a750-46917d9ed572 tempest-CinderUnicodeTest-135127743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (710fbaf7-1092-4a21-8331-7469d5e4f638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:50:23 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-8f16c91f-f2bc-43bc-a750-46917d9ed572 tempest-CinderUnicodeTest-135127743 None] Volume b1104794-732a-4274-8677-db29175749e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1104794-732a-4274-8677-db29175749e1', 'volume_size': 1} Sep 18 21:50:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-8f16c91f-f2bc-43bc-a750-46917d9ed572 tempest-CinderUnicodeTest-135127743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:50:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-8f16c91f-f2bc-43bc-a750-46917d9ed572 tempest-CinderUnicodeTest-135127743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:50:23 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-8f16c91f-f2bc-43bc-a750-46917d9ed572 tempest-CinderUnicodeTest-135127743 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:50:23Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-131756864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1104794-732a-4274-8677-db29175749e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59339de28cf74067bab7519e1a1c48b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:50:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:50:23Z,use_quota=True,user_id='c3aa1f724f254ac1805f20604044695f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:50:23 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-8f16c91f-f2bc-43bc-a750-46917d9ed572 tempest-CinderUnicodeTest-135127743 None] Creating volume b1104794-732a-4274-8677-db29175749e1 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:50:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-8f16c91f-f2bc-43bc-a750-46917d9ed572 tempest-CinderUnicodeTest-135127743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:50:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-8f16c91f-f2bc-43bc-a750-46917d9ed572 tempest-CinderUnicodeTest-135127743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:50:23 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-8f16c91f-f2bc-43bc-a750-46917d9ed572 tempest-CinderUnicodeTest-135127743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:50:23 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-8f16c91f-f2bc-43bc-a750-46917d9ed572 tempest-CinderUnicodeTest-135127743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:50:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-8f16c91f-f2bc-43bc-a750-46917d9ed572 tempest-CinderUnicodeTest-135127743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:50:23 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-8f16c91f-f2bc-43bc-a750-46917d9ed572 tempest-CinderUnicodeTest-135127743 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:50:23 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-8f16c91f-f2bc-43bc-a750-46917d9ed572 tempest-CinderUnicodeTest-135127743 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:50:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-8f16c91f-f2bc-43bc-a750-46917d9ed572 tempest-CinderUnicodeTest-135127743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b1104794-732a-4274-8677-db29175749e1 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:50:23 devstack sudo[103850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b1104794-732a-4274-8677-db29175749e1 1073741824 Sep 18 21:50:23 devstack sudo[103850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:50:24 devstack sudo[103850]: pam_unix(sudo:session): session closed for user root Sep 18 21:50:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-8f16c91f-f2bc-43bc-a750-46917d9ed572 tempest-CinderUnicodeTest-135127743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b1104794-732a-4274-8677-db29175749e1 1073741824" returned: 0 in 0.484s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:50:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-8f16c91f-f2bc-43bc-a750-46917d9ed572 tempest-CinderUnicodeTest-135127743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b1104794-732a-4274-8677-db29175749e1 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:50:24 devstack sudo[103855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b1104794-732a-4274-8677-db29175749e1 Sep 18 21:50:24 devstack sudo[103855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:50:24 devstack sudo[103855]: pam_unix(sudo:session): session closed for user root Sep 18 21:50:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-8f16c91f-f2bc-43bc-a750-46917d9ed572 tempest-CinderUnicodeTest-135127743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b1104794-732a-4274-8677-db29175749e1" returned: 0 in 0.249s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:50:24 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-8f16c91f-f2bc-43bc-a750-46917d9ed572 tempest-CinderUnicodeTest-135127743 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:50:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-8f16c91f-f2bc-43bc-a750-46917d9ed572 tempest-CinderUnicodeTest-135127743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:50:24 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-8f16c91f-f2bc-43bc-a750-46917d9ed572 tempest-CinderUnicodeTest-135127743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (710fbaf7-1092-4a21-8331-7469d5e4f638) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1104794-732a-4274-8677-db29175749e1', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:50:24 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-8f16c91f-f2bc-43bc-a750-46917d9ed572 tempest-CinderUnicodeTest-135127743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b56aaf0-8666-4870-9bd4-e820294dc539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:50:24 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-8f16c91f-f2bc-43bc-a750-46917d9ed572 tempest-CinderUnicodeTest-135127743 None] Volume volume-b1104794-732a-4274-8677-db29175749e1 (b1104794-732a-4274-8677-db29175749e1): created successfully Sep 18 21:50:24 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-8f16c91f-f2bc-43bc-a750-46917d9ed572 tempest-CinderUnicodeTest-135127743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b56aaf0-8666-4870-9bd4-e820294dc539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:50:24 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-8f16c91f-f2bc-43bc-a750-46917d9ed572 tempest-CinderUnicodeTest-135127743 None] Flow 'volume_create_manager' (908bc75b-a321-433f-a8bb-b57d22a92d89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:50:24 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-8f16c91f-f2bc-43bc-a750-46917d9ed572 tempest-CinderUnicodeTest-135127743 None] Created volume successfully. Sep 18 21:50:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-a9664f5d-13cf-47a7-a8f4-8aa001541434 tempest-CinderUnicodeTest-135127743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:50:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-a9664f5d-13cf-47a7-a8f4-8aa001541434 tempest-CinderUnicodeTest-135127743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:50:24 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-a9664f5d-13cf-47a7-a8f4-8aa001541434 tempest-CinderUnicodeTest-135127743 None] Creating offline snapshot 0733f19e-6862-4169-a9a7-8f883fc1e036 of volume b1104794-732a-4274-8677-db29175749e1 {{(pid=86136) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 21:50:24 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[177acf1d-0984-4db7-a3c9-57f104f77dea]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:50:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-a9664f5d-13cf-47a7-a8f4-8aa001541434 tempest-CinderUnicodeTest-135127743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b1104794-732a-4274-8677-db29175749e1 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:50:24 devstack sudo[103859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b1104794-732a-4274-8677-db29175749e1 Sep 18 21:50:24 devstack sudo[103859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:50:25 devstack sudo[103859]: pam_unix(sudo:session): session closed for user root Sep 18 21:50:25 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-a9664f5d-13cf-47a7-a8f4-8aa001541434 tempest-CinderUnicodeTest-135127743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b1104794-732a-4274-8677-db29175749e1" returned: 0 in 0.390s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:50:25 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-a9664f5d-13cf-47a7-a8f4-8aa001541434 tempest-CinderUnicodeTest-135127743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b1104794-732a-4274-8677-db29175749e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b1104794-732a-4274-8677-db29175749e1.0733f19e-6862-4169-a9a7-8f883fc1e036 1G {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:50:25 devstack sudo[103865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b1104794-732a-4274-8677-db29175749e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b1104794-732a-4274-8677-db29175749e1.0733f19e-6862-4169-a9a7-8f883fc1e036 1G Sep 18 21:50:25 devstack sudo[103865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:50:25 devstack sudo[103865]: pam_unix(sudo:session): session closed for user root Sep 18 21:50:25 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-a9664f5d-13cf-47a7-a8f4-8aa001541434 tempest-CinderUnicodeTest-135127743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b1104794-732a-4274-8677-db29175749e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b1104794-732a-4274-8677-db29175749e1.0733f19e-6862-4169-a9a7-8f883fc1e036 1G" returned: 0 in 0.440s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:50:25 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-a9664f5d-13cf-47a7-a8f4-8aa001541434 tempest-CinderUnicodeTest-135127743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1104794-732a-4274-8677-db29175749e1 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b1104794-732a-4274-8677-db29175749e1.0733f19e-6862-4169-a9a7-8f883fc1e036 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:50:25 devstack sudo[103871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1104794-732a-4274-8677-db29175749e1 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b1104794-732a-4274-8677-db29175749e1.0733f19e-6862-4169-a9a7-8f883fc1e036 Sep 18 21:50:25 devstack sudo[103871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:50:25 devstack sudo[103871]: pam_unix(sudo:session): session closed for user root Sep 18 21:50:25 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-a9664f5d-13cf-47a7-a8f4-8aa001541434 tempest-CinderUnicodeTest-135127743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1104794-732a-4274-8677-db29175749e1 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b1104794-732a-4274-8677-db29175749e1.0733f19e-6862-4169-a9a7-8f883fc1e036" returned: 0 in 0.312s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:50:25 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-a9664f5d-13cf-47a7-a8f4-8aa001541434 tempest-CinderUnicodeTest-135127743 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b1104794-732a-4274-8677-db29175749e1.0733f19e-6862-4169-a9a7-8f883fc1e036 is being set with open permissions: ugo+rw Sep 18 21:50:25 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-a9664f5d-13cf-47a7-a8f4-8aa001541434 tempest-CinderUnicodeTest-135127743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b1104794-732a-4274-8677-db29175749e1.0733f19e-6862-4169-a9a7-8f883fc1e036 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:50:26 devstack sudo[103876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b1104794-732a-4274-8677-db29175749e1.0733f19e-6862-4169-a9a7-8f883fc1e036 Sep 18 21:50:26 devstack sudo[103876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:50:26 devstack sudo[103876]: pam_unix(sudo:session): session closed for user root Sep 18 21:50:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-a9664f5d-13cf-47a7-a8f4-8aa001541434 tempest-CinderUnicodeTest-135127743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b1104794-732a-4274-8677-db29175749e1.0733f19e-6862-4169-a9a7-8f883fc1e036" returned: 0 in 0.240s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:50:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-a9664f5d-13cf-47a7-a8f4-8aa001541434 tempest-CinderUnicodeTest-135127743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b1104794-732a-4274-8677-db29175749e1.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:50:26 devstack sudo[103879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b1104794-732a-4274-8677-db29175749e1.info Sep 18 21:50:26 devstack sudo[103879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:50:26 devstack sudo[103879]: pam_unix(sudo:session): session closed for user root Sep 18 21:50:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-a9664f5d-13cf-47a7-a8f4-8aa001541434 tempest-CinderUnicodeTest-135127743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b1104794-732a-4274-8677-db29175749e1.info" returned: 0 in 0.261s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:50:26 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-a9664f5d-13cf-47a7-a8f4-8aa001541434 tempest-CinderUnicodeTest-135127743 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b1104794-732a-4274-8677-db29175749e1.info is being set with open permissions: ugo+rw Sep 18 21:50:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-a9664f5d-13cf-47a7-a8f4-8aa001541434 tempest-CinderUnicodeTest-135127743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b1104794-732a-4274-8677-db29175749e1.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:50:26 devstack sudo[103882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b1104794-732a-4274-8677-db29175749e1.info Sep 18 21:50:26 devstack sudo[103882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:50:26 devstack sudo[103882]: pam_unix(sudo:session): session closed for user root Sep 18 21:50:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-a9664f5d-13cf-47a7-a8f4-8aa001541434 tempest-CinderUnicodeTest-135127743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b1104794-732a-4274-8677-db29175749e1.info" returned: 0 in 0.350s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:50:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-a9664f5d-13cf-47a7-a8f4-8aa001541434 tempest-CinderUnicodeTest-135127743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.091s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:50:26 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-a9664f5d-13cf-47a7-a8f4-8aa001541434 tempest-CinderUnicodeTest-135127743 None] Create snapshot completed successfully Sep 18 21:50:27 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d8932016-b034-4c5c-9842-62834d3bca44 tempest-CinderUnicodeTest-135127743 None] Acquiring lock "cinder-0733f19e-6862-4169-a9a7-8f883fc1e036-delete_snapshot" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:50:27 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d8932016-b034-4c5c-9842-62834d3bca44 tempest-CinderUnicodeTest-135127743 None] Lock "cinder-0733f19e-6862-4169-a9a7-8f883fc1e036-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:50:27 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d8932016-b034-4c5c-9842-62834d3bca44 tempest-CinderUnicodeTest-135127743 None] Acquiring lock "cinder-quobyte-b1104794-732a-4274-8677-db29175749e1" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:50:28 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d8932016-b034-4c5c-9842-62834d3bca44 tempest-CinderUnicodeTest-135127743 None] Lock "cinder-quobyte-b1104794-732a-4274-8677-db29175749e1" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:50:28 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d8932016-b034-4c5c-9842-62834d3bca44 tempest-CinderUnicodeTest-135127743 None] Acquiring lock "cinder-quobyte-0733f19e-6862-4169-a9a7-8f883fc1e036" by "_delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:50:28 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d8932016-b034-4c5c-9842-62834d3bca44 tempest-CinderUnicodeTest-135127743 None] Lock "cinder-quobyte-0733f19e-6862-4169-a9a7-8f883fc1e036" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:50:28 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-d8932016-b034-4c5c-9842-62834d3bca44 tempest-CinderUnicodeTest-135127743 None] Deleting offline snapshot 0733f19e-6862-4169-a9a7-8f883fc1e036 of volume b1104794-732a-4274-8677-db29175749e1 {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 21:50:28 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-d8932016-b034-4c5c-9842-62834d3bca44 tempest-CinderUnicodeTest-135127743 None] snapshot_file for this snap is: volume-b1104794-732a-4274-8677-db29175749e1.0733f19e-6862-4169-a9a7-8f883fc1e036 {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 21:50:28 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e9e157-0fb5-4b7d-8c44-7869a3def0e6]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:50:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d8932016-b034-4c5c-9842-62834d3bca44 tempest-CinderUnicodeTest-135127743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b1104794-732a-4274-8677-db29175749e1.0733f19e-6862-4169-a9a7-8f883fc1e036 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:50:28 devstack sudo[103928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b1104794-732a-4274-8677-db29175749e1.0733f19e-6862-4169-a9a7-8f883fc1e036 Sep 18 21:50:28 devstack sudo[103928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:50:28 devstack sudo[103928]: pam_unix(sudo:session): session closed for user root Sep 18 21:50:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d8932016-b034-4c5c-9842-62834d3bca44 tempest-CinderUnicodeTest-135127743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b1104794-732a-4274-8677-db29175749e1.0733f19e-6862-4169-a9a7-8f883fc1e036" returned: 0 in 0.406s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:50:28 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-d8932016-b034-4c5c-9842-62834d3bca44 tempest-CinderUnicodeTest-135127743 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1104794-732a-4274-8677-db29175749e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86136) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 21:50:28 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f75de7-de6f-4889-bf1d-d2622800316d]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:50:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d8932016-b034-4c5c-9842-62834d3bca44 tempest-CinderUnicodeTest-135127743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b1104794-732a-4274-8677-db29175749e1 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:50:28 devstack sudo[103934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b1104794-732a-4274-8677-db29175749e1 Sep 18 21:50:28 devstack sudo[103934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:50:28 devstack sudo[103934]: pam_unix(sudo:session): session closed for user root Sep 18 21:50:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d8932016-b034-4c5c-9842-62834d3bca44 tempest-CinderUnicodeTest-135127743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b1104794-732a-4274-8677-db29175749e1" returned: 0 in 0.374s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:50:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d8932016-b034-4c5c-9842-62834d3bca44 tempest-CinderUnicodeTest-135127743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b1104794-732a-4274-8677-db29175749e1.0733f19e-6862-4169-a9a7-8f883fc1e036 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:50:28 devstack sudo[103939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b1104794-732a-4274-8677-db29175749e1.0733f19e-6862-4169-a9a7-8f883fc1e036 Sep 18 21:50:28 devstack sudo[103939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:50:29 devstack sudo[103939]: pam_unix(sudo:session): session closed for user root Sep 18 21:50:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d8932016-b034-4c5c-9842-62834d3bca44 tempest-CinderUnicodeTest-135127743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b1104794-732a-4274-8677-db29175749e1.0733f19e-6862-4169-a9a7-8f883fc1e036" returned: 0 in 0.376s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:50:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d8932016-b034-4c5c-9842-62834d3bca44 tempest-CinderUnicodeTest-135127743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b1104794-732a-4274-8677-db29175749e1.0733f19e-6862-4169-a9a7-8f883fc1e036 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:50:29 devstack sudo[103945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b1104794-732a-4274-8677-db29175749e1.0733f19e-6862-4169-a9a7-8f883fc1e036 Sep 18 21:50:29 devstack sudo[103945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:50:29 devstack sudo[103945]: pam_unix(sudo:session): session closed for user root Sep 18 21:50:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d8932016-b034-4c5c-9842-62834d3bca44 tempest-CinderUnicodeTest-135127743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b1104794-732a-4274-8677-db29175749e1.0733f19e-6862-4169-a9a7-8f883fc1e036" returned: 0 in 0.248s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:50:29 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d8932016-b034-4c5c-9842-62834d3bca44 tempest-CinderUnicodeTest-135127743 None] Lock "cinder-quobyte-0733f19e-6862-4169-a9a7-8f883fc1e036" released by "_delete_snapshot" :: held 1.535s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:50:29 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d8932016-b034-4c5c-9842-62834d3bca44 tempest-CinderUnicodeTest-135127743 None] Lock "cinder-quobyte-b1104794-732a-4274-8677-db29175749e1" released by "delete_snapshot" :: held 1.559s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:50:29 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-d8932016-b034-4c5c-9842-62834d3bca44 tempest-CinderUnicodeTest-135127743 None] Created reservations ['ee389c15-c649-48df-88c5-168fcfb5ca0d', '33178fa7-5c80-4612-af88-d0ba0b59023b', '69f0db79-d5f7-453a-95df-e732e1288c2e', 'd7dbde1b-c8c0-4cf3-b81f-d66ad3b31e08'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:50:29 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-d8932016-b034-4c5c-9842-62834d3bca44 tempest-CinderUnicodeTest-135127743 None] Delete snapshot completed successfully. Sep 18 21:50:29 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d8932016-b034-4c5c-9842-62834d3bca44 tempest-CinderUnicodeTest-135127743 None] Lock "cinder-0733f19e-6862-4169-a9a7-8f883fc1e036-delete_snapshot" released by "delete_snapshot" :: held 1.694s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:50:30 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-2f911c1a-9acb-4d4d-b82b-7023f5a8428e tempest-CinderUnicodeTest-135127743 None] Acquiring lock "cinder-b1104794-732a-4274-8677-db29175749e1-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:50:30 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-2f911c1a-9acb-4d4d-b82b-7023f5a8428e tempest-CinderUnicodeTest-135127743 None] Lock "cinder-b1104794-732a-4274-8677-db29175749e1-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:50:30 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-2f911c1a-9acb-4d4d-b82b-7023f5a8428e tempest-CinderUnicodeTest-135127743 None] Acquiring lock "cinder-quobyte-b1104794-732a-4274-8677-db29175749e1" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:50:30 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-2f911c1a-9acb-4d4d-b82b-7023f5a8428e tempest-CinderUnicodeTest-135127743 None] Lock "cinder-quobyte-b1104794-732a-4274-8677-db29175749e1" acquired by "delete_volume" :: waited 0.013s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:50:30 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[baabb491-2b64-4665-9751-dc69f1354bd5]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:50:30 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-2f911c1a-9acb-4d4d-b82b-7023f5a8428e tempest-CinderUnicodeTest-135127743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b1104794-732a-4274-8677-db29175749e1 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:50:30 devstack sudo[103948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b1104794-732a-4274-8677-db29175749e1 Sep 18 21:50:30 devstack sudo[103948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:50:30 devstack sudo[103948]: pam_unix(sudo:session): session closed for user root Sep 18 21:50:30 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-2f911c1a-9acb-4d4d-b82b-7023f5a8428e tempest-CinderUnicodeTest-135127743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b1104794-732a-4274-8677-db29175749e1" returned: 0 in 0.355s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:50:30 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-2f911c1a-9acb-4d4d-b82b-7023f5a8428e tempest-CinderUnicodeTest-135127743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b1104794-732a-4274-8677-db29175749e1 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:50:30 devstack sudo[103953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b1104794-732a-4274-8677-db29175749e1 Sep 18 21:50:30 devstack sudo[103953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:50:30 devstack sudo[103953]: pam_unix(sudo:session): session closed for user root Sep 18 21:50:30 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-2f911c1a-9acb-4d4d-b82b-7023f5a8428e tempest-CinderUnicodeTest-135127743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-b1104794-732a-4274-8677-db29175749e1" returned: 0 in 0.255s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:50:30 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-2f911c1a-9acb-4d4d-b82b-7023f5a8428e tempest-CinderUnicodeTest-135127743 None] Lock "cinder-quobyte-b1104794-732a-4274-8677-db29175749e1" released by "delete_volume" :: held 0.668s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:50:30 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-2f911c1a-9acb-4d4d-b82b-7023f5a8428e tempest-CinderUnicodeTest-135127743 None] Created reservations ['7a01222e-31e1-4643-98b1-a2eb9479ca8f', '307614ec-e8cf-43dd-8960-e0c1a2bc362c', '237eadce-4e3a-4c9a-bc6f-a30e6044f325', '582adf4a-d5c9-465b-97e3-153034b9e8a5'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:50:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-2f911c1a-9acb-4d4d-b82b-7023f5a8428e tempest-CinderUnicodeTest-135127743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:50:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-2f911c1a-9acb-4d4d-b82b-7023f5a8428e tempest-CinderUnicodeTest-135127743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:50:31 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-2f911c1a-9acb-4d4d-b82b-7023f5a8428e tempest-CinderUnicodeTest-135127743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:50:31 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-2f911c1a-9acb-4d4d-b82b-7023f5a8428e tempest-CinderUnicodeTest-135127743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:50:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-2f911c1a-9acb-4d4d-b82b-7023f5a8428e tempest-CinderUnicodeTest-135127743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:50:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-2f911c1a-9acb-4d4d-b82b-7023f5a8428e tempest-CinderUnicodeTest-135127743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:50:31 devstack sudo[103957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:50:31 devstack sudo[103957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:50:31 devstack sudo[103957]: pam_unix(sudo:session): session closed for user root Sep 18 21:50:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-2f911c1a-9acb-4d4d-b82b-7023f5a8428e tempest-CinderUnicodeTest-135127743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.254s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:50:31 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-2f911c1a-9acb-4d4d-b82b-7023f5a8428e tempest-CinderUnicodeTest-135127743 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:50:31 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-2f911c1a-9acb-4d4d-b82b-7023f5a8428e tempest-CinderUnicodeTest-135127743 None] Deleted volume successfully. Sep 18 21:50:31 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-deda2475-a1b4-4ae4-b6a5-bd4037f43972 tempest-CinderUnicodeTest-135127743 None] Acquiring lock "cinder-0e23ecd6-4aae-493e-90b6-2eb2adc07001-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:50:31 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-2f911c1a-9acb-4d4d-b82b-7023f5a8428e tempest-CinderUnicodeTest-135127743 None] Lock "cinder-b1104794-732a-4274-8677-db29175749e1-delete_volume" released by "delete_volume" :: held 1.163s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:50:31 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-deda2475-a1b4-4ae4-b6a5-bd4037f43972 tempest-CinderUnicodeTest-135127743 None] Lock "cinder-0e23ecd6-4aae-493e-90b6-2eb2adc07001-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:50:31 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-deda2475-a1b4-4ae4-b6a5-bd4037f43972 tempest-CinderUnicodeTest-135127743 None] Acquiring lock "cinder-quobyte-0e23ecd6-4aae-493e-90b6-2eb2adc07001" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:50:31 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-deda2475-a1b4-4ae4-b6a5-bd4037f43972 tempest-CinderUnicodeTest-135127743 None] Lock "cinder-quobyte-0e23ecd6-4aae-493e-90b6-2eb2adc07001" acquired by "delete_volume" :: waited 0.016s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:50:31 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e15082-ca2c-4c84-b29f-f5086233c878]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:50:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-deda2475-a1b4-4ae4-b6a5-bd4037f43972 tempest-CinderUnicodeTest-135127743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-0e23ecd6-4aae-493e-90b6-2eb2adc07001 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:50:31 devstack sudo[103960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-0e23ecd6-4aae-493e-90b6-2eb2adc07001 Sep 18 21:50:31 devstack sudo[103960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:50:31 devstack sudo[103960]: pam_unix(sudo:session): session closed for user root Sep 18 21:50:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-deda2475-a1b4-4ae4-b6a5-bd4037f43972 tempest-CinderUnicodeTest-135127743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-0e23ecd6-4aae-493e-90b6-2eb2adc07001" returned: 0 in 0.363s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:50:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-deda2475-a1b4-4ae4-b6a5-bd4037f43972 tempest-CinderUnicodeTest-135127743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-0e23ecd6-4aae-493e-90b6-2eb2adc07001 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:50:31 devstack sudo[103965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-0e23ecd6-4aae-493e-90b6-2eb2adc07001 Sep 18 21:50:31 devstack sudo[103965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:50:32 devstack sudo[103965]: pam_unix(sudo:session): session closed for user root Sep 18 21:50:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-deda2475-a1b4-4ae4-b6a5-bd4037f43972 tempest-CinderUnicodeTest-135127743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-0e23ecd6-4aae-493e-90b6-2eb2adc07001" returned: 0 in 0.252s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:50:32 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-deda2475-a1b4-4ae4-b6a5-bd4037f43972 tempest-CinderUnicodeTest-135127743 None] Lock "cinder-quobyte-0e23ecd6-4aae-493e-90b6-2eb2adc07001" released by "delete_volume" :: held 0.656s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:50:32 devstack cinder-volume[86136]: DEBUG dbcounter [-] [86136] Writing DB stats cinder:SELECT=102,cinder:UPDATE=114,cinder:INSERT=26,cinder:DELETE=11 {{(pid=86136) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 21:50:32 devstack cinder-volume[86136]: DEBUG dbcounter [-] [86136] Writing DB stats cinder:UPDATE=114,cinder:SELECT=92,cinder:DELETE=8,cinder:INSERT=33 {{(pid=86136) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 21:50:32 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-deda2475-a1b4-4ae4-b6a5-bd4037f43972 tempest-CinderUnicodeTest-135127743 None] Created reservations ['e2186fee-ca0d-4768-9f31-f60fa82201a9', 'f4df75f6-6276-4b09-a287-8ea997ac43bd', '5770750f-d4f6-4d79-9df6-98ecb5608c87', '87746005-53e5-49a3-a43a-7e50333f9ada'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:50:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-deda2475-a1b4-4ae4-b6a5-bd4037f43972 tempest-CinderUnicodeTest-135127743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:50:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-deda2475-a1b4-4ae4-b6a5-bd4037f43972 tempest-CinderUnicodeTest-135127743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:50:32 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-deda2475-a1b4-4ae4-b6a5-bd4037f43972 tempest-CinderUnicodeTest-135127743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:50:32 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-deda2475-a1b4-4ae4-b6a5-bd4037f43972 tempest-CinderUnicodeTest-135127743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:50:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-deda2475-a1b4-4ae4-b6a5-bd4037f43972 tempest-CinderUnicodeTest-135127743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:50:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-deda2475-a1b4-4ae4-b6a5-bd4037f43972 tempest-CinderUnicodeTest-135127743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:50:32 devstack sudo[103968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:50:32 devstack sudo[103968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:50:32 devstack sudo[103968]: pam_unix(sudo:session): session closed for user root Sep 18 21:50:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-deda2475-a1b4-4ae4-b6a5-bd4037f43972 tempest-CinderUnicodeTest-135127743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.271s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:50:32 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-deda2475-a1b4-4ae4-b6a5-bd4037f43972 tempest-CinderUnicodeTest-135127743 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:50:32 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-deda2475-a1b4-4ae4-b6a5-bd4037f43972 tempest-CinderUnicodeTest-135127743 None] Deleted volume successfully. Sep 18 21:50:32 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-deda2475-a1b4-4ae4-b6a5-bd4037f43972 tempest-CinderUnicodeTest-135127743 None] Lock "cinder-0e23ecd6-4aae-493e-90b6-2eb2adc07001-delete_volume" released by "delete_volume" :: held 1.138s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:50:42 devstack cinder-volume[86136]: DEBUG dbcounter [-] [86136] Writing DB stats cinder:SELECT=3,cinder:INSERT=1,cinder:UPDATE=10 {{(pid=86136) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 21:50:42 devstack cinder-volume[86136]: DEBUG dbcounter [-] [86136] Writing DB stats cinder:INSERT=3,cinder:UPDATE=5,cinder:SELECT=3,cinder:DELETE=1 {{(pid=86136) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 21:50:52 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-b46be408-aabb-4236-9bbb-a16bb60e726e tempest-CreateVolumesFromSnapshotTest-248322392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:50:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b46be408-aabb-4236-9bbb-a16bb60e726e tempest-CreateVolumesFromSnapshotTest-248322392 None] Flow 'volume_create_manager' (665e40d5-752e-4df3-a315-7a3cbfdd7d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:50:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b46be408-aabb-4236-9bbb-a16bb60e726e tempest-CreateVolumesFromSnapshotTest-248322392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e740ad84-9c31-4c58-909c-bdb503c641e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:50:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b46be408-aabb-4236-9bbb-a16bb60e726e tempest-CreateVolumesFromSnapshotTest-248322392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e740ad84-9c31-4c58-909c-bdb503c641e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:50:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-115085171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=647dda22-4632-4787-8372-5fd9f5c1d986,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3ae13e6e3ab4f639f5c405f0fcfa3f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:50:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:50:52Z,use_quota=True,user_id='6028ee24d4f84c5da80d946f13c838fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:50:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b46be408-aabb-4236-9bbb-a16bb60e726e tempest-CreateVolumesFromSnapshotTest-248322392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c8aa0bc-359e-49a9-a999-cd0a43fa0b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:50:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b46be408-aabb-4236-9bbb-a16bb60e726e tempest-CreateVolumesFromSnapshotTest-248322392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c8aa0bc-359e-49a9-a999-cd0a43fa0b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:50:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b46be408-aabb-4236-9bbb-a16bb60e726e tempest-CreateVolumesFromSnapshotTest-248322392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (095107b8-a095-4ebb-8c40-25bfa98ba1f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:50:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b46be408-aabb-4236-9bbb-a16bb60e726e tempest-CreateVolumesFromSnapshotTest-248322392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (095107b8-a095-4ebb-8c40-25bfa98ba1f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '647dda22-4632-4787-8372-5fd9f5c1d986', 'volume_name': 'volume-647dda22-4632-4787-8372-5fd9f5c1d986', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:50:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b46be408-aabb-4236-9bbb-a16bb60e726e tempest-CreateVolumesFromSnapshotTest-248322392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0a4ea83-978c-46ad-8d2a-cddd5c575bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:50:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b46be408-aabb-4236-9bbb-a16bb60e726e tempest-CreateVolumesFromSnapshotTest-248322392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0a4ea83-978c-46ad-8d2a-cddd5c575bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:50:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b46be408-aabb-4236-9bbb-a16bb60e726e tempest-CreateVolumesFromSnapshotTest-248322392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2f94acb-68c7-4bec-acd1-6d104034c6c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:50:52 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-b46be408-aabb-4236-9bbb-a16bb60e726e tempest-CreateVolumesFromSnapshotTest-248322392 None] Volume 647dda22-4632-4787-8372-5fd9f5c1d986: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-647dda22-4632-4787-8372-5fd9f5c1d986', 'volume_size': 1} Sep 18 21:50:52 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-b46be408-aabb-4236-9bbb-a16bb60e726e tempest-CreateVolumesFromSnapshotTest-248322392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:50:52 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-b46be408-aabb-4236-9bbb-a16bb60e726e tempest-CreateVolumesFromSnapshotTest-248322392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:50:52 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-b46be408-aabb-4236-9bbb-a16bb60e726e tempest-CreateVolumesFromSnapshotTest-248322392 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:50:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-115085171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=647dda22-4632-4787-8372-5fd9f5c1d986,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3ae13e6e3ab4f639f5c405f0fcfa3f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:50:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:50:52Z,use_quota=True,user_id='6028ee24d4f84c5da80d946f13c838fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:50:52 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-b46be408-aabb-4236-9bbb-a16bb60e726e tempest-CreateVolumesFromSnapshotTest-248322392 None] Creating volume 647dda22-4632-4787-8372-5fd9f5c1d986 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:50:52 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-b46be408-aabb-4236-9bbb-a16bb60e726e tempest-CreateVolumesFromSnapshotTest-248322392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:50:52 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-b46be408-aabb-4236-9bbb-a16bb60e726e tempest-CreateVolumesFromSnapshotTest-248322392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:50:52 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-b46be408-aabb-4236-9bbb-a16bb60e726e tempest-CreateVolumesFromSnapshotTest-248322392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:50:52 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-b46be408-aabb-4236-9bbb-a16bb60e726e tempest-CreateVolumesFromSnapshotTest-248322392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:50:52 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-b46be408-aabb-4236-9bbb-a16bb60e726e tempest-CreateVolumesFromSnapshotTest-248322392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:50:52 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-b46be408-aabb-4236-9bbb-a16bb60e726e tempest-CreateVolumesFromSnapshotTest-248322392 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:50:52 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-b46be408-aabb-4236-9bbb-a16bb60e726e tempest-CreateVolumesFromSnapshotTest-248322392 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:50:52 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-b46be408-aabb-4236-9bbb-a16bb60e726e tempest-CreateVolumesFromSnapshotTest-248322392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-647dda22-4632-4787-8372-5fd9f5c1d986 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:50:52 devstack sudo[104012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-647dda22-4632-4787-8372-5fd9f5c1d986 1073741824 Sep 18 21:50:52 devstack sudo[104012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:50:52 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-c73ca0bb-9ffe-432d-b282-ac73a4b50d69 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:50:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c73ca0bb-9ffe-432d-b282-ac73a4b50d69 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Flow 'volume_create_manager' (a0065b34-075a-4f0e-a7d4-ff99b615282a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:50:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c73ca0bb-9ffe-432d-b282-ac73a4b50d69 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74c1129b-f565-42d9-8d24-0dc1439656db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:50:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c73ca0bb-9ffe-432d-b282-ac73a4b50d69 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74c1129b-f565-42d9-8d24-0dc1439656db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:50:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-699912556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2c671e7-a141-4c50-9e6a-e633f457180a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e83c7726ec8e4909a95aeb3cec428cf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:50:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:50:53Z,use_quota=True,user_id='ffab42d96d37402d88cc76aebb0f84de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:50:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c73ca0bb-9ffe-432d-b282-ac73a4b50d69 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cb19ff8-f5f1-4ede-9e9b-d2d129748977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:50:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c73ca0bb-9ffe-432d-b282-ac73a4b50d69 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cb19ff8-f5f1-4ede-9e9b-d2d129748977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:50:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c73ca0bb-9ffe-432d-b282-ac73a4b50d69 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e3db81d-243c-4ed0-9156-a5b92ede15dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:50:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c73ca0bb-9ffe-432d-b282-ac73a4b50d69 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e3db81d-243c-4ed0-9156-a5b92ede15dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2c671e7-a141-4c50-9e6a-e633f457180a', 'volume_name': 'volume-d2c671e7-a141-4c50-9e6a-e633f457180a', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:50:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c73ca0bb-9ffe-432d-b282-ac73a4b50d69 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d41f60d0-caa0-479c-996e-682d2c3f77e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:50:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c73ca0bb-9ffe-432d-b282-ac73a4b50d69 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d41f60d0-caa0-479c-996e-682d2c3f77e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:50:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c73ca0bb-9ffe-432d-b282-ac73a4b50d69 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fda9682-8969-4765-86c8-b145ef7446cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:50:52 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-c73ca0bb-9ffe-432d-b282-ac73a4b50d69 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Volume d2c671e7-a141-4c50-9e6a-e633f457180a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2c671e7-a141-4c50-9e6a-e633f457180a', 'volume_size': 1} Sep 18 21:50:52 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c73ca0bb-9ffe-432d-b282-ac73a4b50d69 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:50:53 devstack sudo[104012]: pam_unix(sudo:session): session closed for user root Sep 18 21:50:53 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-b46be408-aabb-4236-9bbb-a16bb60e726e tempest-CreateVolumesFromSnapshotTest-248322392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-647dda22-4632-4787-8372-5fd9f5c1d986 1073741824" returned: 0 in 0.558s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:50:53 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-b46be408-aabb-4236-9bbb-a16bb60e726e tempest-CreateVolumesFromSnapshotTest-248322392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-647dda22-4632-4787-8372-5fd9f5c1d986 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:50:53 devstack sudo[104018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-647dda22-4632-4787-8372-5fd9f5c1d986 Sep 18 21:50:53 devstack sudo[104018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:50:53 devstack sudo[104018]: pam_unix(sudo:session): session closed for user root Sep 18 21:50:53 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-b46be408-aabb-4236-9bbb-a16bb60e726e tempest-CreateVolumesFromSnapshotTest-248322392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-647dda22-4632-4787-8372-5fd9f5c1d986" returned: 0 in 0.256s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:50:53 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-b46be408-aabb-4236-9bbb-a16bb60e726e tempest-CreateVolumesFromSnapshotTest-248322392 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:50:53 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-b46be408-aabb-4236-9bbb-a16bb60e726e tempest-CreateVolumesFromSnapshotTest-248322392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:50:53 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c73ca0bb-9ffe-432d-b282-ac73a4b50d69 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.549s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:50:53 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-c73ca0bb-9ffe-432d-b282-ac73a4b50d69 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:50:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-699912556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2c671e7-a141-4c50-9e6a-e633f457180a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e83c7726ec8e4909a95aeb3cec428cf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:50:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:50:53Z,use_quota=True,user_id='ffab42d96d37402d88cc76aebb0f84de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:50:53 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-c73ca0bb-9ffe-432d-b282-ac73a4b50d69 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Creating volume d2c671e7-a141-4c50-9e6a-e633f457180a {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:50:53 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c73ca0bb-9ffe-432d-b282-ac73a4b50d69 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:50:53 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c73ca0bb-9ffe-432d-b282-ac73a4b50d69 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:50:53 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-c73ca0bb-9ffe-432d-b282-ac73a4b50d69 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:50:53 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-c73ca0bb-9ffe-432d-b282-ac73a4b50d69 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:50:53 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c73ca0bb-9ffe-432d-b282-ac73a4b50d69 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:50:53 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-c73ca0bb-9ffe-432d-b282-ac73a4b50d69 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:50:53 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-c73ca0bb-9ffe-432d-b282-ac73a4b50d69 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:50:53 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c73ca0bb-9ffe-432d-b282-ac73a4b50d69 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-d2c671e7-a141-4c50-9e6a-e633f457180a 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:50:53 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b46be408-aabb-4236-9bbb-a16bb60e726e tempest-CreateVolumesFromSnapshotTest-248322392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2f94acb-68c7-4bec-acd1-6d104034c6c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-647dda22-4632-4787-8372-5fd9f5c1d986', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:50:53 devstack sudo[104021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-d2c671e7-a141-4c50-9e6a-e633f457180a 1073741824 Sep 18 21:50:53 devstack sudo[104021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:50:53 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b46be408-aabb-4236-9bbb-a16bb60e726e tempest-CreateVolumesFromSnapshotTest-248322392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c583855-26d0-4938-b43e-1e0e52dc893e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:50:53 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-b46be408-aabb-4236-9bbb-a16bb60e726e tempest-CreateVolumesFromSnapshotTest-248322392 None] Volume volume-647dda22-4632-4787-8372-5fd9f5c1d986 (647dda22-4632-4787-8372-5fd9f5c1d986): created successfully Sep 18 21:50:53 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b46be408-aabb-4236-9bbb-a16bb60e726e tempest-CreateVolumesFromSnapshotTest-248322392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c583855-26d0-4938-b43e-1e0e52dc893e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:50:53 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b46be408-aabb-4236-9bbb-a16bb60e726e tempest-CreateVolumesFromSnapshotTest-248322392 None] Flow 'volume_create_manager' (665e40d5-752e-4df3-a315-7a3cbfdd7d80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:50:53 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-b46be408-aabb-4236-9bbb-a16bb60e726e tempest-CreateVolumesFromSnapshotTest-248322392 None] Created volume successfully. Sep 18 21:50:53 devstack sudo[104021]: pam_unix(sudo:session): session closed for user root Sep 18 21:50:53 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c73ca0bb-9ffe-432d-b282-ac73a4b50d69 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-d2c671e7-a141-4c50-9e6a-e633f457180a 1073741824" returned: 0 in 0.532s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:50:53 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c73ca0bb-9ffe-432d-b282-ac73a4b50d69 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-d2c671e7-a141-4c50-9e6a-e633f457180a {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:50:53 devstack sudo[104027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-d2c671e7-a141-4c50-9e6a-e633f457180a Sep 18 21:50:53 devstack sudo[104027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:50:54 devstack sudo[104027]: pam_unix(sudo:session): session closed for user root Sep 18 21:50:54 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c73ca0bb-9ffe-432d-b282-ac73a4b50d69 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-d2c671e7-a141-4c50-9e6a-e633f457180a" returned: 0 in 0.297s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:50:54 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-c73ca0bb-9ffe-432d-b282-ac73a4b50d69 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:50:54 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c73ca0bb-9ffe-432d-b282-ac73a4b50d69 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:50:54 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c73ca0bb-9ffe-432d-b282-ac73a4b50d69 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fda9682-8969-4765-86c8-b145ef7446cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2c671e7-a141-4c50-9e6a-e633f457180a', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:50:54 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c73ca0bb-9ffe-432d-b282-ac73a4b50d69 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5bd8aab-6db5-4c54-a587-ce55308800dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:50:54 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-c73ca0bb-9ffe-432d-b282-ac73a4b50d69 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Volume volume-d2c671e7-a141-4c50-9e6a-e633f457180a (d2c671e7-a141-4c50-9e6a-e633f457180a): created successfully Sep 18 21:50:54 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c73ca0bb-9ffe-432d-b282-ac73a4b50d69 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5bd8aab-6db5-4c54-a587-ce55308800dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:50:54 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c73ca0bb-9ffe-432d-b282-ac73a4b50d69 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Flow 'volume_create_manager' (a0065b34-075a-4f0e-a7d4-ff99b615282a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:50:54 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-c73ca0bb-9ffe-432d-b282-ac73a4b50d69 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Created volume successfully. Sep 18 21:50:54 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-642dbabe-9873-4201-98cb-42ab8903895f tempest-CreateVolumesFromSnapshotTest-248322392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:50:54 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-642dbabe-9873-4201-98cb-42ab8903895f tempest-CreateVolumesFromSnapshotTest-248322392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:50:54 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-642dbabe-9873-4201-98cb-42ab8903895f tempest-CreateVolumesFromSnapshotTest-248322392 None] Creating offline snapshot 85fae045-bbd9-456d-9d07-5b0bfeeea7d0 of volume 647dda22-4632-4787-8372-5fd9f5c1d986 {{(pid=86136) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 21:50:54 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc42cbe4-1289-4115-9208-ced90a8f3d6f]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:50:54 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-642dbabe-9873-4201-98cb-42ab8903895f tempest-CreateVolumesFromSnapshotTest-248322392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-647dda22-4632-4787-8372-5fd9f5c1d986 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:50:54 devstack sudo[104030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-647dda22-4632-4787-8372-5fd9f5c1d986 Sep 18 21:50:54 devstack sudo[104030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:50:55 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd06c4af-26d4-4b70-974f-18b4b65a8b74 tempest-VolumeImageDependencyTests-170429094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:50:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-cd06c4af-26d4-4b70-974f-18b4b65a8b74 tempest-VolumeImageDependencyTests-170429094 None] Flow 'volume_create_manager' (bee9f734-e267-4fa6-b59c-37c5cc2a7956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:50:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-cd06c4af-26d4-4b70-974f-18b4b65a8b74 tempest-VolumeImageDependencyTests-170429094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a1fa1ed-405f-4c31-8b1e-a9684d0a1a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:50:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-cd06c4af-26d4-4b70-974f-18b4b65a8b74 tempest-VolumeImageDependencyTests-170429094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a1fa1ed-405f-4c31-8b1e-a9684d0a1a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:50:55Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30d6bad8-5a3c-4c5f-a6f5-36933fc15561,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='142de6b26dc64ac0ab9d852fb9de9772',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:50:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:50:55Z,use_quota=True,user_id='dca3d6218d674bb09caf9b4d162a1e84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:50:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-cd06c4af-26d4-4b70-974f-18b4b65a8b74 tempest-VolumeImageDependencyTests-170429094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5c79e92-f44c-4d4c-b2ab-f7d4aa5a7b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:50:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-cd06c4af-26d4-4b70-974f-18b4b65a8b74 tempest-VolumeImageDependencyTests-170429094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5c79e92-f44c-4d4c-b2ab-f7d4aa5a7b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:50:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-cd06c4af-26d4-4b70-974f-18b4b65a8b74 tempest-VolumeImageDependencyTests-170429094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69fa6ccc-60e9-4a40-a15f-d447e10bf9cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:50:55 devstack cinder-volume[86136]: DEBUG cinder.image.glance [None req-cd06c4af-26d4-4b70-974f-18b4b65a8b74 tempest-VolumeImageDependencyTests-170429094 None] Creating Keystone auth plugin from conf {{(pid=86136) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 18 21:50:55 devstack sudo[104030]: pam_unix(sudo:session): session closed for user root Sep 18 21:50:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-642dbabe-9873-4201-98cb-42ab8903895f tempest-CreateVolumesFromSnapshotTest-248322392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-647dda22-4632-4787-8372-5fd9f5c1d986" returned: 0 in 0.642s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:50:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-642dbabe-9873-4201-98cb-42ab8903895f tempest-CreateVolumesFromSnapshotTest-248322392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-647dda22-4632-4787-8372-5fd9f5c1d986,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-647dda22-4632-4787-8372-5fd9f5c1d986.85fae045-bbd9-456d-9d07-5b0bfeeea7d0 1G {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:50:55 devstack sudo[104035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-647dda22-4632-4787-8372-5fd9f5c1d986,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-647dda22-4632-4787-8372-5fd9f5c1d986.85fae045-bbd9-456d-9d07-5b0bfeeea7d0 1G Sep 18 21:50:55 devstack sudo[104035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:50:55 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3ec62e1-c954-4e2d-a5d8-63882614b029 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:50:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b3ec62e1-c954-4e2d-a5d8-63882614b029 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Flow 'volume_create_manager' (6a960684-9707-465c-9260-166b8de9137a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:50:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b3ec62e1-c954-4e2d-a5d8-63882614b029 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb54aa2c-7167-4a99-bc1d-3dc5dfe1235d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:50:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b3ec62e1-c954-4e2d-a5d8-63882614b029 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb54aa2c-7167-4a99-bc1d-3dc5dfe1235d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:50:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1865185649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e821f402-95fb-4d3b-8560-db694504f04a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e83c7726ec8e4909a95aeb3cec428cf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:50:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:50:55Z,use_quota=True,user_id='ffab42d96d37402d88cc76aebb0f84de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:50:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b3ec62e1-c954-4e2d-a5d8-63882614b029 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be4f64ef-5598-4662-91f0-2ee35054ac4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:50:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b3ec62e1-c954-4e2d-a5d8-63882614b029 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be4f64ef-5598-4662-91f0-2ee35054ac4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:50:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b3ec62e1-c954-4e2d-a5d8-63882614b029 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cee7636f-cb24-44c6-8a26-ed76bf424078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:50:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b3ec62e1-c954-4e2d-a5d8-63882614b029 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cee7636f-cb24-44c6-8a26-ed76bf424078) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e821f402-95fb-4d3b-8560-db694504f04a', 'volume_name': 'volume-e821f402-95fb-4d3b-8560-db694504f04a', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:50:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b3ec62e1-c954-4e2d-a5d8-63882614b029 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d739b6b-f384-42ee-b004-8ef862cd21bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:50:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b3ec62e1-c954-4e2d-a5d8-63882614b029 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d739b6b-f384-42ee-b004-8ef862cd21bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:50:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b3ec62e1-c954-4e2d-a5d8-63882614b029 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c55cc4c9-114a-44df-ae66-ba4d602ec5a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:50:55 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-b3ec62e1-c954-4e2d-a5d8-63882614b029 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Volume e821f402-95fb-4d3b-8560-db694504f04a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e821f402-95fb-4d3b-8560-db694504f04a', 'volume_size': 1} Sep 18 21:50:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-b3ec62e1-c954-4e2d-a5d8-63882614b029 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:50:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-cd06c4af-26d4-4b70-974f-18b4b65a8b74 tempest-VolumeImageDependencyTests-170429094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69fa6ccc-60e9-4a40-a15f-d447e10bf9cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '30d6bad8-5a3c-4c5f-a6f5-36933fc15561', 'volume_name': 'volume-30d6bad8-5a3c-4c5f-a6f5-36933fc15561', 'volume_size': 1, 'image_id': '90bd439f-c5bb-47c1-807c-97bcf48c5264', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/90bd439f-c5bb-47c1-807c-97bcf48c5264', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8bb3399e85794016ce491a6a5f7e817e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '142de6b26dc64ac0ab9d852fb9de9772', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '097a45c75b9ce905d1a57adc3556d4edcef15870c0e30d701ccaa9b1b4ecdd130adf2bb121621ed79f00eca95c486bf09b4b4913d087aa1e6a601a895cb90258', 'id': '90bd439f-c5bb-47c1-807c-97bcf48c5264', 'created_at': datetime.datetime(2026, 9, 18, 19, 50, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 18, 19, 50, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/90bd439f-c5bb-47c1-807c-97bcf48c5264/file', 'properties': {}}, 'image_service': }' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:50:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-cd06c4af-26d4-4b70-974f-18b4b65a8b74 tempest-VolumeImageDependencyTests-170429094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdc816b9-a6aa-4705-ae4f-d521a4b2ef76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:50:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-cd06c4af-26d4-4b70-974f-18b4b65a8b74 tempest-VolumeImageDependencyTests-170429094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdc816b9-a6aa-4705-ae4f-d521a4b2ef76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:50:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-cd06c4af-26d4-4b70-974f-18b4b65a8b74 tempest-VolumeImageDependencyTests-170429094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d635f62-7b12-4232-90fa-72e4994d8dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:50:55 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-cd06c4af-26d4-4b70-974f-18b4b65a8b74 tempest-VolumeImageDependencyTests-170429094 None] Volume 30d6bad8-5a3c-4c5f-a6f5-36933fc15561: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-30d6bad8-5a3c-4c5f-a6f5-36933fc15561', 'volume_size': 1, 'image_id': '90bd439f-c5bb-47c1-807c-97bcf48c5264', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/90bd439f-c5bb-47c1-807c-97bcf48c5264', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8bb3399e85794016ce491a6a5f7e817e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '142de6b26dc64ac0ab9d852fb9de9772', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '097a45c75b9ce905d1a57adc3556d4edcef15870c0e30d701ccaa9b1b4ecdd130adf2bb121621ed79f00eca95c486bf09b4b4913d087aa1e6a601a895cb90258', 'id': '90bd439f-c5bb-47c1-807c-97bcf48c5264', 'created_at': datetime.datetime(2026, 9, 18, 19, 50, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 18, 19, 50, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/90bd439f-c5bb-47c1-807c-97bcf48c5264/file', 'properties': {}}, 'image_service': } Sep 18 21:50:55 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd06c4af-26d4-4b70-974f-18b4b65a8b74 tempest-VolumeImageDependencyTests-170429094 None] Trying to clone 30d6bad8-5a3c-4c5f-a6f5-36933fc15561 from image 90bd439f-c5bb-47c1-807c-97bcf48c5264 at location (None, [{'url': 'file:///opt/stack/data/glance/images/90bd439f-c5bb-47c1-807c-97bcf48c5264', 'metadata': {}}]). {{(pid=86136) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 18 21:50:55 devstack cinder-volume[86136]: DEBUG cinder.image.image_utils [None req-cd06c4af-26d4-4b70-974f-18b4b65a8b74 tempest-VolumeImageDependencyTests-170429094 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_90bd439f-c5bb-47c1-807c-97bcf48c5264_k0xecpj6devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86136) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 18 21:50:55 devstack cinder-volume[86136]: INFO cinder.image.image_utils [None req-cd06c4af-26d4-4b70-974f-18b4b65a8b74 tempest-VolumeImageDependencyTests-170429094 None] Image download 0.00 MB at 0.00 MB/s Sep 18 21:50:55 devstack sudo[104035]: pam_unix(sudo:session): session closed for user root Sep 18 21:50:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-642dbabe-9873-4201-98cb-42ab8903895f tempest-CreateVolumesFromSnapshotTest-248322392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-647dda22-4632-4787-8372-5fd9f5c1d986,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-647dda22-4632-4787-8372-5fd9f5c1d986.85fae045-bbd9-456d-9d07-5b0bfeeea7d0 1G" returned: 0 in 0.662s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:50:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-642dbabe-9873-4201-98cb-42ab8903895f tempest-CreateVolumesFromSnapshotTest-248322392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-647dda22-4632-4787-8372-5fd9f5c1d986 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-647dda22-4632-4787-8372-5fd9f5c1d986.85fae045-bbd9-456d-9d07-5b0bfeeea7d0 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:50:56 devstack sudo[104041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-647dda22-4632-4787-8372-5fd9f5c1d986 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-647dda22-4632-4787-8372-5fd9f5c1d986.85fae045-bbd9-456d-9d07-5b0bfeeea7d0 Sep 18 21:50:56 devstack sudo[104041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:50:56 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3686e6a-2095-4ccf-8345-eb6a92614871]: (4, 'raw') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:50:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-cd06c4af-26d4-4b70-974f-18b4b65a8b74 tempest-VolumeImageDependencyTests-170429094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_90bd439f-c5bb-47c1-807c-97bcf48c5264_k0xecpj6devstack@QuobyteHD {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:50:56 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-23303b59-e749-4817-9463-647a5b3ceb28 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:50:56 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-23303b59-e749-4817-9463-647a5b3ceb28 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Flow 'volume_create_manager' (702538c1-b36c-40d8-86ab-95e5f1f50c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:50:56 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-23303b59-e749-4817-9463-647a5b3ceb28 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23596be8-ccdc-4881-9e7d-33d32ef34dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:50:56 devstack sudo[104043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_90bd439f-c5bb-47c1-807c-97bcf48c5264_k0xecpj6devstack@QuobyteHD Sep 18 21:50:56 devstack sudo[104043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:50:56 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-23303b59-e749-4817-9463-647a5b3ceb28 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23596be8-ccdc-4881-9e7d-33d32ef34dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:50:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-351830979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc4b729c-5186-4461-88f9-6399efdce2f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e83c7726ec8e4909a95aeb3cec428cf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:50:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:50:56Z,use_quota=True,user_id='ffab42d96d37402d88cc76aebb0f84de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:50:56 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-23303b59-e749-4817-9463-647a5b3ceb28 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7442cd6-de72-4312-b6e5-436eb3e1bc8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:50:56 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-23303b59-e749-4817-9463-647a5b3ceb28 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7442cd6-de72-4312-b6e5-436eb3e1bc8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:50:56 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-23303b59-e749-4817-9463-647a5b3ceb28 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1f794f0-8cca-4504-b262-775da1380f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:50:56 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-23303b59-e749-4817-9463-647a5b3ceb28 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1f794f0-8cca-4504-b262-775da1380f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc4b729c-5186-4461-88f9-6399efdce2f6', 'volume_name': 'volume-fc4b729c-5186-4461-88f9-6399efdce2f6', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:50:56 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-23303b59-e749-4817-9463-647a5b3ceb28 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2209bddd-5b10-4017-90d9-d8791a33a795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:50:56 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-23303b59-e749-4817-9463-647a5b3ceb28 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2209bddd-5b10-4017-90d9-d8791a33a795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:50:56 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-23303b59-e749-4817-9463-647a5b3ceb28 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d53f7dc-146a-4794-8203-02a384a21f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:50:56 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-23303b59-e749-4817-9463-647a5b3ceb28 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Volume fc4b729c-5186-4461-88f9-6399efdce2f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc4b729c-5186-4461-88f9-6399efdce2f6', 'volume_size': 1} Sep 18 21:50:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-23303b59-e749-4817-9463-647a5b3ceb28 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:50:56 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab398b76-fcb3-43a1-a75c-c12fe91c6039 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:50:56 devstack sudo[104041]: pam_unix(sudo:session): session closed for user root Sep 18 21:50:56 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ab398b76-fcb3-43a1-a75c-c12fe91c6039 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Flow 'volume_create_manager' (3d1af28d-61dd-4698-b7eb-f595799597c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:50:56 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ab398b76-fcb3-43a1-a75c-c12fe91c6039 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e8072cd-290c-4c4d-8d7b-47c35c9367fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:50:56 devstack sudo[104043]: pam_unix(sudo:session): session closed for user root Sep 18 21:50:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-642dbabe-9873-4201-98cb-42ab8903895f tempest-CreateVolumesFromSnapshotTest-248322392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-647dda22-4632-4787-8372-5fd9f5c1d986 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-647dda22-4632-4787-8372-5fd9f5c1d986.85fae045-bbd9-456d-9d07-5b0bfeeea7d0" returned: 0 in 0.592s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:50:56 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-642dbabe-9873-4201-98cb-42ab8903895f tempest-CreateVolumesFromSnapshotTest-248322392 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-647dda22-4632-4787-8372-5fd9f5c1d986.85fae045-bbd9-456d-9d07-5b0bfeeea7d0 is being set with open permissions: ugo+rw Sep 18 21:50:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-642dbabe-9873-4201-98cb-42ab8903895f tempest-CreateVolumesFromSnapshotTest-248322392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-647dda22-4632-4787-8372-5fd9f5c1d986.85fae045-bbd9-456d-9d07-5b0bfeeea7d0 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:50:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-cd06c4af-26d4-4b70-974f-18b4b65a8b74 tempest-VolumeImageDependencyTests-170429094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_90bd439f-c5bb-47c1-807c-97bcf48c5264_k0xecpj6devstack@QuobyteHD" returned: 0 in 0.563s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:50:56 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ab398b76-fcb3-43a1-a75c-c12fe91c6039 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e8072cd-290c-4c4d-8d7b-47c35c9367fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:50:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1673213910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f1c92c1-4aa5-4cea-aff6-2d10673b33e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e83c7726ec8e4909a95aeb3cec428cf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:50:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:50:56Z,use_quota=True,user_id='ffab42d96d37402d88cc76aebb0f84de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:50:56 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ab398b76-fcb3-43a1-a75c-c12fe91c6039 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bbf9243-0598-4ce8-8978-ba4877553b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:50:56 devstack sudo[104050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-647dda22-4632-4787-8372-5fd9f5c1d986.85fae045-bbd9-456d-9d07-5b0bfeeea7d0 Sep 18 21:50:56 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ab398b76-fcb3-43a1-a75c-c12fe91c6039 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bbf9243-0598-4ce8-8978-ba4877553b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:50:56 devstack sudo[104050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:50:56 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ab398b76-fcb3-43a1-a75c-c12fe91c6039 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9fb939d-d071-431f-984f-543b9700b6e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:50:56 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ab398b76-fcb3-43a1-a75c-c12fe91c6039 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9fb939d-d071-431f-984f-543b9700b6e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f1c92c1-4aa5-4cea-aff6-2d10673b33e4', 'volume_name': 'volume-9f1c92c1-4aa5-4cea-aff6-2d10673b33e4', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:50:56 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ab398b76-fcb3-43a1-a75c-c12fe91c6039 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e08e41a2-bc42-4d4e-877b-3c97ea023393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:50:56 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ab398b76-fcb3-43a1-a75c-c12fe91c6039 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e08e41a2-bc42-4d4e-877b-3c97ea023393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:50:56 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ab398b76-fcb3-43a1-a75c-c12fe91c6039 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8302d3e-83f3-42e6-902f-41876238c011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:50:56 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-ab398b76-fcb3-43a1-a75c-c12fe91c6039 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Volume 9f1c92c1-4aa5-4cea-aff6-2d10673b33e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f1c92c1-4aa5-4cea-aff6-2d10673b33e4', 'volume_size': 1} Sep 18 21:50:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-ab398b76-fcb3-43a1-a75c-c12fe91c6039 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:50:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-cd06c4af-26d4-4b70-974f-18b4b65a8b74 tempest-VolumeImageDependencyTests-170429094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_90bd439f-c5bb-47c1-807c-97bcf48c5264_k0xecpj6devstack@QuobyteHD {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:50:56 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-59378519-4dfb-40d9-be90-ac28e7ca2060 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:50:56 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-59378519-4dfb-40d9-be90-ac28e7ca2060 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] Flow 'volume_create_manager' (880a7fc1-a2ef-4800-b36d-5eef7d576079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:50:56 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-59378519-4dfb-40d9-be90-ac28e7ca2060 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f82b11b-d8ae-475b-a979-0e71e01582f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:50:56 devstack sudo[104052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_90bd439f-c5bb-47c1-807c-97bcf48c5264_k0xecpj6devstack@QuobyteHD Sep 18 21:50:56 devstack sudo[104052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:50:56 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-59378519-4dfb-40d9-be90-ac28e7ca2060 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f82b11b-d8ae-475b-a979-0e71e01582f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:50:56Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=793d24fd-9fe6-40de-bf11-9dd3a780fa98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3233dc5aa3fd4222a6b0d10d85dbee17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:50:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:50:57Z,use_quota=True,user_id='6a41c450d0574b6f9bf4f8396421df9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1bb15fea-cc76-4c57-8b37-bda05eba78ce),volume_type_id=1bb15fea-cc76-4c57-8b37-bda05eba78ce)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:50:56 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-59378519-4dfb-40d9-be90-ac28e7ca2060 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db968737-a134-466c-a1e6-eb6ed8e2444a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:50:56 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-59378519-4dfb-40d9-be90-ac28e7ca2060 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db968737-a134-466c-a1e6-eb6ed8e2444a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:50:56 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-59378519-4dfb-40d9-be90-ac28e7ca2060 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af800c13-b904-4e73-b986-aa8aebc61a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:50:56 devstack cinder-volume[86136]: DEBUG cinder.image.glance [None req-59378519-4dfb-40d9-be90-ac28e7ca2060 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] Creating Keystone auth plugin from conf {{(pid=86136) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 18 21:50:56 devstack sudo[104050]: pam_unix(sudo:session): session closed for user root Sep 18 21:50:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-642dbabe-9873-4201-98cb-42ab8903895f tempest-CreateVolumesFromSnapshotTest-248322392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-647dda22-4632-4787-8372-5fd9f5c1d986.85fae045-bbd9-456d-9d07-5b0bfeeea7d0" returned: 0 in 0.373s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:50:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-642dbabe-9873-4201-98cb-42ab8903895f tempest-CreateVolumesFromSnapshotTest-248322392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-647dda22-4632-4787-8372-5fd9f5c1d986.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:50:57 devstack sudo[104055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-647dda22-4632-4787-8372-5fd9f5c1d986.info Sep 18 21:50:57 devstack sudo[104055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:50:57 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-527e902b-3045-44a2-a3e2-7ef7a6431dfe tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:50:57 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-527e902b-3045-44a2-a3e2-7ef7a6431dfe tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Flow 'volume_create_manager' (0596dc03-6a51-472d-a168-7b98cb4d060c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:50:57 devstack sudo[104052]: pam_unix(sudo:session): session closed for user root Sep 18 21:50:57 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-527e902b-3045-44a2-a3e2-7ef7a6431dfe tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36cebc3e-984a-4f3f-8075-475c96178d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:50:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-cd06c4af-26d4-4b70-974f-18b4b65a8b74 tempest-VolumeImageDependencyTests-170429094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_90bd439f-c5bb-47c1-807c-97bcf48c5264_k0xecpj6devstack@QuobyteHD" returned: 1 in 0.465s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:50:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-cd06c4af-26d4-4b70-974f-18b4b65a8b74 tempest-VolumeImageDependencyTests-170429094 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_90bd439f-c5bb-47c1-807c-97bcf48c5264_k0xecpj6devstack@QuobyteHD' failed. Not Retrying. {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 18 21:50:57 devstack cinder-volume[86136]: DEBUG cinder.image.image_utils [None req-cd06c4af-26d4-4b70-974f-18b4b65a8b74 tempest-VolumeImageDependencyTests-170429094 None] Temporary image 90bd439f-c5bb-47c1-807c-97bcf48c5264 is fetched for user dca3d6218d674bb09caf9b4d162a1e84. {{(pid=86136) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 18 21:50:57 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-527e902b-3045-44a2-a3e2-7ef7a6431dfe tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36cebc3e-984a-4f3f-8075-475c96178d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:50:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-735339924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e0ea553-c9bf-4472-b7b4-c3d5ed257494,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e83c7726ec8e4909a95aeb3cec428cf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:50:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:50:57Z,use_quota=True,user_id='ffab42d96d37402d88cc76aebb0f84de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:50:57 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-527e902b-3045-44a2-a3e2-7ef7a6431dfe tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dbb8cf3-63d7-42e0-9d37-bc43980eaff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:50:57 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-527e902b-3045-44a2-a3e2-7ef7a6431dfe tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dbb8cf3-63d7-42e0-9d37-bc43980eaff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:50:57 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-527e902b-3045-44a2-a3e2-7ef7a6431dfe tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd2deab7-a12b-4bbd-bed4-4cd919432f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:50:57 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-527e902b-3045-44a2-a3e2-7ef7a6431dfe tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd2deab7-a12b-4bbd-bed4-4cd919432f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e0ea553-c9bf-4472-b7b4-c3d5ed257494', 'volume_name': 'volume-9e0ea553-c9bf-4472-b7b4-c3d5ed257494', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:50:57 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-527e902b-3045-44a2-a3e2-7ef7a6431dfe tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82983065-b62e-4181-8475-0eb10995c900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:50:57 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-527e902b-3045-44a2-a3e2-7ef7a6431dfe tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82983065-b62e-4181-8475-0eb10995c900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:50:57 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-527e902b-3045-44a2-a3e2-7ef7a6431dfe tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (783a6627-e13a-46df-985d-74a577c420fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:50:57 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-527e902b-3045-44a2-a3e2-7ef7a6431dfe tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Volume 9e0ea553-c9bf-4472-b7b4-c3d5ed257494: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e0ea553-c9bf-4472-b7b4-c3d5ed257494', 'volume_size': 1} Sep 18 21:50:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-527e902b-3045-44a2-a3e2-7ef7a6431dfe tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:50:57 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[503b803b-5b51-4905-a18b-9c455f228d1d]: (4, 'raw') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:50:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-cd06c4af-26d4-4b70-974f-18b4b65a8b74 tempest-VolumeImageDependencyTests-170429094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_90bd439f-c5bb-47c1-807c-97bcf48c5264_k0xecpj6devstack@QuobyteHD {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:50:57 devstack sudo[104055]: pam_unix(sudo:session): session closed for user root Sep 18 21:50:57 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-59378519-4dfb-40d9-be90-ac28e7ca2060 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af800c13-b904-4e73-b986-aa8aebc61a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '793d24fd-9fe6-40de-bf11-9dd3a780fa98', 'volume_name': 'volume-793d24fd-9fe6-40de-bf11-9dd3a780fa98', 'volume_size': 1, 'image_id': 'ec3bbfd0-575e-4036-8ed1-bc22b26f2ee2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ec3bbfd0-575e-4036-8ed1-bc22b26f2ee2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a261b7a52952d0fd6f29373165236cd5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3233dc5aa3fd4222a6b0d10d85dbee17', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fb5a2da96b578c37755ff0cb14dba8f03a2634642dfcabb81e732540d264d5ca9dc934cf7de4a9b1d04505ee085622fb9d7c94bec0abe286017f56f0cad2983c', 'id': 'ec3bbfd0-575e-4036-8ed1-bc22b26f2ee2', 'created_at': datetime.datetime(2026, 9, 18, 19, 50, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 18, 19, 50, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ec3bbfd0-575e-4036-8ed1-bc22b26f2ee2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:50:57 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-59378519-4dfb-40d9-be90-ac28e7ca2060 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b14e9530-5355-47d9-97f0-3e45731bc4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:50:57 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-59378519-4dfb-40d9-be90-ac28e7ca2060 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b14e9530-5355-47d9-97f0-3e45731bc4b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:50:57 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-59378519-4dfb-40d9-be90-ac28e7ca2060 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4976387c-c3d4-4410-a298-ecbdc98939a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:50:57 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-59378519-4dfb-40d9-be90-ac28e7ca2060 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] Volume 793d24fd-9fe6-40de-bf11-9dd3a780fa98: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-793d24fd-9fe6-40de-bf11-9dd3a780fa98', 'volume_size': 1, 'image_id': 'ec3bbfd0-575e-4036-8ed1-bc22b26f2ee2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ec3bbfd0-575e-4036-8ed1-bc22b26f2ee2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a261b7a52952d0fd6f29373165236cd5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3233dc5aa3fd4222a6b0d10d85dbee17', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fb5a2da96b578c37755ff0cb14dba8f03a2634642dfcabb81e732540d264d5ca9dc934cf7de4a9b1d04505ee085622fb9d7c94bec0abe286017f56f0cad2983c', 'id': 'ec3bbfd0-575e-4036-8ed1-bc22b26f2ee2', 'created_at': datetime.datetime(2026, 9, 18, 19, 50, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 18, 19, 50, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ec3bbfd0-575e-4036-8ed1-bc22b26f2ee2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 18 21:50:57 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-59378519-4dfb-40d9-be90-ac28e7ca2060 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] Trying to clone 793d24fd-9fe6-40de-bf11-9dd3a780fa98 from image ec3bbfd0-575e-4036-8ed1-bc22b26f2ee2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ec3bbfd0-575e-4036-8ed1-bc22b26f2ee2', 'metadata': {}}]). {{(pid=86136) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 18 21:50:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-642dbabe-9873-4201-98cb-42ab8903895f tempest-CreateVolumesFromSnapshotTest-248322392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-647dda22-4632-4787-8372-5fd9f5c1d986.info" returned: 0 in 0.377s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:50:57 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-642dbabe-9873-4201-98cb-42ab8903895f tempest-CreateVolumesFromSnapshotTest-248322392 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-647dda22-4632-4787-8372-5fd9f5c1d986.info is being set with open permissions: ugo+rw Sep 18 21:50:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-642dbabe-9873-4201-98cb-42ab8903895f tempest-CreateVolumesFromSnapshotTest-248322392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-647dda22-4632-4787-8372-5fd9f5c1d986.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:50:57 devstack sudo[104062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-647dda22-4632-4787-8372-5fd9f5c1d986.info Sep 18 21:50:57 devstack sudo[104062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:50:57 devstack sudo[104061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_90bd439f-c5bb-47c1-807c-97bcf48c5264_k0xecpj6devstack@QuobyteHD Sep 18 21:50:57 devstack sudo[104061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:50:57 devstack cinder-volume[86136]: DEBUG cinder.image.image_utils [None req-59378519-4dfb-40d9-be90-ac28e7ca2060 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ec3bbfd0-575e-4036-8ed1-bc22b26f2ee2_b6vndzkfdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86136) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 18 21:50:57 devstack cinder-volume[86136]: INFO cinder.image.image_utils [None req-59378519-4dfb-40d9-be90-ac28e7ca2060 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] Image download 0.00 MB at 0.00 MB/s Sep 18 21:50:57 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[8856b400-9f55-48fb-87d3-d2910ff89ca2]: (4, 'raw') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:50:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-59378519-4dfb-40d9-be90-ac28e7ca2060 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ec3bbfd0-575e-4036-8ed1-bc22b26f2ee2_b6vndzkfdevstack@QuobyteHD {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:50:57 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-16559dfa-0a59-43ba-a314-18dd28683b1f tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:50:57 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-16559dfa-0a59-43ba-a314-18dd28683b1f tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Flow 'volume_create_manager' (119db5f2-105a-4f9b-87a1-ce052e1a870f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:50:57 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-16559dfa-0a59-43ba-a314-18dd28683b1f tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0117d25-5153-467f-9411-3e7a67e44701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:50:57 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-16559dfa-0a59-43ba-a314-18dd28683b1f tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0117d25-5153-467f-9411-3e7a67e44701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:50:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1001637695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f87a6c52-8dca-40e8-b858-05305d04cf8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e83c7726ec8e4909a95aeb3cec428cf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:50:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:50:58Z,use_quota=True,user_id='ffab42d96d37402d88cc76aebb0f84de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:50:57 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-16559dfa-0a59-43ba-a314-18dd28683b1f tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11a23c48-eacd-4634-9f8c-44d2dc3e7f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:50:57 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-16559dfa-0a59-43ba-a314-18dd28683b1f tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11a23c48-eacd-4634-9f8c-44d2dc3e7f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:50:57 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-16559dfa-0a59-43ba-a314-18dd28683b1f tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62a3431c-db73-4b5c-ac55-e89ef0814263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:50:57 devstack sudo[104062]: pam_unix(sudo:session): session closed for user root Sep 18 21:50:57 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-16559dfa-0a59-43ba-a314-18dd28683b1f tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62a3431c-db73-4b5c-ac55-e89ef0814263) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f87a6c52-8dca-40e8-b858-05305d04cf8f', 'volume_name': 'volume-f87a6c52-8dca-40e8-b858-05305d04cf8f', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:50:57 devstack sudo[104061]: pam_unix(sudo:session): session closed for user root Sep 18 21:50:57 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-16559dfa-0a59-43ba-a314-18dd28683b1f tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0732b57-4047-410f-b1e7-a34786532870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:50:57 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-16559dfa-0a59-43ba-a314-18dd28683b1f tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0732b57-4047-410f-b1e7-a34786532870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:50:57 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-16559dfa-0a59-43ba-a314-18dd28683b1f tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49a79e4e-8245-420d-8787-f332944672f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:50:57 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-16559dfa-0a59-43ba-a314-18dd28683b1f tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Volume f87a6c52-8dca-40e8-b858-05305d04cf8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f87a6c52-8dca-40e8-b858-05305d04cf8f', 'volume_size': 1} Sep 18 21:50:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-16559dfa-0a59-43ba-a314-18dd28683b1f tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:50:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-642dbabe-9873-4201-98cb-42ab8903895f tempest-CreateVolumesFromSnapshotTest-248322392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-647dda22-4632-4787-8372-5fd9f5c1d986.info" returned: 0 in 0.326s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:50:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-cd06c4af-26d4-4b70-974f-18b4b65a8b74 tempest-VolumeImageDependencyTests-170429094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_90bd439f-c5bb-47c1-807c-97bcf48c5264_k0xecpj6devstack@QuobyteHD" returned: 0 in 0.432s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:50:57 devstack sudo[104065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ec3bbfd0-575e-4036-8ed1-bc22b26f2ee2_b6vndzkfdevstack@QuobyteHD Sep 18 21:50:57 devstack sudo[104065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:50:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-642dbabe-9873-4201-98cb-42ab8903895f tempest-CreateVolumesFromSnapshotTest-248322392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.115s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:50:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-cd06c4af-26d4-4b70-974f-18b4b65a8b74 tempest-VolumeImageDependencyTests-170429094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_90bd439f-c5bb-47c1-807c-97bcf48c5264_k0xecpj6devstack@QuobyteHD {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:50:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-b3ec62e1-c954-4e2d-a5d8-63882614b029 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.010s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:50:57 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-b3ec62e1-c954-4e2d-a5d8-63882614b029 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:50:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1865185649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e821f402-95fb-4d3b-8560-db694504f04a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e83c7726ec8e4909a95aeb3cec428cf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:50:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:50:55Z,use_quota=True,user_id='ffab42d96d37402d88cc76aebb0f84de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:50:57 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-b3ec62e1-c954-4e2d-a5d8-63882614b029 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Creating volume e821f402-95fb-4d3b-8560-db694504f04a {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:50:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-b3ec62e1-c954-4e2d-a5d8-63882614b029 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:50:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-b3ec62e1-c954-4e2d-a5d8-63882614b029 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:50:57 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-b3ec62e1-c954-4e2d-a5d8-63882614b029 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:50:57 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-b3ec62e1-c954-4e2d-a5d8-63882614b029 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:50:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-b3ec62e1-c954-4e2d-a5d8-63882614b029 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:50:57 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-b3ec62e1-c954-4e2d-a5d8-63882614b029 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:50:57 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-b3ec62e1-c954-4e2d-a5d8-63882614b029 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:50:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-b3ec62e1-c954-4e2d-a5d8-63882614b029 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e821f402-95fb-4d3b-8560-db694504f04a 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:50:57 devstack sudo[104071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e821f402-95fb-4d3b-8560-db694504f04a 1073741824 Sep 18 21:50:57 devstack sudo[104071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:50:57 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-642dbabe-9873-4201-98cb-42ab8903895f tempest-CreateVolumesFromSnapshotTest-248322392 None] Create snapshot completed successfully Sep 18 21:50:57 devstack sudo[104070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_90bd439f-c5bb-47c1-807c-97bcf48c5264_k0xecpj6devstack@QuobyteHD Sep 18 21:50:57 devstack sudo[104070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:50:57 devstack sudo[104065]: pam_unix(sudo:session): session closed for user root Sep 18 21:50:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-59378519-4dfb-40d9-be90-ac28e7ca2060 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ec3bbfd0-575e-4036-8ed1-bc22b26f2ee2_b6vndzkfdevstack@QuobyteHD" returned: 0 in 0.378s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:50:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-59378519-4dfb-40d9-be90-ac28e7ca2060 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec3bbfd0-575e-4036-8ed1-bc22b26f2ee2_b6vndzkfdevstack@QuobyteHD {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:50:58 devstack sudo[104076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec3bbfd0-575e-4036-8ed1-bc22b26f2ee2_b6vndzkfdevstack@QuobyteHD Sep 18 21:50:58 devstack sudo[104076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:50:58 devstack sudo[104070]: pam_unix(sudo:session): session closed for user root Sep 18 21:50:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-cd06c4af-26d4-4b70-974f-18b4b65a8b74 tempest-VolumeImageDependencyTests-170429094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_90bd439f-c5bb-47c1-807c-97bcf48c5264_k0xecpj6devstack@QuobyteHD" returned: 1 in 0.356s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:50:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-cd06c4af-26d4-4b70-974f-18b4b65a8b74 tempest-VolumeImageDependencyTests-170429094 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_90bd439f-c5bb-47c1-807c-97bcf48c5264_k0xecpj6devstack@QuobyteHD' failed. Not Retrying. {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 18 21:50:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-cd06c4af-26d4-4b70-974f-18b4b65a8b74 tempest-VolumeImageDependencyTests-170429094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:50:58 devstack sudo[104071]: pam_unix(sudo:session): session closed for user root Sep 18 21:50:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-b3ec62e1-c954-4e2d-a5d8-63882614b029 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e821f402-95fb-4d3b-8560-db694504f04a 1073741824" returned: 0 in 0.441s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:50:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-b3ec62e1-c954-4e2d-a5d8-63882614b029 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e821f402-95fb-4d3b-8560-db694504f04a {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:50:58 devstack sudo[104084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e821f402-95fb-4d3b-8560-db694504f04a Sep 18 21:50:58 devstack sudo[104084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:50:58 devstack sudo[104076]: pam_unix(sudo:session): session closed for user root Sep 18 21:50:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-59378519-4dfb-40d9-be90-ac28e7ca2060 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec3bbfd0-575e-4036-8ed1-bc22b26f2ee2_b6vndzkfdevstack@QuobyteHD" returned: 1 in 0.371s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:50:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-59378519-4dfb-40d9-be90-ac28e7ca2060 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec3bbfd0-575e-4036-8ed1-bc22b26f2ee2_b6vndzkfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 18 21:50:58 devstack cinder-volume[86136]: DEBUG cinder.image.image_utils [None req-59378519-4dfb-40d9-be90-ac28e7ca2060 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] Temporary image ec3bbfd0-575e-4036-8ed1-bc22b26f2ee2 is fetched for user 6a41c450d0574b6f9bf4f8396421df9d. {{(pid=86136) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 18 21:50:58 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b3fa25-0382-4d34-8ba5-1b4c355fb0bc]: (4, 'raw') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:50:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-59378519-4dfb-40d9-be90-ac28e7ca2060 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ec3bbfd0-575e-4036-8ed1-bc22b26f2ee2_b6vndzkfdevstack@QuobyteHD {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:50:58 devstack sudo[104084]: pam_unix(sudo:session): session closed for user root Sep 18 21:50:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-b3ec62e1-c954-4e2d-a5d8-63882614b029 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e821f402-95fb-4d3b-8560-db694504f04a" returned: 0 in 0.265s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:50:58 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-b3ec62e1-c954-4e2d-a5d8-63882614b029 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:50:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-b3ec62e1-c954-4e2d-a5d8-63882614b029 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:50:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-23303b59-e749-4817-9463-647a5b3ceb28 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.214s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:50:58 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-23303b59-e749-4817-9463-647a5b3ceb28 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:50:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-351830979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc4b729c-5186-4461-88f9-6399efdce2f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e83c7726ec8e4909a95aeb3cec428cf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:50:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:50:56Z,use_quota=True,user_id='ffab42d96d37402d88cc76aebb0f84de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:50:58 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-23303b59-e749-4817-9463-647a5b3ceb28 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Creating volume fc4b729c-5186-4461-88f9-6399efdce2f6 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:50:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-23303b59-e749-4817-9463-647a5b3ceb28 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:50:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-23303b59-e749-4817-9463-647a5b3ceb28 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:50:58 devstack sudo[104089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ec3bbfd0-575e-4036-8ed1-bc22b26f2ee2_b6vndzkfdevstack@QuobyteHD Sep 18 21:50:58 devstack sudo[104089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:50:58 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-23303b59-e749-4817-9463-647a5b3ceb28 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:50:58 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-23303b59-e749-4817-9463-647a5b3ceb28 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:50:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-23303b59-e749-4817-9463-647a5b3ceb28 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:50:58 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-23303b59-e749-4817-9463-647a5b3ceb28 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:50:58 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-23303b59-e749-4817-9463-647a5b3ceb28 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:50:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-23303b59-e749-4817-9463-647a5b3ceb28 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fc4b729c-5186-4461-88f9-6399efdce2f6 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:50:58 devstack sudo[104092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fc4b729c-5186-4461-88f9-6399efdce2f6 1073741824 Sep 18 21:50:58 devstack sudo[104092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:50:58 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b3ec62e1-c954-4e2d-a5d8-63882614b029 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c55cc4c9-114a-44df-ae66-ba4d602ec5a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e821f402-95fb-4d3b-8560-db694504f04a', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:50:58 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b3ec62e1-c954-4e2d-a5d8-63882614b029 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5ea7992-8d24-4bdc-b2ff-65be5ea4dabd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:50:58 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-b3ec62e1-c954-4e2d-a5d8-63882614b029 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Volume volume-e821f402-95fb-4d3b-8560-db694504f04a (e821f402-95fb-4d3b-8560-db694504f04a): created successfully Sep 18 21:50:58 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b3ec62e1-c954-4e2d-a5d8-63882614b029 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5ea7992-8d24-4bdc-b2ff-65be5ea4dabd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:50:58 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b3ec62e1-c954-4e2d-a5d8-63882614b029 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Flow 'volume_create_manager' (6a960684-9707-465c-9260-166b8de9137a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:50:58 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-b3ec62e1-c954-4e2d-a5d8-63882614b029 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Created volume successfully. Sep 18 21:50:58 devstack sudo[104089]: pam_unix(sudo:session): session closed for user root Sep 18 21:50:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-59378519-4dfb-40d9-be90-ac28e7ca2060 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ec3bbfd0-575e-4036-8ed1-bc22b26f2ee2_b6vndzkfdevstack@QuobyteHD" returned: 0 in 0.365s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:50:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-59378519-4dfb-40d9-be90-ac28e7ca2060 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec3bbfd0-575e-4036-8ed1-bc22b26f2ee2_b6vndzkfdevstack@QuobyteHD {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:50:58 devstack sudo[104096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec3bbfd0-575e-4036-8ed1-bc22b26f2ee2_b6vndzkfdevstack@QuobyteHD Sep 18 21:50:58 devstack sudo[104096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:50:59 devstack sudo[104092]: pam_unix(sudo:session): session closed for user root Sep 18 21:50:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-23303b59-e749-4817-9463-647a5b3ceb28 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fc4b729c-5186-4461-88f9-6399efdce2f6 1073741824" returned: 0 in 0.501s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:50:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-23303b59-e749-4817-9463-647a5b3ceb28 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fc4b729c-5186-4461-88f9-6399efdce2f6 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:50:59 devstack sudo[104103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fc4b729c-5186-4461-88f9-6399efdce2f6 Sep 18 21:50:59 devstack sudo[104103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:50:59 devstack sudo[104096]: pam_unix(sudo:session): session closed for user root Sep 18 21:50:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-59378519-4dfb-40d9-be90-ac28e7ca2060 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec3bbfd0-575e-4036-8ed1-bc22b26f2ee2_b6vndzkfdevstack@QuobyteHD" returned: 1 in 0.373s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:50:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-59378519-4dfb-40d9-be90-ac28e7ca2060 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec3bbfd0-575e-4036-8ed1-bc22b26f2ee2_b6vndzkfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 18 21:50:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-59378519-4dfb-40d9-be90-ac28e7ca2060 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:50:59 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-82c562e5-73d8-4f16-930f-be5851b0ce36 tempest-CreateVolumesFromSnapshotTest-248322392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:50:59 devstack sudo[104103]: pam_unix(sudo:session): session closed for user root Sep 18 21:50:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-82c562e5-73d8-4f16-930f-be5851b0ce36 tempest-CreateVolumesFromSnapshotTest-248322392 None] Flow 'volume_create_manager' (eb9b14df-f4bf-4126-8cb0-6e33e3102114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:50:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-82c562e5-73d8-4f16-930f-be5851b0ce36 tempest-CreateVolumesFromSnapshotTest-248322392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (046f526e-552e-4119-9ab1-a81872fc3d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:50:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-23303b59-e749-4817-9463-647a5b3ceb28 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fc4b729c-5186-4461-88f9-6399efdce2f6" returned: 0 in 0.301s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:50:59 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-23303b59-e749-4817-9463-647a5b3ceb28 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:50:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-23303b59-e749-4817-9463-647a5b3ceb28 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:50:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-ab398b76-fcb3-43a1-a75c-c12fe91c6039 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.680s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:50:59 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-ab398b76-fcb3-43a1-a75c-c12fe91c6039 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:50:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1673213910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f1c92c1-4aa5-4cea-aff6-2d10673b33e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e83c7726ec8e4909a95aeb3cec428cf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:50:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:50:56Z,use_quota=True,user_id='ffab42d96d37402d88cc76aebb0f84de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:50:59 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-ab398b76-fcb3-43a1-a75c-c12fe91c6039 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Creating volume 9f1c92c1-4aa5-4cea-aff6-2d10673b33e4 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:50:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-ab398b76-fcb3-43a1-a75c-c12fe91c6039 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:50:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-ab398b76-fcb3-43a1-a75c-c12fe91c6039 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:50:59 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-ab398b76-fcb3-43a1-a75c-c12fe91c6039 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:50:59 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-ab398b76-fcb3-43a1-a75c-c12fe91c6039 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:50:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-ab398b76-fcb3-43a1-a75c-c12fe91c6039 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:50:59 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-ab398b76-fcb3-43a1-a75c-c12fe91c6039 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:50:59 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-ab398b76-fcb3-43a1-a75c-c12fe91c6039 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:50:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ab398b76-fcb3-43a1-a75c-c12fe91c6039 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9f1c92c1-4aa5-4cea-aff6-2d10673b33e4 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:50:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-82c562e5-73d8-4f16-930f-be5851b0ce36 tempest-CreateVolumesFromSnapshotTest-248322392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (046f526e-552e-4119-9ab1-a81872fc3d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:50:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1373030681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22d7bc9a-e85d-4189-8619-acc71a7c234d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3ae13e6e3ab4f639f5c405f0fcfa3f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:50:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:50:59Z,use_quota=True,user_id='6028ee24d4f84c5da80d946f13c838fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:50:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-82c562e5-73d8-4f16-930f-be5851b0ce36 tempest-CreateVolumesFromSnapshotTest-248322392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (589bd592-89f7-4b73-b6d4-653cc87fc187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:50:59 devstack sudo[104108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9f1c92c1-4aa5-4cea-aff6-2d10673b33e4 1073741824 Sep 18 21:50:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-82c562e5-73d8-4f16-930f-be5851b0ce36 tempest-CreateVolumesFromSnapshotTest-248322392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (589bd592-89f7-4b73-b6d4-653cc87fc187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:50:59 devstack sudo[104108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:50:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-82c562e5-73d8-4f16-930f-be5851b0ce36 tempest-CreateVolumesFromSnapshotTest-248322392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33225d73-c98a-44c4-b5c4-382421f1f0ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:50:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-82c562e5-73d8-4f16-930f-be5851b0ce36 tempest-CreateVolumesFromSnapshotTest-248322392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33225d73-c98a-44c4-b5c4-382421f1f0ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22d7bc9a-e85d-4189-8619-acc71a7c234d', 'volume_name': 'volume-22d7bc9a-e85d-4189-8619-acc71a7c234d', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:50:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-82c562e5-73d8-4f16-930f-be5851b0ce36 tempest-CreateVolumesFromSnapshotTest-248322392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef12e019-3ae1-4b08-a5ed-d76ccf1deb67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:50:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-82c562e5-73d8-4f16-930f-be5851b0ce36 tempest-CreateVolumesFromSnapshotTest-248322392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef12e019-3ae1-4b08-a5ed-d76ccf1deb67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:50:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-82c562e5-73d8-4f16-930f-be5851b0ce36 tempest-CreateVolumesFromSnapshotTest-248322392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e92544eb-07e1-4d2d-a4b5-c2691c574f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:50:59 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-82c562e5-73d8-4f16-930f-be5851b0ce36 tempest-CreateVolumesFromSnapshotTest-248322392 None] Volume 22d7bc9a-e85d-4189-8619-acc71a7c234d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22d7bc9a-e85d-4189-8619-acc71a7c234d', 'volume_size': 1} Sep 18 21:50:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-82c562e5-73d8-4f16-930f-be5851b0ce36 tempest-CreateVolumesFromSnapshotTest-248322392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:50:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-23303b59-e749-4817-9463-647a5b3ceb28 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d53f7dc-146a-4794-8203-02a384a21f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc4b729c-5186-4461-88f9-6399efdce2f6', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:50:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-23303b59-e749-4817-9463-647a5b3ceb28 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9d74f3b-4cd2-49e4-965f-38c6ca324ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:50:59 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-23303b59-e749-4817-9463-647a5b3ceb28 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Volume volume-fc4b729c-5186-4461-88f9-6399efdce2f6 (fc4b729c-5186-4461-88f9-6399efdce2f6): created successfully Sep 18 21:50:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-23303b59-e749-4817-9463-647a5b3ceb28 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9d74f3b-4cd2-49e4-965f-38c6ca324ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:50:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-23303b59-e749-4817-9463-647a5b3ceb28 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Flow 'volume_create_manager' (702538c1-b36c-40d8-86ab-95e5f1f50c79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:50:59 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-23303b59-e749-4817-9463-647a5b3ceb28 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Created volume successfully. Sep 18 21:50:59 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-14849862-a167-47ee-b1ed-ee7a587574f9 tempest-CreateVolumesFromSnapshotTest-248322392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:50:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-14849862-a167-47ee-b1ed-ee7a587574f9 tempest-CreateVolumesFromSnapshotTest-248322392 None] Flow 'volume_create_manager' (09b676b5-2105-4a3b-8639-a27818a9b611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:50:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-14849862-a167-47ee-b1ed-ee7a587574f9 tempest-CreateVolumesFromSnapshotTest-248322392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a81c3780-7e1e-448f-8cf4-d53f3349c014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:50:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-14849862-a167-47ee-b1ed-ee7a587574f9 tempest-CreateVolumesFromSnapshotTest-248322392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a81c3780-7e1e-448f-8cf4-d53f3349c014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:50:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1842491020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d406132-402e-43b4-b31f-35e30f09a004,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3ae13e6e3ab4f639f5c405f0fcfa3f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:51:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:51:00Z,use_quota=True,user_id='6028ee24d4f84c5da80d946f13c838fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:50:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-14849862-a167-47ee-b1ed-ee7a587574f9 tempest-CreateVolumesFromSnapshotTest-248322392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60828b57-9133-4937-bd72-daf1e4a6b364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:50:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-14849862-a167-47ee-b1ed-ee7a587574f9 tempest-CreateVolumesFromSnapshotTest-248322392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60828b57-9133-4937-bd72-daf1e4a6b364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:50:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-14849862-a167-47ee-b1ed-ee7a587574f9 tempest-CreateVolumesFromSnapshotTest-248322392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14446de3-addc-49d1-a8f6-3ee6e5db64ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:50:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-14849862-a167-47ee-b1ed-ee7a587574f9 tempest-CreateVolumesFromSnapshotTest-248322392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14446de3-addc-49d1-a8f6-3ee6e5db64ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d406132-402e-43b4-b31f-35e30f09a004', 'volume_name': 'volume-6d406132-402e-43b4-b31f-35e30f09a004', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:50:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-14849862-a167-47ee-b1ed-ee7a587574f9 tempest-CreateVolumesFromSnapshotTest-248322392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a27012d1-3250-4639-b021-7ccebd3311ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:50:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-14849862-a167-47ee-b1ed-ee7a587574f9 tempest-CreateVolumesFromSnapshotTest-248322392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a27012d1-3250-4639-b021-7ccebd3311ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:50:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-14849862-a167-47ee-b1ed-ee7a587574f9 tempest-CreateVolumesFromSnapshotTest-248322392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (395b61dc-5014-40d5-884c-650f573956df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:50:59 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-14849862-a167-47ee-b1ed-ee7a587574f9 tempest-CreateVolumesFromSnapshotTest-248322392 None] Volume 6d406132-402e-43b4-b31f-35e30f09a004: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d406132-402e-43b4-b31f-35e30f09a004', 'volume_size': 1} Sep 18 21:50:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-14849862-a167-47ee-b1ed-ee7a587574f9 tempest-CreateVolumesFromSnapshotTest-248322392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:50:59 devstack sudo[104108]: pam_unix(sudo:session): session closed for user root Sep 18 21:50:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ab398b76-fcb3-43a1-a75c-c12fe91c6039 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9f1c92c1-4aa5-4cea-aff6-2d10673b33e4 1073741824" returned: 0 in 0.571s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ab398b76-fcb3-43a1-a75c-c12fe91c6039 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9f1c92c1-4aa5-4cea-aff6-2d10673b33e4 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:00 devstack sudo[104114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9f1c92c1-4aa5-4cea-aff6-2d10673b33e4 Sep 18 21:51:00 devstack sudo[104114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:00 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a19e3be-0ba3-4e79-8542-208efb8a51e4 tempest-CreateVolumesFromSnapshotTest-248322392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:51:00 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-5a19e3be-0ba3-4e79-8542-208efb8a51e4 tempest-CreateVolumesFromSnapshotTest-248322392 None] Flow 'volume_create_manager' (30fa5075-dd80-4d92-b75d-b6e5ebdbcc3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:51:00 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-5a19e3be-0ba3-4e79-8542-208efb8a51e4 tempest-CreateVolumesFromSnapshotTest-248322392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00da6ed0-aa68-4c6d-a713-89a8cbf67fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:00 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-5a19e3be-0ba3-4e79-8542-208efb8a51e4 tempest-CreateVolumesFromSnapshotTest-248322392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00da6ed0-aa68-4c6d-a713-89a8cbf67fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:51:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-757538253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55af36c4-fb5a-4740-8232-9e1653b1f710,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3ae13e6e3ab4f639f5c405f0fcfa3f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:51:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:51:00Z,use_quota=True,user_id='6028ee24d4f84c5da80d946f13c838fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:00 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-5a19e3be-0ba3-4e79-8542-208efb8a51e4 tempest-CreateVolumesFromSnapshotTest-248322392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c23cdf03-8a24-4b5a-a54a-b4123e14800f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:00 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-5a19e3be-0ba3-4e79-8542-208efb8a51e4 tempest-CreateVolumesFromSnapshotTest-248322392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c23cdf03-8a24-4b5a-a54a-b4123e14800f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:00 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-5a19e3be-0ba3-4e79-8542-208efb8a51e4 tempest-CreateVolumesFromSnapshotTest-248322392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8033dda1-bc0b-496c-a0c2-756d16f348da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:00 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-5a19e3be-0ba3-4e79-8542-208efb8a51e4 tempest-CreateVolumesFromSnapshotTest-248322392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8033dda1-bc0b-496c-a0c2-756d16f348da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55af36c4-fb5a-4740-8232-9e1653b1f710', 'volume_name': 'volume-55af36c4-fb5a-4740-8232-9e1653b1f710', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:00 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-5a19e3be-0ba3-4e79-8542-208efb8a51e4 tempest-CreateVolumesFromSnapshotTest-248322392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61975321-5ea9-4d33-a860-c9bea8db3ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:00 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-5a19e3be-0ba3-4e79-8542-208efb8a51e4 tempest-CreateVolumesFromSnapshotTest-248322392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61975321-5ea9-4d33-a860-c9bea8db3ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:00 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-5a19e3be-0ba3-4e79-8542-208efb8a51e4 tempest-CreateVolumesFromSnapshotTest-248322392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46e7adda-1acc-4811-a8e5-4186bef21c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:00 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-5a19e3be-0ba3-4e79-8542-208efb8a51e4 tempest-CreateVolumesFromSnapshotTest-248322392 None] Volume 55af36c4-fb5a-4740-8232-9e1653b1f710: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55af36c4-fb5a-4740-8232-9e1653b1f710', 'volume_size': 1} Sep 18 21:51:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-5a19e3be-0ba3-4e79-8542-208efb8a51e4 tempest-CreateVolumesFromSnapshotTest-248322392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:51:00 devstack sudo[104114]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ab398b76-fcb3-43a1-a75c-c12fe91c6039 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9f1c92c1-4aa5-4cea-aff6-2d10673b33e4" returned: 0 in 0.258s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:00 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-ab398b76-fcb3-43a1-a75c-c12fe91c6039 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:51:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-ab398b76-fcb3-43a1-a75c-c12fe91c6039 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:51:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-527e902b-3045-44a2-a3e2-7ef7a6431dfe tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.048s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:51:00 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-527e902b-3045-44a2-a3e2-7ef7a6431dfe tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:50:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-735339924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e0ea553-c9bf-4472-b7b4-c3d5ed257494,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e83c7726ec8e4909a95aeb3cec428cf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:50:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:50:57Z,use_quota=True,user_id='ffab42d96d37402d88cc76aebb0f84de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:51:00 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-527e902b-3045-44a2-a3e2-7ef7a6431dfe tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Creating volume 9e0ea553-c9bf-4472-b7b4-c3d5ed257494 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:51:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-527e902b-3045-44a2-a3e2-7ef7a6431dfe tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:51:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-527e902b-3045-44a2-a3e2-7ef7a6431dfe tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:51:00 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-527e902b-3045-44a2-a3e2-7ef7a6431dfe tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:51:00 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-527e902b-3045-44a2-a3e2-7ef7a6431dfe tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:51:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-527e902b-3045-44a2-a3e2-7ef7a6431dfe tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:51:00 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-527e902b-3045-44a2-a3e2-7ef7a6431dfe tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:51:00 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-527e902b-3045-44a2-a3e2-7ef7a6431dfe tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:51:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-527e902b-3045-44a2-a3e2-7ef7a6431dfe tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9e0ea553-c9bf-4472-b7b4-c3d5ed257494 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:00 devstack sudo[104117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9e0ea553-c9bf-4472-b7b4-c3d5ed257494 1073741824 Sep 18 21:51:00 devstack sudo[104117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:00 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ab398b76-fcb3-43a1-a75c-c12fe91c6039 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8302d3e-83f3-42e6-902f-41876238c011) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f1c92c1-4aa5-4cea-aff6-2d10673b33e4', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:00 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ab398b76-fcb3-43a1-a75c-c12fe91c6039 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d97fbd93-59eb-437d-aade-b0d7bba406e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:00 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-ab398b76-fcb3-43a1-a75c-c12fe91c6039 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Volume volume-9f1c92c1-4aa5-4cea-aff6-2d10673b33e4 (9f1c92c1-4aa5-4cea-aff6-2d10673b33e4): created successfully Sep 18 21:51:00 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ab398b76-fcb3-43a1-a75c-c12fe91c6039 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d97fbd93-59eb-437d-aade-b0d7bba406e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:00 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ab398b76-fcb3-43a1-a75c-c12fe91c6039 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Flow 'volume_create_manager' (3d1af28d-61dd-4698-b7eb-f595799597c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:51:00 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-ab398b76-fcb3-43a1-a75c-c12fe91c6039 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Created volume successfully. Sep 18 21:51:00 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a65dd1e-8d9d-47ee-891a-b71763d2e9e8 tempest-CreateVolumesFromSnapshotTest-248322392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:51:00 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-1a65dd1e-8d9d-47ee-891a-b71763d2e9e8 tempest-CreateVolumesFromSnapshotTest-248322392 None] Flow 'volume_create_manager' (dbc847dd-7d78-4483-80f5-cf6baddb39d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:51:00 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-1a65dd1e-8d9d-47ee-891a-b71763d2e9e8 tempest-CreateVolumesFromSnapshotTest-248322392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e128a0b-a928-4122-8055-b1f88a5518b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:00 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-1a65dd1e-8d9d-47ee-891a-b71763d2e9e8 tempest-CreateVolumesFromSnapshotTest-248322392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e128a0b-a928-4122-8055-b1f88a5518b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:51:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-938203535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d3e2b83-f76d-4361-9f34-d0c1a7f160c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3ae13e6e3ab4f639f5c405f0fcfa3f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:51:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:51:00Z,use_quota=True,user_id='6028ee24d4f84c5da80d946f13c838fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:00 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-1a65dd1e-8d9d-47ee-891a-b71763d2e9e8 tempest-CreateVolumesFromSnapshotTest-248322392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6abe95c1-e193-4af5-baaf-032b05d41fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:00 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-1a65dd1e-8d9d-47ee-891a-b71763d2e9e8 tempest-CreateVolumesFromSnapshotTest-248322392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6abe95c1-e193-4af5-baaf-032b05d41fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:00 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-1a65dd1e-8d9d-47ee-891a-b71763d2e9e8 tempest-CreateVolumesFromSnapshotTest-248322392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e94eb113-f5e4-41bd-84e1-e1d627726f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:00 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-1a65dd1e-8d9d-47ee-891a-b71763d2e9e8 tempest-CreateVolumesFromSnapshotTest-248322392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e94eb113-f5e4-41bd-84e1-e1d627726f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d3e2b83-f76d-4361-9f34-d0c1a7f160c7', 'volume_name': 'volume-6d3e2b83-f76d-4361-9f34-d0c1a7f160c7', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:00 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-1a65dd1e-8d9d-47ee-891a-b71763d2e9e8 tempest-CreateVolumesFromSnapshotTest-248322392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33fc36fe-3d26-4f76-b248-f3b6451e853d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:00 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-1a65dd1e-8d9d-47ee-891a-b71763d2e9e8 tempest-CreateVolumesFromSnapshotTest-248322392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33fc36fe-3d26-4f76-b248-f3b6451e853d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:00 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-1a65dd1e-8d9d-47ee-891a-b71763d2e9e8 tempest-CreateVolumesFromSnapshotTest-248322392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22beca29-ccbc-45ec-b453-58a0dfd2b346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:00 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-1a65dd1e-8d9d-47ee-891a-b71763d2e9e8 tempest-CreateVolumesFromSnapshotTest-248322392 None] Volume 6d3e2b83-f76d-4361-9f34-d0c1a7f160c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d3e2b83-f76d-4361-9f34-d0c1a7f160c7', 'volume_size': 1} Sep 18 21:51:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-1a65dd1e-8d9d-47ee-891a-b71763d2e9e8 tempest-CreateVolumesFromSnapshotTest-248322392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:51:00 devstack sudo[104117]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-527e902b-3045-44a2-a3e2-7ef7a6431dfe tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9e0ea553-c9bf-4472-b7b4-c3d5ed257494 1073741824" returned: 0 in 0.567s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-527e902b-3045-44a2-a3e2-7ef7a6431dfe tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9e0ea553-c9bf-4472-b7b4-c3d5ed257494 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:00 devstack sudo[104126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9e0ea553-c9bf-4472-b7b4-c3d5ed257494 Sep 18 21:51:00 devstack sudo[104126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:00 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6101979-0249-4f82-9f9c-583a9b170cf1 tempest-CreateVolumesFromSnapshotTest-248322392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:51:00 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-e6101979-0249-4f82-9f9c-583a9b170cf1 tempest-CreateVolumesFromSnapshotTest-248322392 None] Flow 'volume_create_manager' (1c4297c7-114d-48da-b1e1-6591e49d82a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:51:01 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-e6101979-0249-4f82-9f9c-583a9b170cf1 tempest-CreateVolumesFromSnapshotTest-248322392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0ab78b9-8b64-4039-848e-fde81d01c658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:01 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-e6101979-0249-4f82-9f9c-583a9b170cf1 tempest-CreateVolumesFromSnapshotTest-248322392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0ab78b9-8b64-4039-848e-fde81d01c658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:51:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-796867474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4f2acd1-ada9-40a2-ac29-c75d491488f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3ae13e6e3ab4f639f5c405f0fcfa3f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:51:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:51:01Z,use_quota=True,user_id='6028ee24d4f84c5da80d946f13c838fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:01 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-e6101979-0249-4f82-9f9c-583a9b170cf1 tempest-CreateVolumesFromSnapshotTest-248322392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (936bb08e-154a-4b9b-b409-191e457729c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:01 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-e6101979-0249-4f82-9f9c-583a9b170cf1 tempest-CreateVolumesFromSnapshotTest-248322392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (936bb08e-154a-4b9b-b409-191e457729c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:01 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-e6101979-0249-4f82-9f9c-583a9b170cf1 tempest-CreateVolumesFromSnapshotTest-248322392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7263bf16-25c7-4d15-8ca3-d9e6e96f1975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:01 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-e6101979-0249-4f82-9f9c-583a9b170cf1 tempest-CreateVolumesFromSnapshotTest-248322392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7263bf16-25c7-4d15-8ca3-d9e6e96f1975) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4f2acd1-ada9-40a2-ac29-c75d491488f3', 'volume_name': 'volume-a4f2acd1-ada9-40a2-ac29-c75d491488f3', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:01 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-e6101979-0249-4f82-9f9c-583a9b170cf1 tempest-CreateVolumesFromSnapshotTest-248322392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d9112c1-c749-4f14-87c0-c0d4e2dd5833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:01 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-e6101979-0249-4f82-9f9c-583a9b170cf1 tempest-CreateVolumesFromSnapshotTest-248322392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d9112c1-c749-4f14-87c0-c0d4e2dd5833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:01 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-e6101979-0249-4f82-9f9c-583a9b170cf1 tempest-CreateVolumesFromSnapshotTest-248322392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9b1bf40-e501-4316-8be2-415b466775b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:01 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-e6101979-0249-4f82-9f9c-583a9b170cf1 tempest-CreateVolumesFromSnapshotTest-248322392 None] Volume a4f2acd1-ada9-40a2-ac29-c75d491488f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4f2acd1-ada9-40a2-ac29-c75d491488f3', 'volume_size': 1} Sep 18 21:51:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-e6101979-0249-4f82-9f9c-583a9b170cf1 tempest-CreateVolumesFromSnapshotTest-248322392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:51:01 devstack sudo[104126]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-527e902b-3045-44a2-a3e2-7ef7a6431dfe tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9e0ea553-c9bf-4472-b7b4-c3d5ed257494" returned: 0 in 0.281s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:01 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-527e902b-3045-44a2-a3e2-7ef7a6431dfe tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:51:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-527e902b-3045-44a2-a3e2-7ef7a6431dfe tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:51:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-16559dfa-0a59-43ba-a314-18dd28683b1f tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.453s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:51:01 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-16559dfa-0a59-43ba-a314-18dd28683b1f tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:50:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1001637695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f87a6c52-8dca-40e8-b858-05305d04cf8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e83c7726ec8e4909a95aeb3cec428cf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:50:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:50:58Z,use_quota=True,user_id='ffab42d96d37402d88cc76aebb0f84de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:51:01 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-16559dfa-0a59-43ba-a314-18dd28683b1f tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Creating volume f87a6c52-8dca-40e8-b858-05305d04cf8f {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:51:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-16559dfa-0a59-43ba-a314-18dd28683b1f tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:51:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-16559dfa-0a59-43ba-a314-18dd28683b1f tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:51:01 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-16559dfa-0a59-43ba-a314-18dd28683b1f tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:51:01 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-16559dfa-0a59-43ba-a314-18dd28683b1f tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:51:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-16559dfa-0a59-43ba-a314-18dd28683b1f tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:51:01 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-16559dfa-0a59-43ba-a314-18dd28683b1f tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:51:01 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-16559dfa-0a59-43ba-a314-18dd28683b1f tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:51:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-16559dfa-0a59-43ba-a314-18dd28683b1f tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f87a6c52-8dca-40e8-b858-05305d04cf8f 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:01 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-527e902b-3045-44a2-a3e2-7ef7a6431dfe tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (783a6627-e13a-46df-985d-74a577c420fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e0ea553-c9bf-4472-b7b4-c3d5ed257494', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:01 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-527e902b-3045-44a2-a3e2-7ef7a6431dfe tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73d045ac-27b2-4521-86c0-7f2e618f62bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:01 devstack sudo[104129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f87a6c52-8dca-40e8-b858-05305d04cf8f 1073741824 Sep 18 21:51:01 devstack sudo[104129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:01 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-527e902b-3045-44a2-a3e2-7ef7a6431dfe tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Volume volume-9e0ea553-c9bf-4472-b7b4-c3d5ed257494 (9e0ea553-c9bf-4472-b7b4-c3d5ed257494): created successfully Sep 18 21:51:01 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-527e902b-3045-44a2-a3e2-7ef7a6431dfe tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73d045ac-27b2-4521-86c0-7f2e618f62bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:01 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-527e902b-3045-44a2-a3e2-7ef7a6431dfe tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Flow 'volume_create_manager' (0596dc03-6a51-472d-a168-7b98cb4d060c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:51:01 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-527e902b-3045-44a2-a3e2-7ef7a6431dfe tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Created volume successfully. Sep 18 21:51:01 devstack sudo[104129]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-16559dfa-0a59-43ba-a314-18dd28683b1f tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f87a6c52-8dca-40e8-b858-05305d04cf8f 1073741824" returned: 0 in 0.416s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-16559dfa-0a59-43ba-a314-18dd28683b1f tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f87a6c52-8dca-40e8-b858-05305d04cf8f {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:01 devstack sudo[104134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f87a6c52-8dca-40e8-b858-05305d04cf8f Sep 18 21:51:01 devstack sudo[104134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:01 devstack sudo[104134]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-16559dfa-0a59-43ba-a314-18dd28683b1f tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f87a6c52-8dca-40e8-b858-05305d04cf8f" returned: 0 in 0.246s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:01 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-16559dfa-0a59-43ba-a314-18dd28683b1f tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:51:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-16559dfa-0a59-43ba-a314-18dd28683b1f tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:51:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-cd06c4af-26d4-4b70-974f-18b4b65a8b74 tempest-VolumeImageDependencyTests-170429094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.776s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:51:01 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-cd06c4af-26d4-4b70-974f-18b4b65a8b74 tempest-VolumeImageDependencyTests-170429094 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:50:55Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30d6bad8-5a3c-4c5f-a6f5-36933fc15561,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='142de6b26dc64ac0ab9d852fb9de9772',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:50:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:50:55Z,use_quota=True,user_id='dca3d6218d674bb09caf9b4d162a1e84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:51:01 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-cd06c4af-26d4-4b70-974f-18b4b65a8b74 tempest-VolumeImageDependencyTests-170429094 None] Creating volume 30d6bad8-5a3c-4c5f-a6f5-36933fc15561 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:51:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-cd06c4af-26d4-4b70-974f-18b4b65a8b74 tempest-VolumeImageDependencyTests-170429094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:51:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-cd06c4af-26d4-4b70-974f-18b4b65a8b74 tempest-VolumeImageDependencyTests-170429094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:51:01 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-cd06c4af-26d4-4b70-974f-18b4b65a8b74 tempest-VolumeImageDependencyTests-170429094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:51:01 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-cd06c4af-26d4-4b70-974f-18b4b65a8b74 tempest-VolumeImageDependencyTests-170429094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:51:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-cd06c4af-26d4-4b70-974f-18b4b65a8b74 tempest-VolumeImageDependencyTests-170429094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:51:01 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-cd06c4af-26d4-4b70-974f-18b4b65a8b74 tempest-VolumeImageDependencyTests-170429094 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:51:01 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-cd06c4af-26d4-4b70-974f-18b4b65a8b74 tempest-VolumeImageDependencyTests-170429094 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:51:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-cd06c4af-26d4-4b70-974f-18b4b65a8b74 tempest-VolumeImageDependencyTests-170429094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-30d6bad8-5a3c-4c5f-a6f5-36933fc15561 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:01 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-16559dfa-0a59-43ba-a314-18dd28683b1f tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49a79e4e-8245-420d-8787-f332944672f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f87a6c52-8dca-40e8-b858-05305d04cf8f', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:01 devstack sudo[104137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-30d6bad8-5a3c-4c5f-a6f5-36933fc15561 1073741824 Sep 18 21:51:01 devstack sudo[104137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:01 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-16559dfa-0a59-43ba-a314-18dd28683b1f tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37dba949-b7d7-458e-ae79-5bbc5363e21b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:01 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-16559dfa-0a59-43ba-a314-18dd28683b1f tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Volume volume-f87a6c52-8dca-40e8-b858-05305d04cf8f (f87a6c52-8dca-40e8-b858-05305d04cf8f): created successfully Sep 18 21:51:01 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-16559dfa-0a59-43ba-a314-18dd28683b1f tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37dba949-b7d7-458e-ae79-5bbc5363e21b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:01 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-16559dfa-0a59-43ba-a314-18dd28683b1f tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Flow 'volume_create_manager' (119db5f2-105a-4f9b-87a1-ce052e1a870f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:51:01 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-16559dfa-0a59-43ba-a314-18dd28683b1f tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Created volume successfully. Sep 18 21:51:02 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-63efa62d-b3e7-433a-ae2b-4b1552c89b43 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Acquiring lock "cinder-f87a6c52-8dca-40e8-b858-05305d04cf8f-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:51:02 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-63efa62d-b3e7-433a-ae2b-4b1552c89b43 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Lock "cinder-f87a6c52-8dca-40e8-b858-05305d04cf8f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:51:02 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-63efa62d-b3e7-433a-ae2b-4b1552c89b43 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Acquiring lock "cinder-quobyte-f87a6c52-8dca-40e8-b858-05305d04cf8f" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:51:02 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-63efa62d-b3e7-433a-ae2b-4b1552c89b43 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Lock "cinder-quobyte-f87a6c52-8dca-40e8-b858-05305d04cf8f" acquired by "delete_volume" :: waited 0.015s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:51:02 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a8bd15-4a0c-4fb1-88b5-f3816b8d31d4]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:51:02 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-63efa62d-b3e7-433a-ae2b-4b1552c89b43 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f87a6c52-8dca-40e8-b858-05305d04cf8f {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:02 devstack sudo[104142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f87a6c52-8dca-40e8-b858-05305d04cf8f Sep 18 21:51:02 devstack sudo[104142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:02 devstack sudo[104137]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:02 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-cd06c4af-26d4-4b70-974f-18b4b65a8b74 tempest-VolumeImageDependencyTests-170429094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-30d6bad8-5a3c-4c5f-a6f5-36933fc15561 1073741824" returned: 0 in 0.478s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:02 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-cd06c4af-26d4-4b70-974f-18b4b65a8b74 tempest-VolumeImageDependencyTests-170429094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-30d6bad8-5a3c-4c5f-a6f5-36933fc15561 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:02 devstack sudo[104144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-30d6bad8-5a3c-4c5f-a6f5-36933fc15561 Sep 18 21:51:02 devstack sudo[104144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:02 devstack sudo[104142]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:02 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-63efa62d-b3e7-433a-ae2b-4b1552c89b43 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f87a6c52-8dca-40e8-b858-05305d04cf8f" returned: 0 in 0.397s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:02 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-63efa62d-b3e7-433a-ae2b-4b1552c89b43 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f87a6c52-8dca-40e8-b858-05305d04cf8f {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:02 devstack sudo[104149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f87a6c52-8dca-40e8-b858-05305d04cf8f Sep 18 21:51:02 devstack sudo[104149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:02 devstack sudo[104144]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:02 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-cd06c4af-26d4-4b70-974f-18b4b65a8b74 tempest-VolumeImageDependencyTests-170429094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-30d6bad8-5a3c-4c5f-a6f5-36933fc15561" returned: 0 in 0.284s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:02 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-cd06c4af-26d4-4b70-974f-18b4b65a8b74 tempest-VolumeImageDependencyTests-170429094 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:51:02 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-cd06c4af-26d4-4b70-974f-18b4b65a8b74 tempest-VolumeImageDependencyTests-170429094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:51:02 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-59378519-4dfb-40d9-be90-ac28e7ca2060 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.574s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:51:02 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-59378519-4dfb-40d9-be90-ac28e7ca2060 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:50:56Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=793d24fd-9fe6-40de-bf11-9dd3a780fa98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3233dc5aa3fd4222a6b0d10d85dbee17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:50:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:50:57Z,use_quota=True,user_id='6a41c450d0574b6f9bf4f8396421df9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1bb15fea-cc76-4c57-8b37-bda05eba78ce),volume_type_id=1bb15fea-cc76-4c57-8b37-bda05eba78ce)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:51:02 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-59378519-4dfb-40d9-be90-ac28e7ca2060 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] Creating volume 793d24fd-9fe6-40de-bf11-9dd3a780fa98 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:51:02 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-59378519-4dfb-40d9-be90-ac28e7ca2060 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:51:02 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-59378519-4dfb-40d9-be90-ac28e7ca2060 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:51:02 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-59378519-4dfb-40d9-be90-ac28e7ca2060 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:51:02 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-59378519-4dfb-40d9-be90-ac28e7ca2060 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:51:02 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-59378519-4dfb-40d9-be90-ac28e7ca2060 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:51:02 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-59378519-4dfb-40d9-be90-ac28e7ca2060 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:51:02 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-59378519-4dfb-40d9-be90-ac28e7ca2060 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:51:02 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-59378519-4dfb-40d9-be90-ac28e7ca2060 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-793d24fd-9fe6-40de-bf11-9dd3a780fa98 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:02 devstack sudo[104152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-793d24fd-9fe6-40de-bf11-9dd3a780fa98 1073741824 Sep 18 21:51:02 devstack sudo[104152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:02 devstack cinder-volume[86136]: DEBUG cinder.volume.volume_utils [None req-cd06c4af-26d4-4b70-974f-18b4b65a8b74 tempest-VolumeImageDependencyTests-170429094 None] Attempting download of 90bd439f-c5bb-47c1-807c-97bcf48c5264 ((None, [{'url': 'file:///opt/stack/data/glance/images/90bd439f-c5bb-47c1-807c-97bcf48c5264', 'metadata': {}}])) to volume 30d6bad8-5a3c-4c5f-a6f5-36933fc15561. {{(pid=86136) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 18 21:51:02 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[a364cd70-ff65-4b97-bf03-f2b49151933f]: (4, 'raw') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:51:02 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-cd06c4af-26d4-4b70-974f-18b4b65a8b74 tempest-VolumeImageDependencyTests-170429094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_90bd439f-c5bb-47c1-807c-97bcf48c5264_n_0m2ext {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:02 devstack sudo[104149]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:02 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-63efa62d-b3e7-433a-ae2b-4b1552c89b43 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f87a6c52-8dca-40e8-b858-05305d04cf8f" returned: 0 in 0.279s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:02 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-63efa62d-b3e7-433a-ae2b-4b1552c89b43 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Lock "cinder-quobyte-f87a6c52-8dca-40e8-b858-05305d04cf8f" released by "delete_volume" :: held 0.721s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:51:02 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-63efa62d-b3e7-433a-ae2b-4b1552c89b43 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Created reservations ['e3da0ea2-496b-4110-a482-e16c911c3fbd', 'da824ecd-985b-4adb-9efe-5fdabd7ae3dc', 'ebdde74d-def9-48df-97dd-b3ca2856050e', '535dd659-9103-45b0-9edc-ab04b9443af5'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:51:02 devstack sudo[104155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_90bd439f-c5bb-47c1-807c-97bcf48c5264_n_0m2ext Sep 18 21:51:02 devstack sudo[104155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-63efa62d-b3e7-433a-ae2b-4b1552c89b43 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:51:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-63efa62d-b3e7-433a-ae2b-4b1552c89b43 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:51:03 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-63efa62d-b3e7-433a-ae2b-4b1552c89b43 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:51:03 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-63efa62d-b3e7-433a-ae2b-4b1552c89b43 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:51:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-63efa62d-b3e7-433a-ae2b-4b1552c89b43 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:51:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-63efa62d-b3e7-433a-ae2b-4b1552c89b43 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:03 devstack sudo[104160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:51:03 devstack sudo[104160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:03 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-fbbab6a7-287a-45d1-9225-71fdb9ad15b2 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Acquiring lock "cinder-9e0ea553-c9bf-4472-b7b4-c3d5ed257494-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:51:03 devstack sudo[104155]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:03 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-fbbab6a7-287a-45d1-9225-71fdb9ad15b2 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Lock "cinder-9e0ea553-c9bf-4472-b7b4-c3d5ed257494-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:51:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-cd06c4af-26d4-4b70-974f-18b4b65a8b74 tempest-VolumeImageDependencyTests-170429094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_90bd439f-c5bb-47c1-807c-97bcf48c5264_n_0m2ext" returned: 0 in 0.452s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-cd06c4af-26d4-4b70-974f-18b4b65a8b74 tempest-VolumeImageDependencyTests-170429094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90bd439f-c5bb-47c1-807c-97bcf48c5264_n_0m2ext {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:03 devstack sudo[104152]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-59378519-4dfb-40d9-be90-ac28e7ca2060 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-793d24fd-9fe6-40de-bf11-9dd3a780fa98 1073741824" returned: 0 in 0.602s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:03 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-fbbab6a7-287a-45d1-9225-71fdb9ad15b2 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Acquiring lock "cinder-quobyte-9e0ea553-c9bf-4472-b7b4-c3d5ed257494" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:51:03 devstack sudo[104160]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-63efa62d-b3e7-433a-ae2b-4b1552c89b43 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.341s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:03 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-63efa62d-b3e7-433a-ae2b-4b1552c89b43 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:51:03 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-63efa62d-b3e7-433a-ae2b-4b1552c89b43 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Deleted volume successfully. Sep 18 21:51:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-59378519-4dfb-40d9-be90-ac28e7ca2060 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-793d24fd-9fe6-40de-bf11-9dd3a780fa98 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:03 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-fbbab6a7-287a-45d1-9225-71fdb9ad15b2 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Lock "cinder-quobyte-9e0ea553-c9bf-4472-b7b4-c3d5ed257494" acquired by "delete_volume" :: waited 0.042s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:51:03 devstack sudo[104165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90bd439f-c5bb-47c1-807c-97bcf48c5264_n_0m2ext Sep 18 21:51:03 devstack sudo[104165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:03 devstack sudo[104167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-793d24fd-9fe6-40de-bf11-9dd3a780fa98 Sep 18 21:51:03 devstack sudo[104167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:03 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-63efa62d-b3e7-433a-ae2b-4b1552c89b43 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Lock "cinder-f87a6c52-8dca-40e8-b858-05305d04cf8f-delete_volume" released by "delete_volume" :: held 1.342s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:51:03 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[11af2037-d4db-48bc-8f66-aaf8cfc137c1]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:51:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-fbbab6a7-287a-45d1-9225-71fdb9ad15b2 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9e0ea553-c9bf-4472-b7b4-c3d5ed257494 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:03 devstack sudo[104170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9e0ea553-c9bf-4472-b7b4-c3d5ed257494 Sep 18 21:51:03 devstack sudo[104170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:03 devstack sudo[104167]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-59378519-4dfb-40d9-be90-ac28e7ca2060 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-793d24fd-9fe6-40de-bf11-9dd3a780fa98" returned: 0 in 0.269s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:03 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-59378519-4dfb-40d9-be90-ac28e7ca2060 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:51:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-59378519-4dfb-40d9-be90-ac28e7ca2060 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:51:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-82c562e5-73d8-4f16-930f-be5851b0ce36 tempest-CreateVolumesFromSnapshotTest-248322392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.213s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:51:03 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-82c562e5-73d8-4f16-930f-be5851b0ce36 tempest-CreateVolumesFromSnapshotTest-248322392 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:50:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1373030681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22d7bc9a-e85d-4189-8619-acc71a7c234d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3ae13e6e3ab4f639f5c405f0fcfa3f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:50:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:50:59Z,use_quota=True,user_id='6028ee24d4f84c5da80d946f13c838fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:51:03 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-82c562e5-73d8-4f16-930f-be5851b0ce36 tempest-CreateVolumesFromSnapshotTest-248322392 None] Creating volume 22d7bc9a-e85d-4189-8619-acc71a7c234d {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:51:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-82c562e5-73d8-4f16-930f-be5851b0ce36 tempest-CreateVolumesFromSnapshotTest-248322392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:51:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-82c562e5-73d8-4f16-930f-be5851b0ce36 tempest-CreateVolumesFromSnapshotTest-248322392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:51:03 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-82c562e5-73d8-4f16-930f-be5851b0ce36 tempest-CreateVolumesFromSnapshotTest-248322392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:51:03 devstack sudo[104165]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:03 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-82c562e5-73d8-4f16-930f-be5851b0ce36 tempest-CreateVolumesFromSnapshotTest-248322392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:51:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-82c562e5-73d8-4f16-930f-be5851b0ce36 tempest-CreateVolumesFromSnapshotTest-248322392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:51:03 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-82c562e5-73d8-4f16-930f-be5851b0ce36 tempest-CreateVolumesFromSnapshotTest-248322392 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:51:03 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-82c562e5-73d8-4f16-930f-be5851b0ce36 tempest-CreateVolumesFromSnapshotTest-248322392 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:51:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-82c562e5-73d8-4f16-930f-be5851b0ce36 tempest-CreateVolumesFromSnapshotTest-248322392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-22d7bc9a-e85d-4189-8619-acc71a7c234d 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-cd06c4af-26d4-4b70-974f-18b4b65a8b74 tempest-VolumeImageDependencyTests-170429094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90bd439f-c5bb-47c1-807c-97bcf48c5264_n_0m2ext" returned: 1 in 0.409s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-cd06c4af-26d4-4b70-974f-18b4b65a8b74 tempest-VolumeImageDependencyTests-170429094 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90bd439f-c5bb-47c1-807c-97bcf48c5264_n_0m2ext' failed. Not Retrying. {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 18 21:51:03 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05cb8a0-5fb6-46ef-83d3-f6a165dc76c6]: (4, 'raw') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:51:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-cd06c4af-26d4-4b70-974f-18b4b65a8b74 tempest-VolumeImageDependencyTests-170429094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_90bd439f-c5bb-47c1-807c-97bcf48c5264_k0xecpj6devstack@QuobyteHD {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:03 devstack sudo[104175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-22d7bc9a-e85d-4189-8619-acc71a7c234d 1073741824 Sep 18 21:51:03 devstack sudo[104175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:03 devstack cinder-volume[86136]: DEBUG cinder.volume.volume_utils [None req-59378519-4dfb-40d9-be90-ac28e7ca2060 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] Attempting download of ec3bbfd0-575e-4036-8ed1-bc22b26f2ee2 ((None, [{'url': 'file:///opt/stack/data/glance/images/ec3bbfd0-575e-4036-8ed1-bc22b26f2ee2', 'metadata': {}}])) to volume 793d24fd-9fe6-40de-bf11-9dd3a780fa98. {{(pid=86136) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 18 21:51:03 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[482d315b-bb9d-43e1-bb5d-f8a3582a7758]: (4, 'raw') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:51:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-59378519-4dfb-40d9-be90-ac28e7ca2060 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ec3bbfd0-575e-4036-8ed1-bc22b26f2ee2_7_se3l50 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:03 devstack sudo[104176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_90bd439f-c5bb-47c1-807c-97bcf48c5264_k0xecpj6devstack@QuobyteHD Sep 18 21:51:03 devstack sudo[104176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:03 devstack sudo[104178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ec3bbfd0-575e-4036-8ed1-bc22b26f2ee2_7_se3l50 Sep 18 21:51:03 devstack sudo[104178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:03 devstack sudo[104170]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-fbbab6a7-287a-45d1-9225-71fdb9ad15b2 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9e0ea553-c9bf-4472-b7b4-c3d5ed257494" returned: 0 in 0.485s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-fbbab6a7-287a-45d1-9225-71fdb9ad15b2 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9e0ea553-c9bf-4472-b7b4-c3d5ed257494 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:03 devstack sudo[104186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9e0ea553-c9bf-4472-b7b4-c3d5ed257494 Sep 18 21:51:03 devstack sudo[104186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:04 devstack sudo[104176]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-cd06c4af-26d4-4b70-974f-18b4b65a8b74 tempest-VolumeImageDependencyTests-170429094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_90bd439f-c5bb-47c1-807c-97bcf48c5264_k0xecpj6devstack@QuobyteHD" returned: 0 in 0.409s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-cd06c4af-26d4-4b70-974f-18b4b65a8b74 tempest-VolumeImageDependencyTests-170429094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_90bd439f-c5bb-47c1-807c-97bcf48c5264_k0xecpj6devstack@QuobyteHD {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:04 devstack sudo[104175]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-82c562e5-73d8-4f16-930f-be5851b0ce36 tempest-CreateVolumesFromSnapshotTest-248322392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-22d7bc9a-e85d-4189-8619-acc71a7c234d 1073741824" returned: 0 in 0.542s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:04 devstack sudo[104191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_90bd439f-c5bb-47c1-807c-97bcf48c5264_k0xecpj6devstack@QuobyteHD Sep 18 21:51:04 devstack sudo[104191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:04 devstack sudo[104186]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:04 devstack sudo[104178]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-fbbab6a7-287a-45d1-9225-71fdb9ad15b2 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9e0ea553-c9bf-4472-b7b4-c3d5ed257494" returned: 0 in 0.323s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-59378519-4dfb-40d9-be90-ac28e7ca2060 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ec3bbfd0-575e-4036-8ed1-bc22b26f2ee2_7_se3l50" returned: 0 in 0.471s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-59378519-4dfb-40d9-be90-ac28e7ca2060 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ec3bbfd0-575e-4036-8ed1-bc22b26f2ee2_7_se3l50 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:04 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-fbbab6a7-287a-45d1-9225-71fdb9ad15b2 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Lock "cinder-quobyte-9e0ea553-c9bf-4472-b7b4-c3d5ed257494" released by "delete_volume" :: held 0.893s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:51:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-82c562e5-73d8-4f16-930f-be5851b0ce36 tempest-CreateVolumesFromSnapshotTest-248322392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-22d7bc9a-e85d-4189-8619-acc71a7c234d {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:04 devstack sudo[104197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-22d7bc9a-e85d-4189-8619-acc71a7c234d Sep 18 21:51:04 devstack sudo[104197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:04 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-fbbab6a7-287a-45d1-9225-71fdb9ad15b2 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Created reservations ['2c197c3c-b9c0-4720-ae44-54ebb0982a7b', 'e42cf62e-ba03-447a-830c-451224a0d11a', '397d9fbb-2a6a-4f06-aa7b-e1d2b7ec0f58', 'bfa717ab-2e37-45f8-ba18-11908e29c180'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:51:04 devstack sudo[104196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ec3bbfd0-575e-4036-8ed1-bc22b26f2ee2_7_se3l50 Sep 18 21:51:04 devstack sudo[104196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-fbbab6a7-287a-45d1-9225-71fdb9ad15b2 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:51:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-fbbab6a7-287a-45d1-9225-71fdb9ad15b2 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:51:04 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-fbbab6a7-287a-45d1-9225-71fdb9ad15b2 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:51:04 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-fbbab6a7-287a-45d1-9225-71fdb9ad15b2 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:51:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-fbbab6a7-287a-45d1-9225-71fdb9ad15b2 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:51:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-fbbab6a7-287a-45d1-9225-71fdb9ad15b2 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:04 devstack sudo[104191]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-cd06c4af-26d4-4b70-974f-18b4b65a8b74 tempest-VolumeImageDependencyTests-170429094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_90bd439f-c5bb-47c1-807c-97bcf48c5264_k0xecpj6devstack@QuobyteHD" returned: 1 in 0.398s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-cd06c4af-26d4-4b70-974f-18b4b65a8b74 tempest-VolumeImageDependencyTests-170429094 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_90bd439f-c5bb-47c1-807c-97bcf48c5264_k0xecpj6devstack@QuobyteHD' failed. Not Retrying. {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 18 21:51:04 devstack sudo[104203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:51:04 devstack sudo[104203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:04 devstack cinder-volume[86136]: DEBUG cinder.image.image_utils [None req-cd06c4af-26d4-4b70-974f-18b4b65a8b74 tempest-VolumeImageDependencyTests-170429094 None] 90bd439f-c5bb-47c1-807c-97bcf48c5264 was raw, converting to qcow2 {{(pid=86136) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 18 21:51:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-cd06c4af-26d4-4b70-974f-18b4b65a8b74 tempest-VolumeImageDependencyTests-170429094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_90bd439f-c5bb-47c1-807c-97bcf48c5264_k0xecpj6devstack@QuobyteHD /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-30d6bad8-5a3c-4c5f-a6f5-36933fc15561 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:04 devstack sudo[104205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_90bd439f-c5bb-47c1-807c-97bcf48c5264_k0xecpj6devstack@QuobyteHD /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-30d6bad8-5a3c-4c5f-a6f5-36933fc15561 Sep 18 21:51:04 devstack sudo[104205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:04 devstack sudo[104197]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-82c562e5-73d8-4f16-930f-be5851b0ce36 tempest-CreateVolumesFromSnapshotTest-248322392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-22d7bc9a-e85d-4189-8619-acc71a7c234d" returned: 0 in 0.300s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:04 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-82c562e5-73d8-4f16-930f-be5851b0ce36 tempest-CreateVolumesFromSnapshotTest-248322392 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:51:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-82c562e5-73d8-4f16-930f-be5851b0ce36 tempest-CreateVolumesFromSnapshotTest-248322392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:51:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-14849862-a167-47ee-b1ed-ee7a587574f9 tempest-CreateVolumesFromSnapshotTest-248322392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.776s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:51:04 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-14849862-a167-47ee-b1ed-ee7a587574f9 tempest-CreateVolumesFromSnapshotTest-248322392 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:50:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1842491020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d406132-402e-43b4-b31f-35e30f09a004,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3ae13e6e3ab4f639f5c405f0fcfa3f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:51:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:51:00Z,use_quota=True,user_id='6028ee24d4f84c5da80d946f13c838fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:51:04 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-14849862-a167-47ee-b1ed-ee7a587574f9 tempest-CreateVolumesFromSnapshotTest-248322392 None] Creating volume 6d406132-402e-43b4-b31f-35e30f09a004 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:51:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-14849862-a167-47ee-b1ed-ee7a587574f9 tempest-CreateVolumesFromSnapshotTest-248322392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:51:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-14849862-a167-47ee-b1ed-ee7a587574f9 tempest-CreateVolumesFromSnapshotTest-248322392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:51:04 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-14849862-a167-47ee-b1ed-ee7a587574f9 tempest-CreateVolumesFromSnapshotTest-248322392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:51:04 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-14849862-a167-47ee-b1ed-ee7a587574f9 tempest-CreateVolumesFromSnapshotTest-248322392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:51:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-14849862-a167-47ee-b1ed-ee7a587574f9 tempest-CreateVolumesFromSnapshotTest-248322392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:51:04 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-14849862-a167-47ee-b1ed-ee7a587574f9 tempest-CreateVolumesFromSnapshotTest-248322392 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:51:04 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-14849862-a167-47ee-b1ed-ee7a587574f9 tempest-CreateVolumesFromSnapshotTest-248322392 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:51:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-14849862-a167-47ee-b1ed-ee7a587574f9 tempest-CreateVolumesFromSnapshotTest-248322392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-6d406132-402e-43b4-b31f-35e30f09a004 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:04 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-82c562e5-73d8-4f16-930f-be5851b0ce36 tempest-CreateVolumesFromSnapshotTest-248322392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e92544eb-07e1-4d2d-a4b5-c2691c574f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22d7bc9a-e85d-4189-8619-acc71a7c234d', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:04 devstack sudo[104208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-6d406132-402e-43b4-b31f-35e30f09a004 1073741824 Sep 18 21:51:04 devstack sudo[104208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:04 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-82c562e5-73d8-4f16-930f-be5851b0ce36 tempest-CreateVolumesFromSnapshotTest-248322392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcfdc619-72cc-471b-9f11-2707cd163fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:04 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-82c562e5-73d8-4f16-930f-be5851b0ce36 tempest-CreateVolumesFromSnapshotTest-248322392 None] Volume volume-22d7bc9a-e85d-4189-8619-acc71a7c234d (22d7bc9a-e85d-4189-8619-acc71a7c234d): created successfully Sep 18 21:51:04 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-82c562e5-73d8-4f16-930f-be5851b0ce36 tempest-CreateVolumesFromSnapshotTest-248322392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcfdc619-72cc-471b-9f11-2707cd163fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:04 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-82c562e5-73d8-4f16-930f-be5851b0ce36 tempest-CreateVolumesFromSnapshotTest-248322392 None] Flow 'volume_create_manager' (eb9b14df-f4bf-4126-8cb0-6e33e3102114) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:51:04 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-82c562e5-73d8-4f16-930f-be5851b0ce36 tempest-CreateVolumesFromSnapshotTest-248322392 None] Created volume successfully. Sep 18 21:51:04 devstack sudo[104196]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-59378519-4dfb-40d9-be90-ac28e7ca2060 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ec3bbfd0-575e-4036-8ed1-bc22b26f2ee2_7_se3l50" returned: 1 in 0.459s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-59378519-4dfb-40d9-be90-ac28e7ca2060 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ec3bbfd0-575e-4036-8ed1-bc22b26f2ee2_7_se3l50' failed. Not Retrying. {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 18 21:51:04 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bad03a6-0e7e-4528-98f8-6e0265cb2fe8]: (4, 'raw') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:51:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-59378519-4dfb-40d9-be90-ac28e7ca2060 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ec3bbfd0-575e-4036-8ed1-bc22b26f2ee2_b6vndzkfdevstack@QuobyteHD {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:04 devstack sudo[104203]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-fbbab6a7-287a-45d1-9225-71fdb9ad15b2 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.284s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:04 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-fbbab6a7-287a-45d1-9225-71fdb9ad15b2 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:51:04 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-fbbab6a7-287a-45d1-9225-71fdb9ad15b2 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Deleted volume successfully. Sep 18 21:51:04 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-fbbab6a7-287a-45d1-9225-71fdb9ad15b2 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Lock "cinder-9e0ea553-c9bf-4472-b7b4-c3d5ed257494-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:51:04 devstack sudo[104213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ec3bbfd0-575e-4036-8ed1-bc22b26f2ee2_b6vndzkfdevstack@QuobyteHD Sep 18 21:51:04 devstack sudo[104213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:05 devstack sudo[104205]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-cd06c4af-26d4-4b70-974f-18b4b65a8b74 tempest-VolumeImageDependencyTests-170429094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_90bd439f-c5bb-47c1-807c-97bcf48c5264_k0xecpj6devstack@QuobyteHD /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-30d6bad8-5a3c-4c5f-a6f5-36933fc15561" returned: 0 in 0.515s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:05 devstack cinder-volume[86136]: DEBUG cinder.image.image_utils [None req-cd06c4af-26d4-4b70-974f-18b4b65a8b74 tempest-VolumeImageDependencyTests-170429094 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_90bd439f-c5bb-47c1-807c-97bcf48c5264_k0xecpj6devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-30d6bad8-5a3c-4c5f-a6f5-36933fc15561 {{(pid=86136) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 18 21:51:05 devstack cinder-volume[86136]: INFO cinder.image.image_utils [None req-cd06c4af-26d4-4b70-974f-18b4b65a8b74 tempest-VolumeImageDependencyTests-170429094 None] Converted 0.00 MB image at 0.00 MB/s Sep 18 21:51:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-cd06c4af-26d4-4b70-974f-18b4b65a8b74 tempest-VolumeImageDependencyTests-170429094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-30d6bad8-5a3c-4c5f-a6f5-36933fc15561 1G {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:05 devstack sudo[104223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-30d6bad8-5a3c-4c5f-a6f5-36933fc15561 1G Sep 18 21:51:05 devstack sudo[104223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:05 devstack sudo[104213]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-59378519-4dfb-40d9-be90-ac28e7ca2060 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ec3bbfd0-575e-4036-8ed1-bc22b26f2ee2_b6vndzkfdevstack@QuobyteHD" returned: 0 in 0.418s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-59378519-4dfb-40d9-be90-ac28e7ca2060 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec3bbfd0-575e-4036-8ed1-bc22b26f2ee2_b6vndzkfdevstack@QuobyteHD {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:05 devstack cinder-volume[86136]: DEBUG oslo_service.periodic_task [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86136) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 21:51:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:51:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:51:05 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:51:05 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:51:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:51:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:05 devstack sudo[104228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:51:05 devstack sudo[104228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:05 devstack sudo[104208]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:05 devstack sudo[104227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec3bbfd0-575e-4036-8ed1-bc22b26f2ee2_b6vndzkfdevstack@QuobyteHD Sep 18 21:51:05 devstack sudo[104227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-14849862-a167-47ee-b1ed-ee7a587574f9 tempest-CreateVolumesFromSnapshotTest-248322392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-6d406132-402e-43b4-b31f-35e30f09a004 1073741824" returned: 0 in 0.699s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-14849862-a167-47ee-b1ed-ee7a587574f9 tempest-CreateVolumesFromSnapshotTest-248322392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-6d406132-402e-43b4-b31f-35e30f09a004 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:05 devstack sudo[104223]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:05 devstack sudo[104235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-6d406132-402e-43b4-b31f-35e30f09a004 Sep 18 21:51:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-cd06c4af-26d4-4b70-974f-18b4b65a8b74 tempest-VolumeImageDependencyTests-170429094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-30d6bad8-5a3c-4c5f-a6f5-36933fc15561 1G" returned: 0 in 0.405s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:05 devstack cinder-volume[86136]: DEBUG cinder.volume.volume_utils [None req-cd06c4af-26d4-4b70-974f-18b4b65a8b74 tempest-VolumeImageDependencyTests-170429094 None] Downloaded image 90bd439f-c5bb-47c1-807c-97bcf48c5264 ((None, [{'url': 'file:///opt/stack/data/glance/images/90bd439f-c5bb-47c1-807c-97bcf48c5264', 'metadata': {}}])) to volume 30d6bad8-5a3c-4c5f-a6f5-36933fc15561 successfully. {{(pid=86136) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 18 21:51:05 devstack cinder-volume[86136]: DEBUG cinder.image.image_utils [None req-cd06c4af-26d4-4b70-974f-18b4b65a8b74 tempest-VolumeImageDependencyTests-170429094 None] Temporary image 90bd439f-c5bb-47c1-807c-97bcf48c5264 for user dca3d6218d674bb09caf9b4d162a1e84 is deleted. {{(pid=86136) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 18 21:51:05 devstack sudo[104235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:05 devstack cinder-volume[86136]: DEBUG cinder.volume.volume_utils [None req-cd06c4af-26d4-4b70-974f-18b4b65a8b74 tempest-VolumeImageDependencyTests-170429094 None] Marking volume 30d6bad8-5a3c-4c5f-a6f5-36933fc15561 as bootable. {{(pid=86136) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 18 21:51:05 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd06c4af-26d4-4b70-974f-18b4b65a8b74 tempest-VolumeImageDependencyTests-170429094 None] Copying metadata from image 90bd439f-c5bb-47c1-807c-97bcf48c5264 to 30d6bad8-5a3c-4c5f-a6f5-36933fc15561. {{(pid=86136) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 18 21:51:05 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd06c4af-26d4-4b70-974f-18b4b65a8b74 tempest-VolumeImageDependencyTests-170429094 None] Creating volume glance metadata for volume 30d6bad8-5a3c-4c5f-a6f5-36933fc15561 backed by image 90bd439f-c5bb-47c1-807c-97bcf48c5264 with: {'image_id': '90bd439f-c5bb-47c1-807c-97bcf48c5264', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '8bb3399e85794016ce491a6a5f7e817e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86136) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 18 21:51:05 devstack sudo[104227]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:05 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-fbbc7b6c-5e77-483b-be29-ec5e87eee883 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Acquiring lock "cinder-9f1c92c1-4aa5-4cea-aff6-2d10673b33e4-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:51:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-59378519-4dfb-40d9-be90-ac28e7ca2060 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec3bbfd0-575e-4036-8ed1-bc22b26f2ee2_b6vndzkfdevstack@QuobyteHD" returned: 1 in 0.434s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-59378519-4dfb-40d9-be90-ac28e7ca2060 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec3bbfd0-575e-4036-8ed1-bc22b26f2ee2_b6vndzkfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 18 21:51:05 devstack cinder-volume[86136]: DEBUG cinder.image.image_utils [None req-59378519-4dfb-40d9-be90-ac28e7ca2060 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] ec3bbfd0-575e-4036-8ed1-bc22b26f2ee2 was raw, converting to qcow2 {{(pid=86136) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 18 21:51:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-59378519-4dfb-40d9-be90-ac28e7ca2060 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ec3bbfd0-575e-4036-8ed1-bc22b26f2ee2_b6vndzkfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-793d24fd-9fe6-40de-bf11-9dd3a780fa98 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:05 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-fbbc7b6c-5e77-483b-be29-ec5e87eee883 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Lock "cinder-9f1c92c1-4aa5-4cea-aff6-2d10673b33e4-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:51:05 devstack sudo[104240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ec3bbfd0-575e-4036-8ed1-bc22b26f2ee2_b6vndzkfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-793d24fd-9fe6-40de-bf11-9dd3a780fa98 Sep 18 21:51:05 devstack sudo[104240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:05 devstack sudo[104228]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.435s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:05 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:51:05 devstack cinder-volume[86136]: DEBUG oslo_service.periodic_task [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Running periodic task VolumeManager._thread_info {{(pid=86136) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 21:51:05 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] thread count: 28 {{(pid=86136) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 18 21:51:05 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] thread info: [<_MainThread(MainThread, started 138548347871360)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86136) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 18 21:51:05 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-cd06c4af-26d4-4b70-974f-18b4b65a8b74 tempest-VolumeImageDependencyTests-170429094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d635f62-7b12-4232-90fa-72e4994d8dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30d6bad8-5a3c-4c5f-a6f5-36933fc15561', 'volume_size': 1, 'image_id': '90bd439f-c5bb-47c1-807c-97bcf48c5264', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/90bd439f-c5bb-47c1-807c-97bcf48c5264', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8bb3399e85794016ce491a6a5f7e817e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '142de6b26dc64ac0ab9d852fb9de9772', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '097a45c75b9ce905d1a57adc3556d4edcef15870c0e30d701ccaa9b1b4ecdd130adf2bb121621ed79f00eca95c486bf09b4b4913d087aa1e6a601a895cb90258', 'id': '90bd439f-c5bb-47c1-807c-97bcf48c5264', 'created_at': datetime.datetime(2026, 9, 18, 19, 50, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 18, 19, 50, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/90bd439f-c5bb-47c1-807c-97bcf48c5264/file', 'properties': {}}, 'image_service': }' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:05 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-cd06c4af-26d4-4b70-974f-18b4b65a8b74 tempest-VolumeImageDependencyTests-170429094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6c8e202-6bc5-4499-85d9-857d76652256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:05 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-fbbc7b6c-5e77-483b-be29-ec5e87eee883 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Acquiring lock "cinder-quobyte-9f1c92c1-4aa5-4cea-aff6-2d10673b33e4" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:51:05 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-cd06c4af-26d4-4b70-974f-18b4b65a8b74 tempest-VolumeImageDependencyTests-170429094 None] Volume volume-30d6bad8-5a3c-4c5f-a6f5-36933fc15561 (30d6bad8-5a3c-4c5f-a6f5-36933fc15561): created successfully Sep 18 21:51:05 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-cd06c4af-26d4-4b70-974f-18b4b65a8b74 tempest-VolumeImageDependencyTests-170429094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6c8e202-6bc5-4499-85d9-857d76652256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:05 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-cd06c4af-26d4-4b70-974f-18b4b65a8b74 tempest-VolumeImageDependencyTests-170429094 None] Flow 'volume_create_manager' (bee9f734-e267-4fa6-b59c-37c5cc2a7956) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:51:05 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-fbbc7b6c-5e77-483b-be29-ec5e87eee883 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Lock "cinder-quobyte-9f1c92c1-4aa5-4cea-aff6-2d10673b33e4" acquired by "delete_volume" :: waited 0.031s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:51:05 devstack sudo[104235]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-14849862-a167-47ee-b1ed-ee7a587574f9 tempest-CreateVolumesFromSnapshotTest-248322392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-6d406132-402e-43b4-b31f-35e30f09a004" returned: 0 in 0.353s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:05 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-14849862-a167-47ee-b1ed-ee7a587574f9 tempest-CreateVolumesFromSnapshotTest-248322392 None] <== create_volume: return (1140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:51:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-14849862-a167-47ee-b1ed-ee7a587574f9 tempest-CreateVolumesFromSnapshotTest-248322392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.143s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:51:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-5a19e3be-0ba3-4e79-8542-208efb8a51e4 tempest-CreateVolumesFromSnapshotTest-248322392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.505s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:51:05 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-5a19e3be-0ba3-4e79-8542-208efb8a51e4 tempest-CreateVolumesFromSnapshotTest-248322392 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:51:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-757538253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55af36c4-fb5a-4740-8232-9e1653b1f710,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3ae13e6e3ab4f639f5c405f0fcfa3f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:51:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:51:00Z,use_quota=True,user_id='6028ee24d4f84c5da80d946f13c838fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:51:05 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-5a19e3be-0ba3-4e79-8542-208efb8a51e4 tempest-CreateVolumesFromSnapshotTest-248322392 None] Creating volume 55af36c4-fb5a-4740-8232-9e1653b1f710 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:51:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-5a19e3be-0ba3-4e79-8542-208efb8a51e4 tempest-CreateVolumesFromSnapshotTest-248322392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:51:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-5a19e3be-0ba3-4e79-8542-208efb8a51e4 tempest-CreateVolumesFromSnapshotTest-248322392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:51:05 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-5a19e3be-0ba3-4e79-8542-208efb8a51e4 tempest-CreateVolumesFromSnapshotTest-248322392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:51:05 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-5a19e3be-0ba3-4e79-8542-208efb8a51e4 tempest-CreateVolumesFromSnapshotTest-248322392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:51:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-5a19e3be-0ba3-4e79-8542-208efb8a51e4 tempest-CreateVolumesFromSnapshotTest-248322392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:51:05 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-5a19e3be-0ba3-4e79-8542-208efb8a51e4 tempest-CreateVolumesFromSnapshotTest-248322392 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:51:05 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-5a19e3be-0ba3-4e79-8542-208efb8a51e4 tempest-CreateVolumesFromSnapshotTest-248322392 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:51:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5a19e3be-0ba3-4e79-8542-208efb8a51e4 tempest-CreateVolumesFromSnapshotTest-248322392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-55af36c4-fb5a-4740-8232-9e1653b1f710 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:05 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbcdc61f-5a86-410c-9528-840ff9a3944c]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:51:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-fbbc7b6c-5e77-483b-be29-ec5e87eee883 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9f1c92c1-4aa5-4cea-aff6-2d10673b33e4 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:05 devstack sudo[104244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-55af36c4-fb5a-4740-8232-9e1653b1f710 1073741824 Sep 18 21:51:05 devstack sudo[104244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:05 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-cd06c4af-26d4-4b70-974f-18b4b65a8b74 tempest-VolumeImageDependencyTests-170429094 None] Created volume successfully. Sep 18 21:51:05 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-14849862-a167-47ee-b1ed-ee7a587574f9 tempest-CreateVolumesFromSnapshotTest-248322392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (395b61dc-5014-40d5-884c-650f573956df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d406132-402e-43b4-b31f-35e30f09a004', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:05 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-14849862-a167-47ee-b1ed-ee7a587574f9 tempest-CreateVolumesFromSnapshotTest-248322392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad9722e0-8c9d-4e20-90bf-38b66eb394d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:05 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-14849862-a167-47ee-b1ed-ee7a587574f9 tempest-CreateVolumesFromSnapshotTest-248322392 None] Volume volume-6d406132-402e-43b4-b31f-35e30f09a004 (6d406132-402e-43b4-b31f-35e30f09a004): created successfully Sep 18 21:51:05 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-14849862-a167-47ee-b1ed-ee7a587574f9 tempest-CreateVolumesFromSnapshotTest-248322392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad9722e0-8c9d-4e20-90bf-38b66eb394d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:05 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-14849862-a167-47ee-b1ed-ee7a587574f9 tempest-CreateVolumesFromSnapshotTest-248322392 None] Flow 'volume_create_manager' (09b676b5-2105-4a3b-8639-a27818a9b611) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:51:05 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-14849862-a167-47ee-b1ed-ee7a587574f9 tempest-CreateVolumesFromSnapshotTest-248322392 None] Created volume successfully. Sep 18 21:51:05 devstack sudo[104245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9f1c92c1-4aa5-4cea-aff6-2d10673b33e4 Sep 18 21:51:05 devstack sudo[104245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:06 devstack sudo[104240]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:06 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-59378519-4dfb-40d9-be90-ac28e7ca2060 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ec3bbfd0-575e-4036-8ed1-bc22b26f2ee2_b6vndzkfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-793d24fd-9fe6-40de-bf11-9dd3a780fa98" returned: 0 in 0.547s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:06 devstack cinder-volume[86136]: DEBUG cinder.image.image_utils [None req-59378519-4dfb-40d9-be90-ac28e7ca2060 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ec3bbfd0-575e-4036-8ed1-bc22b26f2ee2_b6vndzkfdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-793d24fd-9fe6-40de-bf11-9dd3a780fa98 {{(pid=86136) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 18 21:51:06 devstack cinder-volume[86136]: INFO cinder.image.image_utils [None req-59378519-4dfb-40d9-be90-ac28e7ca2060 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] Converted 0.00 MB image at 0.00 MB/s Sep 18 21:51:06 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-59378519-4dfb-40d9-be90-ac28e7ca2060 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-793d24fd-9fe6-40de-bf11-9dd3a780fa98 1G {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:06 devstack sudo[104255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-793d24fd-9fe6-40de-bf11-9dd3a780fa98 1G Sep 18 21:51:06 devstack sudo[104255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:06 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-8dcee77e-fbf0-4b9f-a8f2-244cb93d98a8 tempest-VolumeImageDependencyTests-170429094 None] Acquiring lock "cinder-30d6bad8-5a3c-4c5f-a6f5-36933fc15561-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:51:06 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-8dcee77e-fbf0-4b9f-a8f2-244cb93d98a8 tempest-VolumeImageDependencyTests-170429094 None] Lock "cinder-30d6bad8-5a3c-4c5f-a6f5-36933fc15561-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:51:06 devstack sudo[104245]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:06 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-fbbc7b6c-5e77-483b-be29-ec5e87eee883 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9f1c92c1-4aa5-4cea-aff6-2d10673b33e4" returned: 0 in 0.513s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:06 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-fbbc7b6c-5e77-483b-be29-ec5e87eee883 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9f1c92c1-4aa5-4cea-aff6-2d10673b33e4 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:06 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-8dcee77e-fbf0-4b9f-a8f2-244cb93d98a8 tempest-VolumeImageDependencyTests-170429094 None] Acquiring lock "cinder-quobyte-30d6bad8-5a3c-4c5f-a6f5-36933fc15561" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:51:06 devstack sudo[104261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9f1c92c1-4aa5-4cea-aff6-2d10673b33e4 Sep 18 21:51:06 devstack sudo[104261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:06 devstack sudo[104244]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:06 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-8dcee77e-fbf0-4b9f-a8f2-244cb93d98a8 tempest-VolumeImageDependencyTests-170429094 None] Lock "cinder-quobyte-30d6bad8-5a3c-4c5f-a6f5-36933fc15561" acquired by "delete_volume" :: waited 0.033s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:51:06 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5a19e3be-0ba3-4e79-8542-208efb8a51e4 tempest-CreateVolumesFromSnapshotTest-248322392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-55af36c4-fb5a-4740-8232-9e1653b1f710 1073741824" returned: 0 in 0.628s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:06 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9e944d-d957-4cc2-aea4-b12f4816a38a]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:51:06 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-8dcee77e-fbf0-4b9f-a8f2-244cb93d98a8 tempest-VolumeImageDependencyTests-170429094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-30d6bad8-5a3c-4c5f-a6f5-36933fc15561 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:06 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5a19e3be-0ba3-4e79-8542-208efb8a51e4 tempest-CreateVolumesFromSnapshotTest-248322392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-55af36c4-fb5a-4740-8232-9e1653b1f710 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:06 devstack sudo[104268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-55af36c4-fb5a-4740-8232-9e1653b1f710 Sep 18 21:51:06 devstack sudo[104268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:06 devstack sudo[104265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-30d6bad8-5a3c-4c5f-a6f5-36933fc15561 Sep 18 21:51:06 devstack sudo[104265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:06 devstack sudo[104255]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:06 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-59378519-4dfb-40d9-be90-ac28e7ca2060 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-793d24fd-9fe6-40de-bf11-9dd3a780fa98 1G" returned: 0 in 0.442s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:06 devstack cinder-volume[86136]: DEBUG cinder.volume.volume_utils [None req-59378519-4dfb-40d9-be90-ac28e7ca2060 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] Downloaded image ec3bbfd0-575e-4036-8ed1-bc22b26f2ee2 ((None, [{'url': 'file:///opt/stack/data/glance/images/ec3bbfd0-575e-4036-8ed1-bc22b26f2ee2', 'metadata': {}}])) to volume 793d24fd-9fe6-40de-bf11-9dd3a780fa98 successfully. {{(pid=86136) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 18 21:51:06 devstack cinder-volume[86136]: DEBUG cinder.image.image_utils [None req-59378519-4dfb-40d9-be90-ac28e7ca2060 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] Temporary image ec3bbfd0-575e-4036-8ed1-bc22b26f2ee2 for user 6a41c450d0574b6f9bf4f8396421df9d is deleted. {{(pid=86136) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 18 21:51:06 devstack cinder-volume[86136]: DEBUG cinder.volume.volume_utils [None req-59378519-4dfb-40d9-be90-ac28e7ca2060 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] Marking volume 793d24fd-9fe6-40de-bf11-9dd3a780fa98 as bootable. {{(pid=86136) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 18 21:51:06 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-59378519-4dfb-40d9-be90-ac28e7ca2060 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] Copying metadata from image ec3bbfd0-575e-4036-8ed1-bc22b26f2ee2 to 793d24fd-9fe6-40de-bf11-9dd3a780fa98. {{(pid=86136) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 18 21:51:06 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-59378519-4dfb-40d9-be90-ac28e7ca2060 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] Creating volume glance metadata for volume 793d24fd-9fe6-40de-bf11-9dd3a780fa98 backed by image ec3bbfd0-575e-4036-8ed1-bc22b26f2ee2 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'ec3bbfd0-575e-4036-8ed1-bc22b26f2ee2', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'a261b7a52952d0fd6f29373165236cd5', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86136) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 18 21:51:06 devstack sudo[104261]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:06 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-fbbc7b6c-5e77-483b-be29-ec5e87eee883 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9f1c92c1-4aa5-4cea-aff6-2d10673b33e4" returned: 0 in 0.398s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:06 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-fbbc7b6c-5e77-483b-be29-ec5e87eee883 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Lock "cinder-quobyte-9f1c92c1-4aa5-4cea-aff6-2d10673b33e4" released by "delete_volume" :: held 0.994s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:51:06 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-59378519-4dfb-40d9-be90-ac28e7ca2060 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4976387c-c3d4-4410-a298-ecbdc98939a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-793d24fd-9fe6-40de-bf11-9dd3a780fa98', 'volume_size': 1, 'image_id': 'ec3bbfd0-575e-4036-8ed1-bc22b26f2ee2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ec3bbfd0-575e-4036-8ed1-bc22b26f2ee2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a261b7a52952d0fd6f29373165236cd5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3233dc5aa3fd4222a6b0d10d85dbee17', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fb5a2da96b578c37755ff0cb14dba8f03a2634642dfcabb81e732540d264d5ca9dc934cf7de4a9b1d04505ee085622fb9d7c94bec0abe286017f56f0cad2983c', 'id': 'ec3bbfd0-575e-4036-8ed1-bc22b26f2ee2', 'created_at': datetime.datetime(2026, 9, 18, 19, 50, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 18, 19, 50, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ec3bbfd0-575e-4036-8ed1-bc22b26f2ee2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:06 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-59378519-4dfb-40d9-be90-ac28e7ca2060 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2065782-977c-4b7f-928f-8a17b83f4e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:06 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-59378519-4dfb-40d9-be90-ac28e7ca2060 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] Volume volume-793d24fd-9fe6-40de-bf11-9dd3a780fa98 (793d24fd-9fe6-40de-bf11-9dd3a780fa98): created successfully Sep 18 21:51:06 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-59378519-4dfb-40d9-be90-ac28e7ca2060 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2065782-977c-4b7f-928f-8a17b83f4e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:06 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-59378519-4dfb-40d9-be90-ac28e7ca2060 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] Flow 'volume_create_manager' (880a7fc1-a2ef-4800-b36d-5eef7d576079) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:51:06 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-59378519-4dfb-40d9-be90-ac28e7ca2060 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] Created volume successfully. Sep 18 21:51:06 devstack sudo[104268]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:06 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5a19e3be-0ba3-4e79-8542-208efb8a51e4 tempest-CreateVolumesFromSnapshotTest-248322392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-55af36c4-fb5a-4740-8232-9e1653b1f710" returned: 0 in 0.333s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:06 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-5a19e3be-0ba3-4e79-8542-208efb8a51e4 tempest-CreateVolumesFromSnapshotTest-248322392 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:51:06 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-5a19e3be-0ba3-4e79-8542-208efb8a51e4 tempest-CreateVolumesFromSnapshotTest-248322392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:51:06 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-1a65dd1e-8d9d-47ee-891a-b71763d2e9e8 tempest-CreateVolumesFromSnapshotTest-248322392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.164s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:51:06 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-1a65dd1e-8d9d-47ee-891a-b71763d2e9e8 tempest-CreateVolumesFromSnapshotTest-248322392 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:51:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-938203535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d3e2b83-f76d-4361-9f34-d0c1a7f160c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3ae13e6e3ab4f639f5c405f0fcfa3f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:51:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:51:00Z,use_quota=True,user_id='6028ee24d4f84c5da80d946f13c838fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:51:06 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-1a65dd1e-8d9d-47ee-891a-b71763d2e9e8 tempest-CreateVolumesFromSnapshotTest-248322392 None] Creating volume 6d3e2b83-f76d-4361-9f34-d0c1a7f160c7 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:51:06 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-1a65dd1e-8d9d-47ee-891a-b71763d2e9e8 tempest-CreateVolumesFromSnapshotTest-248322392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:51:06 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-1a65dd1e-8d9d-47ee-891a-b71763d2e9e8 tempest-CreateVolumesFromSnapshotTest-248322392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:51:06 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-1a65dd1e-8d9d-47ee-891a-b71763d2e9e8 tempest-CreateVolumesFromSnapshotTest-248322392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:51:06 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-1a65dd1e-8d9d-47ee-891a-b71763d2e9e8 tempest-CreateVolumesFromSnapshotTest-248322392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:51:06 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-1a65dd1e-8d9d-47ee-891a-b71763d2e9e8 tempest-CreateVolumesFromSnapshotTest-248322392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:51:06 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-1a65dd1e-8d9d-47ee-891a-b71763d2e9e8 tempest-CreateVolumesFromSnapshotTest-248322392 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:51:06 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-1a65dd1e-8d9d-47ee-891a-b71763d2e9e8 tempest-CreateVolumesFromSnapshotTest-248322392 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:51:06 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1a65dd1e-8d9d-47ee-891a-b71763d2e9e8 tempest-CreateVolumesFromSnapshotTest-248322392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-6d3e2b83-f76d-4361-9f34-d0c1a7f160c7 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:06 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-fbbc7b6c-5e77-483b-be29-ec5e87eee883 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Created reservations ['0e165cff-f982-42da-bd1b-cfc13de0d918', '2e0addff-f775-43bc-8128-2583fcafee44', '73af06d0-5ed6-4e8d-8704-f05605a99ec6', '89b8f8d1-9f07-42fa-a3f1-744212cbd2c8'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:51:06 devstack sudo[104265]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:06 devstack sudo[104276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-6d3e2b83-f76d-4361-9f34-d0c1a7f160c7 1073741824 Sep 18 21:51:06 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-8dcee77e-fbf0-4b9f-a8f2-244cb93d98a8 tempest-VolumeImageDependencyTests-170429094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-30d6bad8-5a3c-4c5f-a6f5-36933fc15561" returned: 0 in 0.438s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:06 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-8dcee77e-fbf0-4b9f-a8f2-244cb93d98a8 tempest-VolumeImageDependencyTests-170429094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-30d6bad8-5a3c-4c5f-a6f5-36933fc15561 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:06 devstack sudo[104276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:06 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-5a19e3be-0ba3-4e79-8542-208efb8a51e4 tempest-CreateVolumesFromSnapshotTest-248322392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46e7adda-1acc-4811-a8e5-4186bef21c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55af36c4-fb5a-4740-8232-9e1653b1f710', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:06 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-5a19e3be-0ba3-4e79-8542-208efb8a51e4 tempest-CreateVolumesFromSnapshotTest-248322392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a3f0e8b-d18f-48cb-8cd2-5316e9889601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:06 devstack sudo[104278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-30d6bad8-5a3c-4c5f-a6f5-36933fc15561 Sep 18 21:51:06 devstack sudo[104278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:06 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-5a19e3be-0ba3-4e79-8542-208efb8a51e4 tempest-CreateVolumesFromSnapshotTest-248322392 None] Volume volume-55af36c4-fb5a-4740-8232-9e1653b1f710 (55af36c4-fb5a-4740-8232-9e1653b1f710): created successfully Sep 18 21:51:06 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-5a19e3be-0ba3-4e79-8542-208efb8a51e4 tempest-CreateVolumesFromSnapshotTest-248322392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a3f0e8b-d18f-48cb-8cd2-5316e9889601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:06 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-5a19e3be-0ba3-4e79-8542-208efb8a51e4 tempest-CreateVolumesFromSnapshotTest-248322392 None] Flow 'volume_create_manager' (30fa5075-dd80-4d92-b75d-b6e5ebdbcc3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:51:06 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-5a19e3be-0ba3-4e79-8542-208efb8a51e4 tempest-CreateVolumesFromSnapshotTest-248322392 None] Created volume successfully. Sep 18 21:51:06 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-fbbc7b6c-5e77-483b-be29-ec5e87eee883 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:51:06 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-fbbc7b6c-5e77-483b-be29-ec5e87eee883 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:51:06 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-fbbc7b6c-5e77-483b-be29-ec5e87eee883 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:51:06 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-fbbc7b6c-5e77-483b-be29-ec5e87eee883 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:51:06 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-fbbc7b6c-5e77-483b-be29-ec5e87eee883 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:51:06 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-fbbc7b6c-5e77-483b-be29-ec5e87eee883 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:06 devstack sudo[104280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:51:06 devstack sudo[104280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:07 devstack sudo[104278]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:07 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-8dcee77e-fbf0-4b9f-a8f2-244cb93d98a8 tempest-VolumeImageDependencyTests-170429094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-30d6bad8-5a3c-4c5f-a6f5-36933fc15561" returned: 0 in 0.289s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:07 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-8dcee77e-fbf0-4b9f-a8f2-244cb93d98a8 tempest-VolumeImageDependencyTests-170429094 None] Lock "cinder-quobyte-30d6bad8-5a3c-4c5f-a6f5-36933fc15561" released by "delete_volume" :: held 0.802s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:51:07 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-8dcee77e-fbf0-4b9f-a8f2-244cb93d98a8 tempest-VolumeImageDependencyTests-170429094 None] Created reservations ['23adc978-960d-40c8-a774-651aa00c91fb', '08aff405-72a9-4286-b2ab-bd1d1d310968', '35f044d7-83db-4f92-ae2e-905570972770', '069a664d-843d-4122-9115-dd7950f572ad'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:51:07 devstack sudo[104280]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:07 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-8dcee77e-fbf0-4b9f-a8f2-244cb93d98a8 tempest-VolumeImageDependencyTests-170429094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:51:07 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-8dcee77e-fbf0-4b9f-a8f2-244cb93d98a8 tempest-VolumeImageDependencyTests-170429094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:51:07 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-8dcee77e-fbf0-4b9f-a8f2-244cb93d98a8 tempest-VolumeImageDependencyTests-170429094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:51:07 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-8dcee77e-fbf0-4b9f-a8f2-244cb93d98a8 tempest-VolumeImageDependencyTests-170429094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:51:07 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-8dcee77e-fbf0-4b9f-a8f2-244cb93d98a8 tempest-VolumeImageDependencyTests-170429094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:51:07 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-8dcee77e-fbf0-4b9f-a8f2-244cb93d98a8 tempest-VolumeImageDependencyTests-170429094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:07 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-fbbc7b6c-5e77-483b-be29-ec5e87eee883 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.334s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:07 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-fbbc7b6c-5e77-483b-be29-ec5e87eee883 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:51:07 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-fbbc7b6c-5e77-483b-be29-ec5e87eee883 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Deleted volume successfully. Sep 18 21:51:07 devstack sudo[104276]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:07 devstack sudo[104288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:51:07 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1a65dd1e-8d9d-47ee-891a-b71763d2e9e8 tempest-CreateVolumesFromSnapshotTest-248322392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-6d3e2b83-f76d-4361-9f34-d0c1a7f160c7 1073741824" returned: 0 in 0.501s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:07 devstack sudo[104288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:07 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-fbbc7b6c-5e77-483b-be29-ec5e87eee883 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Lock "cinder-9f1c92c1-4aa5-4cea-aff6-2d10673b33e4-delete_volume" released by "delete_volume" :: held 1.734s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:51:07 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1a65dd1e-8d9d-47ee-891a-b71763d2e9e8 tempest-CreateVolumesFromSnapshotTest-248322392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-6d3e2b83-f76d-4361-9f34-d0c1a7f160c7 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:07 devstack sudo[104290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-6d3e2b83-f76d-4361-9f34-d0c1a7f160c7 Sep 18 21:51:07 devstack sudo[104290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:07 devstack sudo[104288]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:07 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-c655a7bb-6266-4647-a15f-ff8e953c8db1 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] Acquiring lock "cinder-793d24fd-9fe6-40de-bf11-9dd3a780fa98-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:51:07 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-8dcee77e-fbf0-4b9f-a8f2-244cb93d98a8 tempest-VolumeImageDependencyTests-170429094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.330s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:07 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-8dcee77e-fbf0-4b9f-a8f2-244cb93d98a8 tempest-VolumeImageDependencyTests-170429094 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:51:07 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-8dcee77e-fbf0-4b9f-a8f2-244cb93d98a8 tempest-VolumeImageDependencyTests-170429094 None] Deleted volume successfully. Sep 18 21:51:07 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-c655a7bb-6266-4647-a15f-ff8e953c8db1 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] Lock "cinder-793d24fd-9fe6-40de-bf11-9dd3a780fa98-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:51:07 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-8dcee77e-fbf0-4b9f-a8f2-244cb93d98a8 tempest-VolumeImageDependencyTests-170429094 None] Lock "cinder-30d6bad8-5a3c-4c5f-a6f5-36933fc15561-delete_volume" released by "delete_volume" :: held 1.463s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:51:07 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-c655a7bb-6266-4647-a15f-ff8e953c8db1 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] Acquiring lock "cinder-quobyte-793d24fd-9fe6-40de-bf11-9dd3a780fa98" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:51:07 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-c655a7bb-6266-4647-a15f-ff8e953c8db1 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] Lock "cinder-quobyte-793d24fd-9fe6-40de-bf11-9dd3a780fa98" acquired by "delete_volume" :: waited 0.015s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:51:07 devstack sudo[104290]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:07 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1a65dd1e-8d9d-47ee-891a-b71763d2e9e8 tempest-CreateVolumesFromSnapshotTest-248322392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-6d3e2b83-f76d-4361-9f34-d0c1a7f160c7" returned: 0 in 0.385s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:07 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-1a65dd1e-8d9d-47ee-891a-b71763d2e9e8 tempest-CreateVolumesFromSnapshotTest-248322392 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:51:07 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-1a65dd1e-8d9d-47ee-891a-b71763d2e9e8 tempest-CreateVolumesFromSnapshotTest-248322392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:51:07 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-e6101979-0249-4f82-9f9c-583a9b170cf1 tempest-CreateVolumesFromSnapshotTest-248322392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.682s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:51:07 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-e6101979-0249-4f82-9f9c-583a9b170cf1 tempest-CreateVolumesFromSnapshotTest-248322392 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:51:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-796867474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4f2acd1-ada9-40a2-ac29-c75d491488f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3ae13e6e3ab4f639f5c405f0fcfa3f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:51:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:51:01Z,use_quota=True,user_id='6028ee24d4f84c5da80d946f13c838fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:51:07 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-e6101979-0249-4f82-9f9c-583a9b170cf1 tempest-CreateVolumesFromSnapshotTest-248322392 None] Creating volume a4f2acd1-ada9-40a2-ac29-c75d491488f3 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:51:07 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-e6101979-0249-4f82-9f9c-583a9b170cf1 tempest-CreateVolumesFromSnapshotTest-248322392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:51:07 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-e6101979-0249-4f82-9f9c-583a9b170cf1 tempest-CreateVolumesFromSnapshotTest-248322392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:51:07 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-e6101979-0249-4f82-9f9c-583a9b170cf1 tempest-CreateVolumesFromSnapshotTest-248322392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:51:07 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-e6101979-0249-4f82-9f9c-583a9b170cf1 tempest-CreateVolumesFromSnapshotTest-248322392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:51:07 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-e6101979-0249-4f82-9f9c-583a9b170cf1 tempest-CreateVolumesFromSnapshotTest-248322392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:51:07 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-e6101979-0249-4f82-9f9c-583a9b170cf1 tempest-CreateVolumesFromSnapshotTest-248322392 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:51:07 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-e6101979-0249-4f82-9f9c-583a9b170cf1 tempest-CreateVolumesFromSnapshotTest-248322392 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:51:07 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e6101979-0249-4f82-9f9c-583a9b170cf1 tempest-CreateVolumesFromSnapshotTest-248322392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a4f2acd1-ada9-40a2-ac29-c75d491488f3 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:07 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[19cd4b4a-2fea-4af4-b2b4-8f3505b8d2ad]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:51:07 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c655a7bb-6266-4647-a15f-ff8e953c8db1 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-793d24fd-9fe6-40de-bf11-9dd3a780fa98 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:07 devstack sudo[104294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a4f2acd1-ada9-40a2-ac29-c75d491488f3 1073741824 Sep 18 21:51:07 devstack sudo[104294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:07 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-1a65dd1e-8d9d-47ee-891a-b71763d2e9e8 tempest-CreateVolumesFromSnapshotTest-248322392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22beca29-ccbc-45ec-b453-58a0dfd2b346) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d3e2b83-f76d-4361-9f34-d0c1a7f160c7', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:07 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-1a65dd1e-8d9d-47ee-891a-b71763d2e9e8 tempest-CreateVolumesFromSnapshotTest-248322392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e70d8afd-74a5-4b79-9b34-6aa601e32e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:07 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-1188c322-5d60-43a2-a853-3ccdad996765 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Acquiring lock "cinder-fc4b729c-5186-4461-88f9-6399efdce2f6-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:51:07 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-1a65dd1e-8d9d-47ee-891a-b71763d2e9e8 tempest-CreateVolumesFromSnapshotTest-248322392 None] Volume volume-6d3e2b83-f76d-4361-9f34-d0c1a7f160c7 (6d3e2b83-f76d-4361-9f34-d0c1a7f160c7): created successfully Sep 18 21:51:07 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-1a65dd1e-8d9d-47ee-891a-b71763d2e9e8 tempest-CreateVolumesFromSnapshotTest-248322392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e70d8afd-74a5-4b79-9b34-6aa601e32e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:07 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-1a65dd1e-8d9d-47ee-891a-b71763d2e9e8 tempest-CreateVolumesFromSnapshotTest-248322392 None] Flow 'volume_create_manager' (dbc847dd-7d78-4483-80f5-cf6baddb39d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:51:07 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-1188c322-5d60-43a2-a853-3ccdad996765 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Lock "cinder-fc4b729c-5186-4461-88f9-6399efdce2f6-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:51:07 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-1a65dd1e-8d9d-47ee-891a-b71763d2e9e8 tempest-CreateVolumesFromSnapshotTest-248322392 None] Created volume successfully. Sep 18 21:51:07 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-1188c322-5d60-43a2-a853-3ccdad996765 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Acquiring lock "cinder-quobyte-fc4b729c-5186-4461-88f9-6399efdce2f6" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:51:07 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-1188c322-5d60-43a2-a853-3ccdad996765 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Lock "cinder-quobyte-fc4b729c-5186-4461-88f9-6399efdce2f6" acquired by "delete_volume" :: waited 0.026s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:51:07 devstack sudo[104295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-793d24fd-9fe6-40de-bf11-9dd3a780fa98 Sep 18 21:51:07 devstack sudo[104295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:08 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[45fbd976-8bac-4c0b-846b-bb7554a5d70f]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:51:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1188c322-5d60-43a2-a853-3ccdad996765 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fc4b729c-5186-4461-88f9-6399efdce2f6 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:08 devstack sudo[104298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fc4b729c-5186-4461-88f9-6399efdce2f6 Sep 18 21:51:08 devstack sudo[104298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:08 devstack sudo[104295]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c655a7bb-6266-4647-a15f-ff8e953c8db1 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-793d24fd-9fe6-40de-bf11-9dd3a780fa98" returned: 0 in 0.501s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c655a7bb-6266-4647-a15f-ff8e953c8db1 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-793d24fd-9fe6-40de-bf11-9dd3a780fa98 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:08 devstack sudo[104308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-793d24fd-9fe6-40de-bf11-9dd3a780fa98 Sep 18 21:51:08 devstack sudo[104308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:08 devstack sudo[104294]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e6101979-0249-4f82-9f9c-583a9b170cf1 tempest-CreateVolumesFromSnapshotTest-248322392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a4f2acd1-ada9-40a2-ac29-c75d491488f3 1073741824" returned: 0 in 0.606s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e6101979-0249-4f82-9f9c-583a9b170cf1 tempest-CreateVolumesFromSnapshotTest-248322392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a4f2acd1-ada9-40a2-ac29-c75d491488f3 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:08 devstack sudo[104313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a4f2acd1-ada9-40a2-ac29-c75d491488f3 Sep 18 21:51:08 devstack sudo[104313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:08 devstack sudo[104298]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1188c322-5d60-43a2-a853-3ccdad996765 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fc4b729c-5186-4461-88f9-6399efdce2f6" returned: 0 in 0.591s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1188c322-5d60-43a2-a853-3ccdad996765 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fc4b729c-5186-4461-88f9-6399efdce2f6 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:08 devstack sudo[104308]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c655a7bb-6266-4647-a15f-ff8e953c8db1 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-793d24fd-9fe6-40de-bf11-9dd3a780fa98" returned: 0 in 0.360s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:08 devstack sudo[104317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fc4b729c-5186-4461-88f9-6399efdce2f6 Sep 18 21:51:08 devstack sudo[104317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:08 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-c655a7bb-6266-4647-a15f-ff8e953c8db1 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] Lock "cinder-quobyte-793d24fd-9fe6-40de-bf11-9dd3a780fa98" released by "delete_volume" :: held 0.961s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:51:08 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-c655a7bb-6266-4647-a15f-ff8e953c8db1 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] Created reservations ['2afbb613-3258-4be2-a4c2-af3345a3cc92', '9f7a3dac-f934-4bb4-aadb-1f8fb38fbd7b', 'e961488c-3c8f-4893-a0eb-d7d6624010ff', '10aa852f-a32d-4ebf-ae5a-b5db6775165a'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:51:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c655a7bb-6266-4647-a15f-ff8e953c8db1 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:51:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c655a7bb-6266-4647-a15f-ff8e953c8db1 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:51:08 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-c655a7bb-6266-4647-a15f-ff8e953c8db1 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:51:08 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-c655a7bb-6266-4647-a15f-ff8e953c8db1 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:51:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c655a7bb-6266-4647-a15f-ff8e953c8db1 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:51:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c655a7bb-6266-4647-a15f-ff8e953c8db1 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:08 devstack sudo[104313]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e6101979-0249-4f82-9f9c-583a9b170cf1 tempest-CreateVolumesFromSnapshotTest-248322392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a4f2acd1-ada9-40a2-ac29-c75d491488f3" returned: 0 in 0.507s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:08 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-e6101979-0249-4f82-9f9c-583a9b170cf1 tempest-CreateVolumesFromSnapshotTest-248322392 None] <== create_volume: return (1190ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:51:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-e6101979-0249-4f82-9f9c-583a9b170cf1 tempest-CreateVolumesFromSnapshotTest-248322392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.193s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:51:08 devstack sudo[104320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:51:08 devstack sudo[104320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:08 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-e6101979-0249-4f82-9f9c-583a9b170cf1 tempest-CreateVolumesFromSnapshotTest-248322392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9b1bf40-e501-4316-8be2-415b466775b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4f2acd1-ada9-40a2-ac29-c75d491488f3', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:08 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-e6101979-0249-4f82-9f9c-583a9b170cf1 tempest-CreateVolumesFromSnapshotTest-248322392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f97c30b-5792-42b4-b996-811d4a4806a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:08 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-e6101979-0249-4f82-9f9c-583a9b170cf1 tempest-CreateVolumesFromSnapshotTest-248322392 None] Volume volume-a4f2acd1-ada9-40a2-ac29-c75d491488f3 (a4f2acd1-ada9-40a2-ac29-c75d491488f3): created successfully Sep 18 21:51:09 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-e6101979-0249-4f82-9f9c-583a9b170cf1 tempest-CreateVolumesFromSnapshotTest-248322392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f97c30b-5792-42b4-b996-811d4a4806a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:09 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-e6101979-0249-4f82-9f9c-583a9b170cf1 tempest-CreateVolumesFromSnapshotTest-248322392 None] Flow 'volume_create_manager' (1c4297c7-114d-48da-b1e1-6591e49d82a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:51:09 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-e6101979-0249-4f82-9f9c-583a9b170cf1 tempest-CreateVolumesFromSnapshotTest-248322392 None] Created volume successfully. Sep 18 21:51:09 devstack sudo[104317]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1188c322-5d60-43a2-a853-3ccdad996765 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fc4b729c-5186-4461-88f9-6399efdce2f6" returned: 0 in 0.489s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:09 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-1188c322-5d60-43a2-a853-3ccdad996765 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Lock "cinder-quobyte-fc4b729c-5186-4461-88f9-6399efdce2f6" released by "delete_volume" :: held 1.155s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:51:09 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-1188c322-5d60-43a2-a853-3ccdad996765 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Created reservations ['92d45af7-cc6a-4cb3-9184-53cf2d352a3f', '61491c41-a49a-42fa-82e4-adbcbbbc05ff', '3003b859-ec20-4854-a3fd-ea9ef4f1bec7', '27dcaffb-7fae-4cb8-8bdd-4fbe37bbe377'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:51:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-1188c322-5d60-43a2-a853-3ccdad996765 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:51:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-1188c322-5d60-43a2-a853-3ccdad996765 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:51:09 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-1188c322-5d60-43a2-a853-3ccdad996765 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:51:09 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-1188c322-5d60-43a2-a853-3ccdad996765 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:51:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-1188c322-5d60-43a2-a853-3ccdad996765 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:51:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1188c322-5d60-43a2-a853-3ccdad996765 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:09 devstack sudo[104324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:51:09 devstack sudo[104324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:09 devstack sudo[104320]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c655a7bb-6266-4647-a15f-ff8e953c8db1 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.342s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:09 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-c655a7bb-6266-4647-a15f-ff8e953c8db1 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:51:09 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-c655a7bb-6266-4647-a15f-ff8e953c8db1 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] Deleted volume successfully. Sep 18 21:51:09 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-c655a7bb-6266-4647-a15f-ff8e953c8db1 tempest-VolumeAndVolumeTypeFromImageTest-1527870340 None] Lock "cinder-793d24fd-9fe6-40de-bf11-9dd3a780fa98-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:51:09 devstack sudo[104324]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1188c322-5d60-43a2-a853-3ccdad996765 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.268s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:09 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-1188c322-5d60-43a2-a853-3ccdad996765 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:51:09 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-1188c322-5d60-43a2-a853-3ccdad996765 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Deleted volume successfully. Sep 18 21:51:09 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-1188c322-5d60-43a2-a853-3ccdad996765 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Lock "cinder-fc4b729c-5186-4461-88f9-6399efdce2f6-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:51:10 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-a5f4165b-18c4-4ef4-b83a-34bcf95f2062 tempest-CreateVolumesFromSnapshotTest-248322392 None] Acquiring lock "cinder-a4f2acd1-ada9-40a2-ac29-c75d491488f3-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:51:10 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-a5f4165b-18c4-4ef4-b83a-34bcf95f2062 tempest-CreateVolumesFromSnapshotTest-248322392 None] Lock "cinder-a4f2acd1-ada9-40a2-ac29-c75d491488f3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:51:10 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-a83df4f0-6def-4c61-b540-d983966ae7f0 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Acquiring lock "cinder-e821f402-95fb-4d3b-8560-db694504f04a-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:51:10 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-a83df4f0-6def-4c61-b540-d983966ae7f0 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Lock "cinder-e821f402-95fb-4d3b-8560-db694504f04a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:51:10 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-a5f4165b-18c4-4ef4-b83a-34bcf95f2062 tempest-CreateVolumesFromSnapshotTest-248322392 None] Acquiring lock "cinder-quobyte-a4f2acd1-ada9-40a2-ac29-c75d491488f3" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:51:10 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-a83df4f0-6def-4c61-b540-d983966ae7f0 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Acquiring lock "cinder-quobyte-e821f402-95fb-4d3b-8560-db694504f04a" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:51:10 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-a5f4165b-18c4-4ef4-b83a-34bcf95f2062 tempest-CreateVolumesFromSnapshotTest-248322392 None] Lock "cinder-quobyte-a4f2acd1-ada9-40a2-ac29-c75d491488f3" acquired by "delete_volume" :: waited 0.043s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:51:10 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-a83df4f0-6def-4c61-b540-d983966ae7f0 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Lock "cinder-quobyte-e821f402-95fb-4d3b-8560-db694504f04a" acquired by "delete_volume" :: waited 0.058s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:51:10 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca89e30-d656-4737-9d51-bf0efd579d69]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:51:10 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-a5f4165b-18c4-4ef4-b83a-34bcf95f2062 tempest-CreateVolumesFromSnapshotTest-248322392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a4f2acd1-ada9-40a2-ac29-c75d491488f3 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:10 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf74c2fd-172b-493f-9581-2e3b4f1dd3d3]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:51:10 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-a83df4f0-6def-4c61-b540-d983966ae7f0 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e821f402-95fb-4d3b-8560-db694504f04a {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:10 devstack sudo[104328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a4f2acd1-ada9-40a2-ac29-c75d491488f3 Sep 18 21:51:10 devstack sudo[104328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:10 devstack sudo[104329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e821f402-95fb-4d3b-8560-db694504f04a Sep 18 21:51:10 devstack sudo[104329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:10 devstack sudo[104328]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:10 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-a5f4165b-18c4-4ef4-b83a-34bcf95f2062 tempest-CreateVolumesFromSnapshotTest-248322392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a4f2acd1-ada9-40a2-ac29-c75d491488f3" returned: 0 in 0.442s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:10 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-a5f4165b-18c4-4ef4-b83a-34bcf95f2062 tempest-CreateVolumesFromSnapshotTest-248322392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a4f2acd1-ada9-40a2-ac29-c75d491488f3 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:10 devstack sudo[104341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a4f2acd1-ada9-40a2-ac29-c75d491488f3 Sep 18 21:51:10 devstack sudo[104341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:10 devstack sudo[104329]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:10 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-a83df4f0-6def-4c61-b540-d983966ae7f0 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e821f402-95fb-4d3b-8560-db694504f04a" returned: 0 in 0.467s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:10 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-a83df4f0-6def-4c61-b540-d983966ae7f0 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e821f402-95fb-4d3b-8560-db694504f04a {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:10 devstack sudo[104343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e821f402-95fb-4d3b-8560-db694504f04a Sep 18 21:51:10 devstack sudo[104343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:11 devstack sudo[104341]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-a5f4165b-18c4-4ef4-b83a-34bcf95f2062 tempest-CreateVolumesFromSnapshotTest-248322392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a4f2acd1-ada9-40a2-ac29-c75d491488f3" returned: 0 in 0.330s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:11 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-a5f4165b-18c4-4ef4-b83a-34bcf95f2062 tempest-CreateVolumesFromSnapshotTest-248322392 None] Lock "cinder-quobyte-a4f2acd1-ada9-40a2-ac29-c75d491488f3" released by "delete_volume" :: held 0.848s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:51:11 devstack sudo[104343]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-a83df4f0-6def-4c61-b540-d983966ae7f0 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-e821f402-95fb-4d3b-8560-db694504f04a" returned: 0 in 0.311s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:11 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-a83df4f0-6def-4c61-b540-d983966ae7f0 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Lock "cinder-quobyte-e821f402-95fb-4d3b-8560-db694504f04a" released by "delete_volume" :: held 0.841s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:51:11 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-a5f4165b-18c4-4ef4-b83a-34bcf95f2062 tempest-CreateVolumesFromSnapshotTest-248322392 None] Created reservations ['3053d2d2-7840-4fbf-9b17-3e0aaf183c1d', '0bfdfcf9-b1e6-468d-a036-d757e8af2171', '5d0a3dca-adb1-45c6-a824-ae9adcba256d', '0106c6d0-13d9-4063-8cde-131afd4e5e63'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:51:11 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-a83df4f0-6def-4c61-b540-d983966ae7f0 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Created reservations ['a2047289-f793-4e8f-89d7-73103b9157ce', 'bd8dc7cb-a408-4e59-baf1-a2ecc54757c1', '87fdcec8-689f-4868-9598-3853883c7f7c', '7f355db0-af66-4ab0-b54b-ccf5aecc2e15'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:51:11 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-fbc93bdc-ed91-4e53-b4d8-c2eb499154e2 tempest-CreateVolumesFromSnapshotTest-248322392 None] Acquiring lock "cinder-6d3e2b83-f76d-4361-9f34-d0c1a7f160c7-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:51:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-a5f4165b-18c4-4ef4-b83a-34bcf95f2062 tempest-CreateVolumesFromSnapshotTest-248322392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:51:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-a5f4165b-18c4-4ef4-b83a-34bcf95f2062 tempest-CreateVolumesFromSnapshotTest-248322392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:51:11 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-a5f4165b-18c4-4ef4-b83a-34bcf95f2062 tempest-CreateVolumesFromSnapshotTest-248322392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:51:11 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-a5f4165b-18c4-4ef4-b83a-34bcf95f2062 tempest-CreateVolumesFromSnapshotTest-248322392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:51:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-a5f4165b-18c4-4ef4-b83a-34bcf95f2062 tempest-CreateVolumesFromSnapshotTest-248322392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:51:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-a5f4165b-18c4-4ef4-b83a-34bcf95f2062 tempest-CreateVolumesFromSnapshotTest-248322392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:11 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-fbc93bdc-ed91-4e53-b4d8-c2eb499154e2 tempest-CreateVolumesFromSnapshotTest-248322392 None] Lock "cinder-6d3e2b83-f76d-4361-9f34-d0c1a7f160c7-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:51:11 devstack sudo[104347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:51:11 devstack sudo[104347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-a83df4f0-6def-4c61-b540-d983966ae7f0 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:51:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-a83df4f0-6def-4c61-b540-d983966ae7f0 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:51:11 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-a83df4f0-6def-4c61-b540-d983966ae7f0 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:51:11 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-a83df4f0-6def-4c61-b540-d983966ae7f0 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:51:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-a83df4f0-6def-4c61-b540-d983966ae7f0 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:51:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-a83df4f0-6def-4c61-b540-d983966ae7f0 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:11 devstack sudo[104349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:51:11 devstack sudo[104349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:11 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-c744ffa9-0786-4d25-8b36-e9e1ba742e0c tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Acquiring lock "cinder-d2c671e7-a141-4c50-9e6a-e633f457180a-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:51:11 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-fbc93bdc-ed91-4e53-b4d8-c2eb499154e2 tempest-CreateVolumesFromSnapshotTest-248322392 None] Acquiring lock "cinder-quobyte-6d3e2b83-f76d-4361-9f34-d0c1a7f160c7" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:51:11 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-c744ffa9-0786-4d25-8b36-e9e1ba742e0c tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Lock "cinder-d2c671e7-a141-4c50-9e6a-e633f457180a-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:51:11 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-fbc93bdc-ed91-4e53-b4d8-c2eb499154e2 tempest-CreateVolumesFromSnapshotTest-248322392 None] Lock "cinder-quobyte-6d3e2b83-f76d-4361-9f34-d0c1a7f160c7" acquired by "delete_volume" :: waited 0.032s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:51:11 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-c744ffa9-0786-4d25-8b36-e9e1ba742e0c tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Acquiring lock "cinder-quobyte-d2c671e7-a141-4c50-9e6a-e633f457180a" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:51:11 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba11c79-8d02-477a-9416-d5334582e93e]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:51:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-fbc93bdc-ed91-4e53-b4d8-c2eb499154e2 tempest-CreateVolumesFromSnapshotTest-248322392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-6d3e2b83-f76d-4361-9f34-d0c1a7f160c7 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:11 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-c744ffa9-0786-4d25-8b36-e9e1ba742e0c tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Lock "cinder-quobyte-d2c671e7-a141-4c50-9e6a-e633f457180a" acquired by "delete_volume" :: waited 0.085s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:51:11 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3de3421-b686-4037-8213-6afc3d5c3042]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:51:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c744ffa9-0786-4d25-8b36-e9e1ba742e0c tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-d2c671e7-a141-4c50-9e6a-e633f457180a {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:11 devstack sudo[104347]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-a5f4165b-18c4-4ef4-b83a-34bcf95f2062 tempest-CreateVolumesFromSnapshotTest-248322392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.496s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:11 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-a5f4165b-18c4-4ef4-b83a-34bcf95f2062 tempest-CreateVolumesFromSnapshotTest-248322392 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:51:11 devstack sudo[104351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-6d3e2b83-f76d-4361-9f34-d0c1a7f160c7 Sep 18 21:51:11 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-a5f4165b-18c4-4ef4-b83a-34bcf95f2062 tempest-CreateVolumesFromSnapshotTest-248322392 None] Deleted volume successfully. Sep 18 21:51:11 devstack sudo[104351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:11 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-a5f4165b-18c4-4ef4-b83a-34bcf95f2062 tempest-CreateVolumesFromSnapshotTest-248322392 None] Lock "cinder-a4f2acd1-ada9-40a2-ac29-c75d491488f3-delete_volume" released by "delete_volume" :: held 1.762s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:51:12 devstack sudo[104353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-d2c671e7-a141-4c50-9e6a-e633f457180a Sep 18 21:51:12 devstack sudo[104353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:12 devstack sudo[104349]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-a83df4f0-6def-4c61-b540-d983966ae7f0 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.609s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:12 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-a83df4f0-6def-4c61-b540-d983966ae7f0 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:51:12 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-a83df4f0-6def-4c61-b540-d983966ae7f0 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Deleted volume successfully. Sep 18 21:51:12 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-a83df4f0-6def-4c61-b540-d983966ae7f0 tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Lock "cinder-e821f402-95fb-4d3b-8560-db694504f04a-delete_volume" released by "delete_volume" :: held 1.926s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:51:12 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-713fd338-c272-44f3-a1d2-b8d040a501d8 tempest-CinderUnicodeTest-1242393573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:51:12 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-713fd338-c272-44f3-a1d2-b8d040a501d8 tempest-CinderUnicodeTest-1242393573 None] Flow 'volume_create_manager' (26b113e7-60fe-42d3-af10-9491edcd2887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:51:12 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-713fd338-c272-44f3-a1d2-b8d040a501d8 tempest-CinderUnicodeTest-1242393573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a46afe37-b400-4e11-9702-eb97c27e6094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:12 devstack sudo[104351]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:12 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-713fd338-c272-44f3-a1d2-b8d040a501d8 tempest-CinderUnicodeTest-1242393573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a46afe37-b400-4e11-9702-eb97c27e6094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:51:12Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20be7eb6-7e75-48e1-97bc-be48d5e01690,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b053ab9cc4d4c05a8d01106e9a80eb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:51:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:51:12Z,use_quota=True,user_id='9677791667294751b09c725ee8d23c4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:12 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-713fd338-c272-44f3-a1d2-b8d040a501d8 tempest-CinderUnicodeTest-1242393573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d6c0ccd-eb6f-4b18-9a05-d1aea933c9f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:12 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-713fd338-c272-44f3-a1d2-b8d040a501d8 tempest-CinderUnicodeTest-1242393573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d6c0ccd-eb6f-4b18-9a05-d1aea933c9f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:12 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-713fd338-c272-44f3-a1d2-b8d040a501d8 tempest-CinderUnicodeTest-1242393573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9e5bc07-122a-422e-a295-2f696b0eb2d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:12 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-713fd338-c272-44f3-a1d2-b8d040a501d8 tempest-CinderUnicodeTest-1242393573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9e5bc07-122a-422e-a295-2f696b0eb2d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20be7eb6-7e75-48e1-97bc-be48d5e01690', 'volume_name': 'volume-20be7eb6-7e75-48e1-97bc-be48d5e01690', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:12 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-713fd338-c272-44f3-a1d2-b8d040a501d8 tempest-CinderUnicodeTest-1242393573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1b05066-b3fe-47a5-a110-1f63d9dfe657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:12 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-713fd338-c272-44f3-a1d2-b8d040a501d8 tempest-CinderUnicodeTest-1242393573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1b05066-b3fe-47a5-a110-1f63d9dfe657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:12 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-713fd338-c272-44f3-a1d2-b8d040a501d8 tempest-CinderUnicodeTest-1242393573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e71108f-5bc4-4bba-ac75-71d467537558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:12 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-713fd338-c272-44f3-a1d2-b8d040a501d8 tempest-CinderUnicodeTest-1242393573 None] Volume 20be7eb6-7e75-48e1-97bc-be48d5e01690: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20be7eb6-7e75-48e1-97bc-be48d5e01690', 'volume_size': 1} Sep 18 21:51:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-713fd338-c272-44f3-a1d2-b8d040a501d8 tempest-CinderUnicodeTest-1242393573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:51:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-713fd338-c272-44f3-a1d2-b8d040a501d8 tempest-CinderUnicodeTest-1242393573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:51:12 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-713fd338-c272-44f3-a1d2-b8d040a501d8 tempest-CinderUnicodeTest-1242393573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:51:12Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20be7eb6-7e75-48e1-97bc-be48d5e01690,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b053ab9cc4d4c05a8d01106e9a80eb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:51:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:51:12Z,use_quota=True,user_id='9677791667294751b09c725ee8d23c4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:51:12 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-713fd338-c272-44f3-a1d2-b8d040a501d8 tempest-CinderUnicodeTest-1242393573 None] Creating volume 20be7eb6-7e75-48e1-97bc-be48d5e01690 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:51:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-713fd338-c272-44f3-a1d2-b8d040a501d8 tempest-CinderUnicodeTest-1242393573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:51:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-713fd338-c272-44f3-a1d2-b8d040a501d8 tempest-CinderUnicodeTest-1242393573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:51:12 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-713fd338-c272-44f3-a1d2-b8d040a501d8 tempest-CinderUnicodeTest-1242393573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:51:12 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-713fd338-c272-44f3-a1d2-b8d040a501d8 tempest-CinderUnicodeTest-1242393573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:51:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-713fd338-c272-44f3-a1d2-b8d040a501d8 tempest-CinderUnicodeTest-1242393573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:51:12 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-713fd338-c272-44f3-a1d2-b8d040a501d8 tempest-CinderUnicodeTest-1242393573 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:51:12 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-713fd338-c272-44f3-a1d2-b8d040a501d8 tempest-CinderUnicodeTest-1242393573 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:51:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-713fd338-c272-44f3-a1d2-b8d040a501d8 tempest-CinderUnicodeTest-1242393573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-20be7eb6-7e75-48e1-97bc-be48d5e01690 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-fbc93bdc-ed91-4e53-b4d8-c2eb499154e2 tempest-CreateVolumesFromSnapshotTest-248322392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-6d3e2b83-f76d-4361-9f34-d0c1a7f160c7" returned: 0 in 0.618s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-fbc93bdc-ed91-4e53-b4d8-c2eb499154e2 tempest-CreateVolumesFromSnapshotTest-248322392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-6d3e2b83-f76d-4361-9f34-d0c1a7f160c7 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:12 devstack sudo[104362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-20be7eb6-7e75-48e1-97bc-be48d5e01690 1073741824 Sep 18 21:51:12 devstack sudo[104362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:12 devstack sudo[104363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-6d3e2b83-f76d-4361-9f34-d0c1a7f160c7 Sep 18 21:51:12 devstack sudo[104363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:12 devstack sudo[104353]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c744ffa9-0786-4d25-8b36-e9e1ba742e0c tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-d2c671e7-a141-4c50-9e6a-e633f457180a" returned: 0 in 0.577s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c744ffa9-0786-4d25-8b36-e9e1ba742e0c tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-d2c671e7-a141-4c50-9e6a-e633f457180a {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:12 devstack sudo[104367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-d2c671e7-a141-4c50-9e6a-e633f457180a Sep 18 21:51:12 devstack sudo[104367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:12 devstack sudo[104363]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-fbc93bdc-ed91-4e53-b4d8-c2eb499154e2 tempest-CreateVolumesFromSnapshotTest-248322392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-6d3e2b83-f76d-4361-9f34-d0c1a7f160c7" returned: 0 in 0.316s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:12 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-fbc93bdc-ed91-4e53-b4d8-c2eb499154e2 tempest-CreateVolumesFromSnapshotTest-248322392 None] Lock "cinder-quobyte-6d3e2b83-f76d-4361-9f34-d0c1a7f160c7" released by "delete_volume" :: held 1.040s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:51:12 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-fbc93bdc-ed91-4e53-b4d8-c2eb499154e2 tempest-CreateVolumesFromSnapshotTest-248322392 None] Created reservations ['a957eb48-add0-4067-8a3f-91582e601e73', 'f42de71f-cc9e-4396-ad7d-d27c11af7416', '93fd1054-6d44-488d-a0ff-9ecece72afd3', 'f23e0cf9-e1f0-43e8-9a51-9359064f64f7'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:51:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-fbc93bdc-ed91-4e53-b4d8-c2eb499154e2 tempest-CreateVolumesFromSnapshotTest-248322392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:51:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-fbc93bdc-ed91-4e53-b4d8-c2eb499154e2 tempest-CreateVolumesFromSnapshotTest-248322392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:51:12 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-fbc93bdc-ed91-4e53-b4d8-c2eb499154e2 tempest-CreateVolumesFromSnapshotTest-248322392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:51:12 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-fbc93bdc-ed91-4e53-b4d8-c2eb499154e2 tempest-CreateVolumesFromSnapshotTest-248322392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:51:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-fbc93bdc-ed91-4e53-b4d8-c2eb499154e2 tempest-CreateVolumesFromSnapshotTest-248322392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:51:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-fbc93bdc-ed91-4e53-b4d8-c2eb499154e2 tempest-CreateVolumesFromSnapshotTest-248322392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:12 devstack sudo[104367]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c744ffa9-0786-4d25-8b36-e9e1ba742e0c tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-d2c671e7-a141-4c50-9e6a-e633f457180a" returned: 0 in 0.461s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:12 devstack sudo[104375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:51:12 devstack sudo[104375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:12 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-c744ffa9-0786-4d25-8b36-e9e1ba742e0c tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Lock "cinder-quobyte-d2c671e7-a141-4c50-9e6a-e633f457180a" released by "delete_volume" :: held 1.108s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:51:12 devstack sudo[104362]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-713fd338-c272-44f3-a1d2-b8d040a501d8 tempest-CinderUnicodeTest-1242393573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-20be7eb6-7e75-48e1-97bc-be48d5e01690 1073741824" returned: 0 in 0.617s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:12 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-c744ffa9-0786-4d25-8b36-e9e1ba742e0c tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Created reservations ['e4f52255-5a5e-444d-9c7a-0aa59339e417', '78447041-026d-4f3a-b05e-4744f3241440', '1d3c9a09-7ffd-478f-abf6-aea31a22a505', '44e25083-fd22-44de-9aa8-eccb7e7d6cfa'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:51:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-713fd338-c272-44f3-a1d2-b8d040a501d8 tempest-CinderUnicodeTest-1242393573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-20be7eb6-7e75-48e1-97bc-be48d5e01690 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:12 devstack sudo[104377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-20be7eb6-7e75-48e1-97bc-be48d5e01690 Sep 18 21:51:12 devstack sudo[104377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c744ffa9-0786-4d25-8b36-e9e1ba742e0c tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:51:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c744ffa9-0786-4d25-8b36-e9e1ba742e0c tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:51:13 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-c744ffa9-0786-4d25-8b36-e9e1ba742e0c tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:51:13 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-c744ffa9-0786-4d25-8b36-e9e1ba742e0c tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:51:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c744ffa9-0786-4d25-8b36-e9e1ba742e0c tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:51:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c744ffa9-0786-4d25-8b36-e9e1ba742e0c tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:13 devstack sudo[104379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:51:13 devstack sudo[104379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:13 devstack sudo[104375]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-fbc93bdc-ed91-4e53-b4d8-c2eb499154e2 tempest-CreateVolumesFromSnapshotTest-248322392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.413s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:13 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-fbc93bdc-ed91-4e53-b4d8-c2eb499154e2 tempest-CreateVolumesFromSnapshotTest-248322392 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:51:13 devstack sudo[104377]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:13 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-fbc93bdc-ed91-4e53-b4d8-c2eb499154e2 tempest-CreateVolumesFromSnapshotTest-248322392 None] Deleted volume successfully. Sep 18 21:51:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-713fd338-c272-44f3-a1d2-b8d040a501d8 tempest-CinderUnicodeTest-1242393573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-20be7eb6-7e75-48e1-97bc-be48d5e01690" returned: 0 in 0.308s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:13 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-713fd338-c272-44f3-a1d2-b8d040a501d8 tempest-CinderUnicodeTest-1242393573 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:51:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-713fd338-c272-44f3-a1d2-b8d040a501d8 tempest-CinderUnicodeTest-1242393573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:51:13 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-713fd338-c272-44f3-a1d2-b8d040a501d8 tempest-CinderUnicodeTest-1242393573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e71108f-5bc4-4bba-ac75-71d467537558) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20be7eb6-7e75-48e1-97bc-be48d5e01690', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:13 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-713fd338-c272-44f3-a1d2-b8d040a501d8 tempest-CinderUnicodeTest-1242393573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca843e24-75a1-4349-b4b4-af353456a13c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:13 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-fbc93bdc-ed91-4e53-b4d8-c2eb499154e2 tempest-CreateVolumesFromSnapshotTest-248322392 None] Lock "cinder-6d3e2b83-f76d-4361-9f34-d0c1a7f160c7-delete_volume" released by "delete_volume" :: held 1.856s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:51:13 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-713fd338-c272-44f3-a1d2-b8d040a501d8 tempest-CinderUnicodeTest-1242393573 None] Volume volume-20be7eb6-7e75-48e1-97bc-be48d5e01690 (20be7eb6-7e75-48e1-97bc-be48d5e01690): created successfully Sep 18 21:51:13 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-713fd338-c272-44f3-a1d2-b8d040a501d8 tempest-CinderUnicodeTest-1242393573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca843e24-75a1-4349-b4b4-af353456a13c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:13 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-713fd338-c272-44f3-a1d2-b8d040a501d8 tempest-CinderUnicodeTest-1242393573 None] Flow 'volume_create_manager' (26b113e7-60fe-42d3-af10-9491edcd2887) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:51:13 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-713fd338-c272-44f3-a1d2-b8d040a501d8 tempest-CinderUnicodeTest-1242393573 None] Created volume successfully. Sep 18 21:51:13 devstack sudo[104379]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c744ffa9-0786-4d25-8b36-e9e1ba742e0c tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.316s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:13 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-c744ffa9-0786-4d25-8b36-e9e1ba742e0c tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:51:13 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-c744ffa9-0786-4d25-8b36-e9e1ba742e0c tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Deleted volume successfully. Sep 18 21:51:13 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-c744ffa9-0786-4d25-8b36-e9e1ba742e0c tempest-CreateVolumesFromSourceVolumeTest-1518115265 None] Lock "cinder-d2c671e7-a141-4c50-9e6a-e633f457180a-delete_volume" released by "delete_volume" :: held 1.818s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:51:13 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-5d4cfab0-4a3b-4a0a-b2fd-a70897ee2110 tempest-CreateVolumesFromSnapshotTest-248322392 None] Acquiring lock "cinder-55af36c4-fb5a-4740-8232-9e1653b1f710-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:51:13 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-5d4cfab0-4a3b-4a0a-b2fd-a70897ee2110 tempest-CreateVolumesFromSnapshotTest-248322392 None] Lock "cinder-55af36c4-fb5a-4740-8232-9e1653b1f710-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:51:13 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-5d4cfab0-4a3b-4a0a-b2fd-a70897ee2110 tempest-CreateVolumesFromSnapshotTest-248322392 None] Acquiring lock "cinder-quobyte-55af36c4-fb5a-4740-8232-9e1653b1f710" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:51:13 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-5d4cfab0-4a3b-4a0a-b2fd-a70897ee2110 tempest-CreateVolumesFromSnapshotTest-248322392 None] Lock "cinder-quobyte-55af36c4-fb5a-4740-8232-9e1653b1f710" acquired by "delete_volume" :: waited 0.030s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:51:13 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa931c3f-731c-41e2-9a47-76db8c68020b]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:51:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5d4cfab0-4a3b-4a0a-b2fd-a70897ee2110 tempest-CreateVolumesFromSnapshotTest-248322392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-55af36c4-fb5a-4740-8232-9e1653b1f710 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:13 devstack sudo[104384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-55af36c4-fb5a-4740-8232-9e1653b1f710 Sep 18 21:51:13 devstack sudo[104384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:14 devstack sudo[104384]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5d4cfab0-4a3b-4a0a-b2fd-a70897ee2110 tempest-CreateVolumesFromSnapshotTest-248322392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-55af36c4-fb5a-4740-8232-9e1653b1f710" returned: 0 in 0.412s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5d4cfab0-4a3b-4a0a-b2fd-a70897ee2110 tempest-CreateVolumesFromSnapshotTest-248322392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-55af36c4-fb5a-4740-8232-9e1653b1f710 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:14 devstack sudo[104389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-55af36c4-fb5a-4740-8232-9e1653b1f710 Sep 18 21:51:14 devstack sudo[104389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:14 devstack sudo[104389]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5d4cfab0-4a3b-4a0a-b2fd-a70897ee2110 tempest-CreateVolumesFromSnapshotTest-248322392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-55af36c4-fb5a-4740-8232-9e1653b1f710" returned: 0 in 0.324s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:14 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-5d4cfab0-4a3b-4a0a-b2fd-a70897ee2110 tempest-CreateVolumesFromSnapshotTest-248322392 None] Lock "cinder-quobyte-55af36c4-fb5a-4740-8232-9e1653b1f710" released by "delete_volume" :: held 0.802s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:51:14 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-5d4cfab0-4a3b-4a0a-b2fd-a70897ee2110 tempest-CreateVolumesFromSnapshotTest-248322392 None] Created reservations ['55f2356d-e722-425e-8c44-5f5f059aeb57', '640fe3a0-2960-452c-90fd-29c4b814d945', 'aadb836f-64b0-4058-9417-b1cd35b1db96', '65d6705b-1853-4c31-bb48-91ad5bd45c26'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:51:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-5d4cfab0-4a3b-4a0a-b2fd-a70897ee2110 tempest-CreateVolumesFromSnapshotTest-248322392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:51:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-5d4cfab0-4a3b-4a0a-b2fd-a70897ee2110 tempest-CreateVolumesFromSnapshotTest-248322392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:51:14 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-5d4cfab0-4a3b-4a0a-b2fd-a70897ee2110 tempest-CreateVolumesFromSnapshotTest-248322392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:51:14 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-5d4cfab0-4a3b-4a0a-b2fd-a70897ee2110 tempest-CreateVolumesFromSnapshotTest-248322392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:51:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-5d4cfab0-4a3b-4a0a-b2fd-a70897ee2110 tempest-CreateVolumesFromSnapshotTest-248322392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:51:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5d4cfab0-4a3b-4a0a-b2fd-a70897ee2110 tempest-CreateVolumesFromSnapshotTest-248322392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:14 devstack sudo[104392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:51:14 devstack sudo[104392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:14 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-146cd7a6-b404-4d76-b251-a0bdc3b30ddd tempest-CreateVolumesFromSnapshotTest-248322392 None] Acquiring lock "cinder-6d406132-402e-43b4-b31f-35e30f09a004-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:51:14 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-146cd7a6-b404-4d76-b251-a0bdc3b30ddd tempest-CreateVolumesFromSnapshotTest-248322392 None] Lock "cinder-6d406132-402e-43b4-b31f-35e30f09a004-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:51:15 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-146cd7a6-b404-4d76-b251-a0bdc3b30ddd tempest-CreateVolumesFromSnapshotTest-248322392 None] Acquiring lock "cinder-quobyte-6d406132-402e-43b4-b31f-35e30f09a004" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:51:15 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-146cd7a6-b404-4d76-b251-a0bdc3b30ddd tempest-CreateVolumesFromSnapshotTest-248322392 None] Lock "cinder-quobyte-6d406132-402e-43b4-b31f-35e30f09a004" acquired by "delete_volume" :: waited 0.025s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:51:15 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e76e729-a7a9-44e8-97c6-1559b503c4f9 tempest-CinderUnicodeTest-1242393573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:51:15 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6e76e729-a7a9-44e8-97c6-1559b503c4f9 tempest-CinderUnicodeTest-1242393573 None] Flow 'volume_create_manager' (8e3de95b-c537-4296-afc3-dd1fa672fbad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:51:15 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6e76e729-a7a9-44e8-97c6-1559b503c4f9 tempest-CinderUnicodeTest-1242393573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54d6026e-f05e-43cd-b156-529ef4ec2617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:15 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6bc4d41-b9cd-4ed7-b645-a1b020f7cf99]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:51:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-146cd7a6-b404-4d76-b251-a0bdc3b30ddd tempest-CreateVolumesFromSnapshotTest-248322392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-6d406132-402e-43b4-b31f-35e30f09a004 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:15 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6e76e729-a7a9-44e8-97c6-1559b503c4f9 tempest-CinderUnicodeTest-1242393573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54d6026e-f05e-43cd-b156-529ef4ec2617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:51:15Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-577021354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53e002ff-2432-4e4e-9310-be5023d7dc9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b053ab9cc4d4c05a8d01106e9a80eb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:51:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:51:15Z,use_quota=True,user_id='9677791667294751b09c725ee8d23c4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:15 devstack sudo[104392]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:15 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6e76e729-a7a9-44e8-97c6-1559b503c4f9 tempest-CinderUnicodeTest-1242393573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70cbf887-b320-4514-b9ad-5a6b3a2f1711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:15 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6e76e729-a7a9-44e8-97c6-1559b503c4f9 tempest-CinderUnicodeTest-1242393573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70cbf887-b320-4514-b9ad-5a6b3a2f1711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:15 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6e76e729-a7a9-44e8-97c6-1559b503c4f9 tempest-CinderUnicodeTest-1242393573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ce9e895-5b83-4a0e-abd2-8351e52e3524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:15 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6e76e729-a7a9-44e8-97c6-1559b503c4f9 tempest-CinderUnicodeTest-1242393573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ce9e895-5b83-4a0e-abd2-8351e52e3524) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53e002ff-2432-4e4e-9310-be5023d7dc9f', 'volume_name': 'volume-53e002ff-2432-4e4e-9310-be5023d7dc9f', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:15 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6e76e729-a7a9-44e8-97c6-1559b503c4f9 tempest-CinderUnicodeTest-1242393573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffc60f42-402f-430e-949b-82eeeb132c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:15 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6e76e729-a7a9-44e8-97c6-1559b503c4f9 tempest-CinderUnicodeTest-1242393573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffc60f42-402f-430e-949b-82eeeb132c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:15 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6e76e729-a7a9-44e8-97c6-1559b503c4f9 tempest-CinderUnicodeTest-1242393573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30338fb9-aeb7-41cc-b7b9-2b199c55ff66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:15 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-6e76e729-a7a9-44e8-97c6-1559b503c4f9 tempest-CinderUnicodeTest-1242393573 None] Volume 53e002ff-2432-4e4e-9310-be5023d7dc9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53e002ff-2432-4e4e-9310-be5023d7dc9f', 'volume_size': 1} Sep 18 21:51:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6e76e729-a7a9-44e8-97c6-1559b503c4f9 tempest-CinderUnicodeTest-1242393573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:51:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6e76e729-a7a9-44e8-97c6-1559b503c4f9 tempest-CinderUnicodeTest-1242393573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:51:15 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-6e76e729-a7a9-44e8-97c6-1559b503c4f9 tempest-CinderUnicodeTest-1242393573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:51:15Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-577021354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53e002ff-2432-4e4e-9310-be5023d7dc9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b053ab9cc4d4c05a8d01106e9a80eb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:51:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:51:15Z,use_quota=True,user_id='9677791667294751b09c725ee8d23c4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:51:15 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-6e76e729-a7a9-44e8-97c6-1559b503c4f9 tempest-CinderUnicodeTest-1242393573 None] Creating volume 53e002ff-2432-4e4e-9310-be5023d7dc9f {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:51:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6e76e729-a7a9-44e8-97c6-1559b503c4f9 tempest-CinderUnicodeTest-1242393573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:51:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6e76e729-a7a9-44e8-97c6-1559b503c4f9 tempest-CinderUnicodeTest-1242393573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:51:15 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-6e76e729-a7a9-44e8-97c6-1559b503c4f9 tempest-CinderUnicodeTest-1242393573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:51:15 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-6e76e729-a7a9-44e8-97c6-1559b503c4f9 tempest-CinderUnicodeTest-1242393573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:51:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6e76e729-a7a9-44e8-97c6-1559b503c4f9 tempest-CinderUnicodeTest-1242393573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:51:15 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-6e76e729-a7a9-44e8-97c6-1559b503c4f9 tempest-CinderUnicodeTest-1242393573 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:51:15 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-6e76e729-a7a9-44e8-97c6-1559b503c4f9 tempest-CinderUnicodeTest-1242393573 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:51:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6e76e729-a7a9-44e8-97c6-1559b503c4f9 tempest-CinderUnicodeTest-1242393573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-53e002ff-2432-4e4e-9310-be5023d7dc9f 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5d4cfab0-4a3b-4a0a-b2fd-a70897ee2110 tempest-CreateVolumesFromSnapshotTest-248322392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.479s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:15 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-5d4cfab0-4a3b-4a0a-b2fd-a70897ee2110 tempest-CreateVolumesFromSnapshotTest-248322392 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:51:15 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-5d4cfab0-4a3b-4a0a-b2fd-a70897ee2110 tempest-CreateVolumesFromSnapshotTest-248322392 None] Deleted volume successfully. Sep 18 21:51:15 devstack sudo[104395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-6d406132-402e-43b4-b31f-35e30f09a004 Sep 18 21:51:15 devstack sudo[104395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:15 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-5d4cfab0-4a3b-4a0a-b2fd-a70897ee2110 tempest-CreateVolumesFromSnapshotTest-248322392 None] Lock "cinder-55af36c4-fb5a-4740-8232-9e1653b1f710-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:51:15 devstack sudo[104396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-53e002ff-2432-4e4e-9310-be5023d7dc9f 1073741824 Sep 18 21:51:15 devstack sudo[104396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:15 devstack sudo[104395]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-146cd7a6-b404-4d76-b251-a0bdc3b30ddd tempest-CreateVolumesFromSnapshotTest-248322392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-6d406132-402e-43b4-b31f-35e30f09a004" returned: 0 in 0.496s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-146cd7a6-b404-4d76-b251-a0bdc3b30ddd tempest-CreateVolumesFromSnapshotTest-248322392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-6d406132-402e-43b4-b31f-35e30f09a004 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:15 devstack sudo[104405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-6d406132-402e-43b4-b31f-35e30f09a004 Sep 18 21:51:15 devstack sudo[104405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:15 devstack sudo[104396]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6e76e729-a7a9-44e8-97c6-1559b503c4f9 tempest-CinderUnicodeTest-1242393573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-53e002ff-2432-4e4e-9310-be5023d7dc9f 1073741824" returned: 0 in 0.569s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6e76e729-a7a9-44e8-97c6-1559b503c4f9 tempest-CinderUnicodeTest-1242393573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-53e002ff-2432-4e4e-9310-be5023d7dc9f {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:15 devstack sudo[104409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-53e002ff-2432-4e4e-9310-be5023d7dc9f Sep 18 21:51:15 devstack sudo[104409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:15 devstack sudo[104405]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-146cd7a6-b404-4d76-b251-a0bdc3b30ddd tempest-CreateVolumesFromSnapshotTest-248322392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-6d406132-402e-43b4-b31f-35e30f09a004" returned: 0 in 0.387s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:16 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-146cd7a6-b404-4d76-b251-a0bdc3b30ddd tempest-CreateVolumesFromSnapshotTest-248322392 None] Lock "cinder-quobyte-6d406132-402e-43b4-b31f-35e30f09a004" released by "delete_volume" :: held 1.002s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:51:16 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-146cd7a6-b404-4d76-b251-a0bdc3b30ddd tempest-CreateVolumesFromSnapshotTest-248322392 None] Created reservations ['67ebd3ef-e0ba-46b2-a7e9-b4d84f4c3b05', 'a1382abd-564d-4b6b-8091-f667b805cdcd', 'e7311a19-92c4-4937-8caa-59eb7bf98d4c', '47b0fa26-03ef-4c94-aefa-8b78f0b49317'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:51:16 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-69a38a62-af61-496f-bc70-31434824b2cf tempest-CreateVolumesFromImageTest-1864121411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:51:16 devstack sudo[104409]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:16 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-69a38a62-af61-496f-bc70-31434824b2cf tempest-CreateVolumesFromImageTest-1864121411 None] Flow 'volume_create_manager' (6de5ce46-9102-4585-8500-9a9b4220e26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:51:16 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-69a38a62-af61-496f-bc70-31434824b2cf tempest-CreateVolumesFromImageTest-1864121411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75fb0d36-23e8-4999-9690-83fd042742ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6e76e729-a7a9-44e8-97c6-1559b503c4f9 tempest-CinderUnicodeTest-1242393573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-53e002ff-2432-4e4e-9310-be5023d7dc9f" returned: 0 in 0.368s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:16 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-6e76e729-a7a9-44e8-97c6-1559b503c4f9 tempest-CinderUnicodeTest-1242393573 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:51:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6e76e729-a7a9-44e8-97c6-1559b503c4f9 tempest-CinderUnicodeTest-1242393573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:51:16 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-69a38a62-af61-496f-bc70-31434824b2cf tempest-CreateVolumesFromImageTest-1864121411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75fb0d36-23e8-4999-9690-83fd042742ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:51:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1240275386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2abb92cd-4f2d-4355-b9e9-0f2ab3b0246a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db4333441bc74b98ab3cf7d0e2a810f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:51:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:51:16Z,use_quota=True,user_id='7a110f349fa74887aaf9ede7e1c3302c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:16 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-69a38a62-af61-496f-bc70-31434824b2cf tempest-CreateVolumesFromImageTest-1864121411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3269e04c-ce33-4e50-bc5f-d32ac7457aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:16 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-69a38a62-af61-496f-bc70-31434824b2cf tempest-CreateVolumesFromImageTest-1864121411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3269e04c-ce33-4e50-bc5f-d32ac7457aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:16 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-69a38a62-af61-496f-bc70-31434824b2cf tempest-CreateVolumesFromImageTest-1864121411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9a7f93f-ef65-4706-9c6e-b9578f35ea36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:16 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-69a38a62-af61-496f-bc70-31434824b2cf tempest-CreateVolumesFromImageTest-1864121411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9a7f93f-ef65-4706-9c6e-b9578f35ea36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2abb92cd-4f2d-4355-b9e9-0f2ab3b0246a', 'volume_name': 'volume-2abb92cd-4f2d-4355-b9e9-0f2ab3b0246a', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:16 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-69a38a62-af61-496f-bc70-31434824b2cf tempest-CreateVolumesFromImageTest-1864121411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (739f6cc6-3d1b-4510-8925-0ca32affc90b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:16 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-69a38a62-af61-496f-bc70-31434824b2cf tempest-CreateVolumesFromImageTest-1864121411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (739f6cc6-3d1b-4510-8925-0ca32affc90b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:16 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-69a38a62-af61-496f-bc70-31434824b2cf tempest-CreateVolumesFromImageTest-1864121411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0b6773a-f397-4036-9397-32b8d24f40bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:16 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-69a38a62-af61-496f-bc70-31434824b2cf tempest-CreateVolumesFromImageTest-1864121411 None] Volume 2abb92cd-4f2d-4355-b9e9-0f2ab3b0246a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2abb92cd-4f2d-4355-b9e9-0f2ab3b0246a', 'volume_size': 1} Sep 18 21:51:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-69a38a62-af61-496f-bc70-31434824b2cf tempest-CreateVolumesFromImageTest-1864121411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:51:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-69a38a62-af61-496f-bc70-31434824b2cf tempest-CreateVolumesFromImageTest-1864121411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:51:16 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-69a38a62-af61-496f-bc70-31434824b2cf tempest-CreateVolumesFromImageTest-1864121411 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:51:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1240275386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2abb92cd-4f2d-4355-b9e9-0f2ab3b0246a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db4333441bc74b98ab3cf7d0e2a810f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:51:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:51:16Z,use_quota=True,user_id='7a110f349fa74887aaf9ede7e1c3302c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:51:16 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-69a38a62-af61-496f-bc70-31434824b2cf tempest-CreateVolumesFromImageTest-1864121411 None] Creating volume 2abb92cd-4f2d-4355-b9e9-0f2ab3b0246a {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:51:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-69a38a62-af61-496f-bc70-31434824b2cf tempest-CreateVolumesFromImageTest-1864121411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:51:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-69a38a62-af61-496f-bc70-31434824b2cf tempest-CreateVolumesFromImageTest-1864121411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:51:16 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-69a38a62-af61-496f-bc70-31434824b2cf tempest-CreateVolumesFromImageTest-1864121411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:51:16 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-69a38a62-af61-496f-bc70-31434824b2cf tempest-CreateVolumesFromImageTest-1864121411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:51:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-69a38a62-af61-496f-bc70-31434824b2cf tempest-CreateVolumesFromImageTest-1864121411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:51:16 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-69a38a62-af61-496f-bc70-31434824b2cf tempest-CreateVolumesFromImageTest-1864121411 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:51:16 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-69a38a62-af61-496f-bc70-31434824b2cf tempest-CreateVolumesFromImageTest-1864121411 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:51:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-69a38a62-af61-496f-bc70-31434824b2cf tempest-CreateVolumesFromImageTest-1864121411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2abb92cd-4f2d-4355-b9e9-0f2ab3b0246a 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:16 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6e76e729-a7a9-44e8-97c6-1559b503c4f9 tempest-CinderUnicodeTest-1242393573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30338fb9-aeb7-41cc-b7b9-2b199c55ff66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53e002ff-2432-4e4e-9310-be5023d7dc9f', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:16 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6e76e729-a7a9-44e8-97c6-1559b503c4f9 tempest-CinderUnicodeTest-1242393573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72157ab0-572a-450d-ade2-0a7a920666a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:16 devstack sudo[104413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2abb92cd-4f2d-4355-b9e9-0f2ab3b0246a 1073741824 Sep 18 21:51:16 devstack sudo[104413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-146cd7a6-b404-4d76-b251-a0bdc3b30ddd tempest-CreateVolumesFromSnapshotTest-248322392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:51:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-146cd7a6-b404-4d76-b251-a0bdc3b30ddd tempest-CreateVolumesFromSnapshotTest-248322392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:51:16 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-146cd7a6-b404-4d76-b251-a0bdc3b30ddd tempest-CreateVolumesFromSnapshotTest-248322392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:51:16 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-146cd7a6-b404-4d76-b251-a0bdc3b30ddd tempest-CreateVolumesFromSnapshotTest-248322392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:51:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-146cd7a6-b404-4d76-b251-a0bdc3b30ddd tempest-CreateVolumesFromSnapshotTest-248322392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:51:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-146cd7a6-b404-4d76-b251-a0bdc3b30ddd tempest-CreateVolumesFromSnapshotTest-248322392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:16 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-6e76e729-a7a9-44e8-97c6-1559b503c4f9 tempest-CinderUnicodeTest-1242393573 None] Volume volume-53e002ff-2432-4e4e-9310-be5023d7dc9f (53e002ff-2432-4e4e-9310-be5023d7dc9f): created successfully Sep 18 21:51:16 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6e76e729-a7a9-44e8-97c6-1559b503c4f9 tempest-CinderUnicodeTest-1242393573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72157ab0-572a-450d-ade2-0a7a920666a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:16 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6e76e729-a7a9-44e8-97c6-1559b503c4f9 tempest-CinderUnicodeTest-1242393573 None] Flow 'volume_create_manager' (8e3de95b-c537-4296-afc3-dd1fa672fbad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:51:16 devstack sudo[104415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:51:16 devstack sudo[104415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:16 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-6e76e729-a7a9-44e8-97c6-1559b503c4f9 tempest-CinderUnicodeTest-1242393573 None] Created volume successfully. Sep 18 21:51:16 devstack sudo[104415]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-146cd7a6-b404-4d76-b251-a0bdc3b30ddd tempest-CreateVolumesFromSnapshotTest-248322392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.326s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:16 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-146cd7a6-b404-4d76-b251-a0bdc3b30ddd tempest-CreateVolumesFromSnapshotTest-248322392 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:51:16 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-146cd7a6-b404-4d76-b251-a0bdc3b30ddd tempest-CreateVolumesFromSnapshotTest-248322392 None] Deleted volume successfully. Sep 18 21:51:16 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-146cd7a6-b404-4d76-b251-a0bdc3b30ddd tempest-CreateVolumesFromSnapshotTest-248322392 None] Lock "cinder-6d406132-402e-43b4-b31f-35e30f09a004-delete_volume" released by "delete_volume" :: held 1.821s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:51:16 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-0433ff57-db6b-4a24-b717-6959fcb52660 tempest-CreateVolumesFromImageTest-1864121411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:51:16 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-0433ff57-db6b-4a24-b717-6959fcb52660 tempest-CreateVolumesFromImageTest-1864121411 None] Flow 'volume_create_manager' (ad90f11a-50c2-45cf-9e2d-702c720dac38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:51:16 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-0433ff57-db6b-4a24-b717-6959fcb52660 tempest-CreateVolumesFromImageTest-1864121411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bd72621-b164-49a8-970a-6df91b5a88cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:16 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-0433ff57-db6b-4a24-b717-6959fcb52660 tempest-CreateVolumesFromImageTest-1864121411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bd72621-b164-49a8-970a-6df91b5a88cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:51:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2045266880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8aa87c6f-dcd6-4f9d-884b-2ef9c74cb100,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db4333441bc74b98ab3cf7d0e2a810f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:51:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:51:17Z,use_quota=True,user_id='7a110f349fa74887aaf9ede7e1c3302c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:16 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-0433ff57-db6b-4a24-b717-6959fcb52660 tempest-CreateVolumesFromImageTest-1864121411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3de0fe37-f8c3-4d69-ae46-45d07f8c708f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:16 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-0433ff57-db6b-4a24-b717-6959fcb52660 tempest-CreateVolumesFromImageTest-1864121411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3de0fe37-f8c3-4d69-ae46-45d07f8c708f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:16 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-0433ff57-db6b-4a24-b717-6959fcb52660 tempest-CreateVolumesFromImageTest-1864121411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (031be678-e736-4fe4-a0b2-89ac2fc03d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:16 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-0433ff57-db6b-4a24-b717-6959fcb52660 tempest-CreateVolumesFromImageTest-1864121411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (031be678-e736-4fe4-a0b2-89ac2fc03d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8aa87c6f-dcd6-4f9d-884b-2ef9c74cb100', 'volume_name': 'volume-8aa87c6f-dcd6-4f9d-884b-2ef9c74cb100', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:16 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-0433ff57-db6b-4a24-b717-6959fcb52660 tempest-CreateVolumesFromImageTest-1864121411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e70d2155-7724-47a5-adc8-beaeb07f91c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:16 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-0433ff57-db6b-4a24-b717-6959fcb52660 tempest-CreateVolumesFromImageTest-1864121411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e70d2155-7724-47a5-adc8-beaeb07f91c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:16 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-0433ff57-db6b-4a24-b717-6959fcb52660 tempest-CreateVolumesFromImageTest-1864121411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c87c340d-d119-451c-acdf-194e09afd5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:16 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-0433ff57-db6b-4a24-b717-6959fcb52660 tempest-CreateVolumesFromImageTest-1864121411 None] Volume 8aa87c6f-dcd6-4f9d-884b-2ef9c74cb100: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8aa87c6f-dcd6-4f9d-884b-2ef9c74cb100', 'volume_size': 1} Sep 18 21:51:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-0433ff57-db6b-4a24-b717-6959fcb52660 tempest-CreateVolumesFromImageTest-1864121411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:51:17 devstack sudo[104413]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-69a38a62-af61-496f-bc70-31434824b2cf tempest-CreateVolumesFromImageTest-1864121411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2abb92cd-4f2d-4355-b9e9-0f2ab3b0246a 1073741824" returned: 0 in 0.786s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:17 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-33820d9d-0f7a-48e7-b65e-5cb4c5f6d1cd tempest-CreateVolumesFromImageTest-1864121411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:51:17 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-33820d9d-0f7a-48e7-b65e-5cb4c5f6d1cd tempest-CreateVolumesFromImageTest-1864121411 None] Flow 'volume_create_manager' (237a8c3e-eed9-4a09-bf27-4b2183dd2f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:51:17 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-33820d9d-0f7a-48e7-b65e-5cb4c5f6d1cd tempest-CreateVolumesFromImageTest-1864121411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eb2d9a5-011d-443b-bb6b-5f62d4bc521e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-69a38a62-af61-496f-bc70-31434824b2cf tempest-CreateVolumesFromImageTest-1864121411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2abb92cd-4f2d-4355-b9e9-0f2ab3b0246a {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:17 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-33820d9d-0f7a-48e7-b65e-5cb4c5f6d1cd tempest-CreateVolumesFromImageTest-1864121411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eb2d9a5-011d-443b-bb6b-5f62d4bc521e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:51:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-377761298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e41793c-de88-48ad-867e-33f0dfa35359,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db4333441bc74b98ab3cf7d0e2a810f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:51:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:51:17Z,use_quota=True,user_id='7a110f349fa74887aaf9ede7e1c3302c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:17 devstack sudo[104422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2abb92cd-4f2d-4355-b9e9-0f2ab3b0246a Sep 18 21:51:17 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-33820d9d-0f7a-48e7-b65e-5cb4c5f6d1cd tempest-CreateVolumesFromImageTest-1864121411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d6d1fc8-6b46-4f59-88ee-0e870e3ab95a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:17 devstack sudo[104422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:17 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-33820d9d-0f7a-48e7-b65e-5cb4c5f6d1cd tempest-CreateVolumesFromImageTest-1864121411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d6d1fc8-6b46-4f59-88ee-0e870e3ab95a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:17 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-33820d9d-0f7a-48e7-b65e-5cb4c5f6d1cd tempest-CreateVolumesFromImageTest-1864121411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b0e090e-ca50-4fe4-9b5e-4265a0e693e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:17 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-33820d9d-0f7a-48e7-b65e-5cb4c5f6d1cd tempest-CreateVolumesFromImageTest-1864121411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b0e090e-ca50-4fe4-9b5e-4265a0e693e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e41793c-de88-48ad-867e-33f0dfa35359', 'volume_name': 'volume-9e41793c-de88-48ad-867e-33f0dfa35359', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:17 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-33820d9d-0f7a-48e7-b65e-5cb4c5f6d1cd tempest-CreateVolumesFromImageTest-1864121411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f50220f-376a-495c-a621-1020a12c3235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:17 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-33820d9d-0f7a-48e7-b65e-5cb4c5f6d1cd tempest-CreateVolumesFromImageTest-1864121411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f50220f-376a-495c-a621-1020a12c3235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:17 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-33820d9d-0f7a-48e7-b65e-5cb4c5f6d1cd tempest-CreateVolumesFromImageTest-1864121411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d569f87-da46-4215-9cad-7fa476844ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:17 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-33820d9d-0f7a-48e7-b65e-5cb4c5f6d1cd tempest-CreateVolumesFromImageTest-1864121411 None] Volume 9e41793c-de88-48ad-867e-33f0dfa35359: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e41793c-de88-48ad-867e-33f0dfa35359', 'volume_size': 1} Sep 18 21:51:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-33820d9d-0f7a-48e7-b65e-5cb4c5f6d1cd tempest-CreateVolumesFromImageTest-1864121411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:51:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-0674e1bb-90b8-4c29-8fb4-d6043d0a924e tempest-CinderUnicodeTest-1242393573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:51:17 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-ad9de653-9157-4960-bbea-242a607866dc tempest-CreateVolumesFromSnapshotTest-248322392 None] Acquiring lock "cinder-22d7bc9a-e85d-4189-8619-acc71a7c234d-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:51:17 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-ad9de653-9157-4960-bbea-242a607866dc tempest-CreateVolumesFromSnapshotTest-248322392 None] Lock "cinder-22d7bc9a-e85d-4189-8619-acc71a7c234d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:51:17 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-ad9de653-9157-4960-bbea-242a607866dc tempest-CreateVolumesFromSnapshotTest-248322392 None] Acquiring lock "cinder-quobyte-22d7bc9a-e85d-4189-8619-acc71a7c234d" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:51:17 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-ad9de653-9157-4960-bbea-242a607866dc tempest-CreateVolumesFromSnapshotTest-248322392 None] Lock "cinder-quobyte-22d7bc9a-e85d-4189-8619-acc71a7c234d" acquired by "delete_volume" :: waited 0.023s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:51:17 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[8165b7ea-c7ac-4c64-9d77-c9dcef8265a6]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:51:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ad9de653-9157-4960-bbea-242a607866dc tempest-CreateVolumesFromSnapshotTest-248322392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-22d7bc9a-e85d-4189-8619-acc71a7c234d {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:17 devstack sudo[104422]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-69a38a62-af61-496f-bc70-31434824b2cf tempest-CreateVolumesFromImageTest-1864121411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2abb92cd-4f2d-4355-b9e9-0f2ab3b0246a" returned: 0 in 0.495s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:17 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-69a38a62-af61-496f-bc70-31434824b2cf tempest-CreateVolumesFromImageTest-1864121411 None] <== create_volume: return (1399ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:51:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-69a38a62-af61-496f-bc70-31434824b2cf tempest-CreateVolumesFromImageTest-1864121411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.404s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:51:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-0433ff57-db6b-4a24-b717-6959fcb52660 tempest-CreateVolumesFromImageTest-1864121411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.812s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:51:17 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-0433ff57-db6b-4a24-b717-6959fcb52660 tempest-CreateVolumesFromImageTest-1864121411 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:51:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2045266880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8aa87c6f-dcd6-4f9d-884b-2ef9c74cb100,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db4333441bc74b98ab3cf7d0e2a810f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:51:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:51:17Z,use_quota=True,user_id='7a110f349fa74887aaf9ede7e1c3302c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:51:17 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-0433ff57-db6b-4a24-b717-6959fcb52660 tempest-CreateVolumesFromImageTest-1864121411 None] Creating volume 8aa87c6f-dcd6-4f9d-884b-2ef9c74cb100 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:51:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-0433ff57-db6b-4a24-b717-6959fcb52660 tempest-CreateVolumesFromImageTest-1864121411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:51:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-0433ff57-db6b-4a24-b717-6959fcb52660 tempest-CreateVolumesFromImageTest-1864121411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:51:17 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-0433ff57-db6b-4a24-b717-6959fcb52660 tempest-CreateVolumesFromImageTest-1864121411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:51:17 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-0433ff57-db6b-4a24-b717-6959fcb52660 tempest-CreateVolumesFromImageTest-1864121411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:51:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-0433ff57-db6b-4a24-b717-6959fcb52660 tempest-CreateVolumesFromImageTest-1864121411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:51:17 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-0433ff57-db6b-4a24-b717-6959fcb52660 tempest-CreateVolumesFromImageTest-1864121411 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:51:17 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-0433ff57-db6b-4a24-b717-6959fcb52660 tempest-CreateVolumesFromImageTest-1864121411 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:51:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0433ff57-db6b-4a24-b717-6959fcb52660 tempest-CreateVolumesFromImageTest-1864121411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-8aa87c6f-dcd6-4f9d-884b-2ef9c74cb100 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:17 devstack sudo[104426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-8aa87c6f-dcd6-4f9d-884b-2ef9c74cb100 1073741824 Sep 18 21:51:17 devstack sudo[104426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:17 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-69a38a62-af61-496f-bc70-31434824b2cf tempest-CreateVolumesFromImageTest-1864121411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0b6773a-f397-4036-9397-32b8d24f40bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2abb92cd-4f2d-4355-b9e9-0f2ab3b0246a', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:17 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-69a38a62-af61-496f-bc70-31434824b2cf tempest-CreateVolumesFromImageTest-1864121411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5033ff2b-c99d-43f2-8b5b-acecef02c9cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:17 devstack sudo[104425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-22d7bc9a-e85d-4189-8619-acc71a7c234d Sep 18 21:51:17 devstack sudo[104425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:17 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-69a38a62-af61-496f-bc70-31434824b2cf tempest-CreateVolumesFromImageTest-1864121411 None] Volume volume-2abb92cd-4f2d-4355-b9e9-0f2ab3b0246a (2abb92cd-4f2d-4355-b9e9-0f2ab3b0246a): created successfully Sep 18 21:51:17 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-69a38a62-af61-496f-bc70-31434824b2cf tempest-CreateVolumesFromImageTest-1864121411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5033ff2b-c99d-43f2-8b5b-acecef02c9cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:17 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-69a38a62-af61-496f-bc70-31434824b2cf tempest-CreateVolumesFromImageTest-1864121411 None] Flow 'volume_create_manager' (6de5ce46-9102-4585-8500-9a9b4220e26c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:51:17 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec76d21c-8df9-4526-b245-e20e6efb0b7a tempest-CreateVolumesFromImageTest-1864121411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:51:17 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ec76d21c-8df9-4526-b245-e20e6efb0b7a tempest-CreateVolumesFromImageTest-1864121411 None] Flow 'volume_create_manager' (064a8b14-0ad6-4b29-a4dd-06a6b6799e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:51:17 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ec76d21c-8df9-4526-b245-e20e6efb0b7a tempest-CreateVolumesFromImageTest-1864121411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dd022ba-1480-4bfe-853a-4e2a4e27fb3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:17 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-69a38a62-af61-496f-bc70-31434824b2cf tempest-CreateVolumesFromImageTest-1864121411 None] Created volume successfully. Sep 18 21:51:17 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ec76d21c-8df9-4526-b245-e20e6efb0b7a tempest-CreateVolumesFromImageTest-1864121411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dd022ba-1480-4bfe-853a-4e2a4e27fb3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:51:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-893117719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe6a79a8-4727-4792-bfbb-8dd00ebfc3c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db4333441bc74b98ab3cf7d0e2a810f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:51:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:51:18Z,use_quota=True,user_id='7a110f349fa74887aaf9ede7e1c3302c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:17 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ec76d21c-8df9-4526-b245-e20e6efb0b7a tempest-CreateVolumesFromImageTest-1864121411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b799e736-5e9b-4971-bd0b-84b65fab9417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:18 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ec76d21c-8df9-4526-b245-e20e6efb0b7a tempest-CreateVolumesFromImageTest-1864121411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b799e736-5e9b-4971-bd0b-84b65fab9417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:18 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ec76d21c-8df9-4526-b245-e20e6efb0b7a tempest-CreateVolumesFromImageTest-1864121411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77950e95-cd81-4d3f-b383-e68d42b7775d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:18 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ec76d21c-8df9-4526-b245-e20e6efb0b7a tempest-CreateVolumesFromImageTest-1864121411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77950e95-cd81-4d3f-b383-e68d42b7775d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe6a79a8-4727-4792-bfbb-8dd00ebfc3c8', 'volume_name': 'volume-fe6a79a8-4727-4792-bfbb-8dd00ebfc3c8', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:18 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ec76d21c-8df9-4526-b245-e20e6efb0b7a tempest-CreateVolumesFromImageTest-1864121411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fcbe182-2bc9-4c46-ade0-97adc039d6b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:18 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ec76d21c-8df9-4526-b245-e20e6efb0b7a tempest-CreateVolumesFromImageTest-1864121411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fcbe182-2bc9-4c46-ade0-97adc039d6b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:18 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ec76d21c-8df9-4526-b245-e20e6efb0b7a tempest-CreateVolumesFromImageTest-1864121411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fffe3e5c-6ead-452d-9f5d-7b36234c51a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:18 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-ec76d21c-8df9-4526-b245-e20e6efb0b7a tempest-CreateVolumesFromImageTest-1864121411 None] Volume fe6a79a8-4727-4792-bfbb-8dd00ebfc3c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe6a79a8-4727-4792-bfbb-8dd00ebfc3c8', 'volume_size': 1} Sep 18 21:51:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-ec76d21c-8df9-4526-b245-e20e6efb0b7a tempest-CreateVolumesFromImageTest-1864121411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:51:18 devstack sudo[104425]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ad9de653-9157-4960-bbea-242a607866dc tempest-CreateVolumesFromSnapshotTest-248322392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-22d7bc9a-e85d-4189-8619-acc71a7c234d" returned: 0 in 0.615s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ad9de653-9157-4960-bbea-242a607866dc tempest-CreateVolumesFromSnapshotTest-248322392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-22d7bc9a-e85d-4189-8619-acc71a7c234d {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:18 devstack sudo[104436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-22d7bc9a-e85d-4189-8619-acc71a7c234d Sep 18 21:51:18 devstack sudo[104436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:18 devstack sudo[104426]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0433ff57-db6b-4a24-b717-6959fcb52660 tempest-CreateVolumesFromImageTest-1864121411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-8aa87c6f-dcd6-4f9d-884b-2ef9c74cb100 1073741824" returned: 0 in 0.621s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:18 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e6e7904-dd37-4640-b2e9-21b13870a515 tempest-CreateVolumesFromImageTest-1864121411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:51:18 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6e6e7904-dd37-4640-b2e9-21b13870a515 tempest-CreateVolumesFromImageTest-1864121411 None] Flow 'volume_create_manager' (e02d4ce9-dee2-4db4-8ea8-2b5bcc0a4f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:51:18 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6e6e7904-dd37-4640-b2e9-21b13870a515 tempest-CreateVolumesFromImageTest-1864121411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f464e40-a28b-40ed-97b1-9e4e6a8faa56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0433ff57-db6b-4a24-b717-6959fcb52660 tempest-CreateVolumesFromImageTest-1864121411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-8aa87c6f-dcd6-4f9d-884b-2ef9c74cb100 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:18 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6e6e7904-dd37-4640-b2e9-21b13870a515 tempest-CreateVolumesFromImageTest-1864121411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f464e40-a28b-40ed-97b1-9e4e6a8faa56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:51:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1339349183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1275f311-b80d-4a15-850a-336bce223ce1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db4333441bc74b98ab3cf7d0e2a810f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:51:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:51:18Z,use_quota=True,user_id='7a110f349fa74887aaf9ede7e1c3302c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:18 devstack sudo[104438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-8aa87c6f-dcd6-4f9d-884b-2ef9c74cb100 Sep 18 21:51:18 devstack sudo[104438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:18 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6e6e7904-dd37-4640-b2e9-21b13870a515 tempest-CreateVolumesFromImageTest-1864121411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19470c7a-e396-48dd-be81-cf8b877633bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:18 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6e6e7904-dd37-4640-b2e9-21b13870a515 tempest-CreateVolumesFromImageTest-1864121411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19470c7a-e396-48dd-be81-cf8b877633bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:18 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6e6e7904-dd37-4640-b2e9-21b13870a515 tempest-CreateVolumesFromImageTest-1864121411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bbdced1-e674-4f67-b0e8-3a1f7f67d2e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:18 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6e6e7904-dd37-4640-b2e9-21b13870a515 tempest-CreateVolumesFromImageTest-1864121411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bbdced1-e674-4f67-b0e8-3a1f7f67d2e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1275f311-b80d-4a15-850a-336bce223ce1', 'volume_name': 'volume-1275f311-b80d-4a15-850a-336bce223ce1', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:18 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6e6e7904-dd37-4640-b2e9-21b13870a515 tempest-CreateVolumesFromImageTest-1864121411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c986eba0-b580-4206-a943-b389f6736d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:18 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6e6e7904-dd37-4640-b2e9-21b13870a515 tempest-CreateVolumesFromImageTest-1864121411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c986eba0-b580-4206-a943-b389f6736d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:18 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6e6e7904-dd37-4640-b2e9-21b13870a515 tempest-CreateVolumesFromImageTest-1864121411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (503f4356-a064-419c-8be3-8dc9328f6710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:18 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-6e6e7904-dd37-4640-b2e9-21b13870a515 tempest-CreateVolumesFromImageTest-1864121411 None] Volume 1275f311-b80d-4a15-850a-336bce223ce1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1275f311-b80d-4a15-850a-336bce223ce1', 'volume_size': 1} Sep 18 21:51:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6e6e7904-dd37-4640-b2e9-21b13870a515 tempest-CreateVolumesFromImageTest-1864121411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:51:18 devstack sudo[104436]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ad9de653-9157-4960-bbea-242a607866dc tempest-CreateVolumesFromSnapshotTest-248322392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-22d7bc9a-e85d-4189-8619-acc71a7c234d" returned: 0 in 0.310s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:18 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-ad9de653-9157-4960-bbea-242a607866dc tempest-CreateVolumesFromSnapshotTest-248322392 None] Lock "cinder-quobyte-22d7bc9a-e85d-4189-8619-acc71a7c234d" released by "delete_volume" :: held 0.983s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:51:18 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-ad9de653-9157-4960-bbea-242a607866dc tempest-CreateVolumesFromSnapshotTest-248322392 None] Created reservations ['ceafa245-7f52-42de-9832-56062370da30', 'ff0c8344-7f0a-43cc-bebf-e854141f1236', '161495c0-0785-4d55-aef4-8aa6b3263616', '65161201-6c70-4604-b2ec-63c76633af7f'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:51:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-ad9de653-9157-4960-bbea-242a607866dc tempest-CreateVolumesFromSnapshotTest-248322392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:51:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-ad9de653-9157-4960-bbea-242a607866dc tempest-CreateVolumesFromSnapshotTest-248322392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:51:18 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-ad9de653-9157-4960-bbea-242a607866dc tempest-CreateVolumesFromSnapshotTest-248322392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:51:18 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-ad9de653-9157-4960-bbea-242a607866dc tempest-CreateVolumesFromSnapshotTest-248322392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:51:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-ad9de653-9157-4960-bbea-242a607866dc tempest-CreateVolumesFromSnapshotTest-248322392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:51:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ad9de653-9157-4960-bbea-242a607866dc tempest-CreateVolumesFromSnapshotTest-248322392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:18 devstack sudo[104438]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0433ff57-db6b-4a24-b717-6959fcb52660 tempest-CreateVolumesFromImageTest-1864121411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-8aa87c6f-dcd6-4f9d-884b-2ef9c74cb100" returned: 0 in 0.364s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:18 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-0433ff57-db6b-4a24-b717-6959fcb52660 tempest-CreateVolumesFromImageTest-1864121411 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:51:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-0433ff57-db6b-4a24-b717-6959fcb52660 tempest-CreateVolumesFromImageTest-1864121411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:51:18 devstack sudo[104442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:51:18 devstack sudo[104442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-33820d9d-0f7a-48e7-b65e-5cb4c5f6d1cd tempest-CreateVolumesFromImageTest-1864121411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.515s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:51:18 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-33820d9d-0f7a-48e7-b65e-5cb4c5f6d1cd tempest-CreateVolumesFromImageTest-1864121411 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:51:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-377761298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e41793c-de88-48ad-867e-33f0dfa35359,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db4333441bc74b98ab3cf7d0e2a810f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:51:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:51:17Z,use_quota=True,user_id='7a110f349fa74887aaf9ede7e1c3302c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:51:18 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-33820d9d-0f7a-48e7-b65e-5cb4c5f6d1cd tempest-CreateVolumesFromImageTest-1864121411 None] Creating volume 9e41793c-de88-48ad-867e-33f0dfa35359 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:51:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-33820d9d-0f7a-48e7-b65e-5cb4c5f6d1cd tempest-CreateVolumesFromImageTest-1864121411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:51:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-33820d9d-0f7a-48e7-b65e-5cb4c5f6d1cd tempest-CreateVolumesFromImageTest-1864121411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:51:18 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-33820d9d-0f7a-48e7-b65e-5cb4c5f6d1cd tempest-CreateVolumesFromImageTest-1864121411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:51:18 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-33820d9d-0f7a-48e7-b65e-5cb4c5f6d1cd tempest-CreateVolumesFromImageTest-1864121411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:51:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-33820d9d-0f7a-48e7-b65e-5cb4c5f6d1cd tempest-CreateVolumesFromImageTest-1864121411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:51:18 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-33820d9d-0f7a-48e7-b65e-5cb4c5f6d1cd tempest-CreateVolumesFromImageTest-1864121411 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:51:18 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-33820d9d-0f7a-48e7-b65e-5cb4c5f6d1cd tempest-CreateVolumesFromImageTest-1864121411 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:51:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-33820d9d-0f7a-48e7-b65e-5cb4c5f6d1cd tempest-CreateVolumesFromImageTest-1864121411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9e41793c-de88-48ad-867e-33f0dfa35359 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:18 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-0433ff57-db6b-4a24-b717-6959fcb52660 tempest-CreateVolumesFromImageTest-1864121411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c87c340d-d119-451c-acdf-194e09afd5d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8aa87c6f-dcd6-4f9d-884b-2ef9c74cb100', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:18 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-0433ff57-db6b-4a24-b717-6959fcb52660 tempest-CreateVolumesFromImageTest-1864121411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7daa375-5e80-4b54-9927-86bae79bfa45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:18 devstack sudo[104444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9e41793c-de88-48ad-867e-33f0dfa35359 1073741824 Sep 18 21:51:18 devstack sudo[104444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:18 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-0433ff57-db6b-4a24-b717-6959fcb52660 tempest-CreateVolumesFromImageTest-1864121411 None] Volume volume-8aa87c6f-dcd6-4f9d-884b-2ef9c74cb100 (8aa87c6f-dcd6-4f9d-884b-2ef9c74cb100): created successfully Sep 18 21:51:18 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-0433ff57-db6b-4a24-b717-6959fcb52660 tempest-CreateVolumesFromImageTest-1864121411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7daa375-5e80-4b54-9927-86bae79bfa45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:18 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-0433ff57-db6b-4a24-b717-6959fcb52660 tempest-CreateVolumesFromImageTest-1864121411 None] Flow 'volume_create_manager' (ad90f11a-50c2-45cf-9e2d-702c720dac38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:51:18 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-0433ff57-db6b-4a24-b717-6959fcb52660 tempest-CreateVolumesFromImageTest-1864121411 None] Created volume successfully. Sep 18 21:51:19 devstack sudo[104442]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:19 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ad9de653-9157-4960-bbea-242a607866dc tempest-CreateVolumesFromSnapshotTest-248322392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.274s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:19 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-ad9de653-9157-4960-bbea-242a607866dc tempest-CreateVolumesFromSnapshotTest-248322392 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:51:19 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-ad9de653-9157-4960-bbea-242a607866dc tempest-CreateVolumesFromSnapshotTest-248322392 None] Deleted volume successfully. Sep 18 21:51:19 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-ad9de653-9157-4960-bbea-242a607866dc tempest-CreateVolumesFromSnapshotTest-248322392 None] Lock "cinder-22d7bc9a-e85d-4189-8619-acc71a7c234d-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:51:19 devstack sudo[104444]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:19 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-33820d9d-0f7a-48e7-b65e-5cb4c5f6d1cd tempest-CreateVolumesFromImageTest-1864121411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9e41793c-de88-48ad-867e-33f0dfa35359 1073741824" returned: 0 in 0.435s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:19 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-33820d9d-0f7a-48e7-b65e-5cb4c5f6d1cd tempest-CreateVolumesFromImageTest-1864121411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9e41793c-de88-48ad-867e-33f0dfa35359 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:19 devstack sudo[104450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9e41793c-de88-48ad-867e-33f0dfa35359 Sep 18 21:51:19 devstack sudo[104450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:19 devstack sudo[104450]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:19 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-33820d9d-0f7a-48e7-b65e-5cb4c5f6d1cd tempest-CreateVolumesFromImageTest-1864121411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9e41793c-de88-48ad-867e-33f0dfa35359" returned: 0 in 0.251s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:19 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-33820d9d-0f7a-48e7-b65e-5cb4c5f6d1cd tempest-CreateVolumesFromImageTest-1864121411 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:51:19 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-33820d9d-0f7a-48e7-b65e-5cb4c5f6d1cd tempest-CreateVolumesFromImageTest-1864121411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:51:19 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-0674e1bb-90b8-4c29-8fb4-d6043d0a924e tempest-CinderUnicodeTest-1242393573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.091s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:51:19 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-33820d9d-0f7a-48e7-b65e-5cb4c5f6d1cd tempest-CreateVolumesFromImageTest-1864121411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d569f87-da46-4215-9cad-7fa476844ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e41793c-de88-48ad-867e-33f0dfa35359', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:19 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-33820d9d-0f7a-48e7-b65e-5cb4c5f6d1cd tempest-CreateVolumesFromImageTest-1864121411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acf343df-c5fe-47e3-8650-1de9716edd1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:19 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-0674e1bb-90b8-4c29-8fb4-d6043d0a924e tempest-CinderUnicodeTest-1242393573 None] Creating offline snapshot e507ec0f-192f-43bb-97ef-32ea6666f341 of volume 53e002ff-2432-4e4e-9310-be5023d7dc9f {{(pid=86136) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 21:51:19 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-33820d9d-0f7a-48e7-b65e-5cb4c5f6d1cd tempest-CreateVolumesFromImageTest-1864121411 None] Volume volume-9e41793c-de88-48ad-867e-33f0dfa35359 (9e41793c-de88-48ad-867e-33f0dfa35359): created successfully Sep 18 21:51:19 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-33820d9d-0f7a-48e7-b65e-5cb4c5f6d1cd tempest-CreateVolumesFromImageTest-1864121411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acf343df-c5fe-47e3-8650-1de9716edd1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:19 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-33820d9d-0f7a-48e7-b65e-5cb4c5f6d1cd tempest-CreateVolumesFromImageTest-1864121411 None] Flow 'volume_create_manager' (237a8c3e-eed9-4a09-bf27-4b2183dd2f62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:51:19 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[440f974a-e1d6-425a-9228-5b4bd3f30b3a]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:51:19 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0674e1bb-90b8-4c29-8fb4-d6043d0a924e tempest-CinderUnicodeTest-1242393573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-53e002ff-2432-4e4e-9310-be5023d7dc9f {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:19 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-33820d9d-0f7a-48e7-b65e-5cb4c5f6d1cd tempest-CreateVolumesFromImageTest-1864121411 None] Created volume successfully. Sep 18 21:51:19 devstack sudo[104453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-53e002ff-2432-4e4e-9310-be5023d7dc9f Sep 18 21:51:19 devstack sudo[104453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:19 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-f4edef68-e9ef-48fb-b0e9-34849baaefba tempest-CreateVolumesFromSnapshotTest-248322392 None] Acquiring lock "cinder-85fae045-bbd9-456d-9d07-5b0bfeeea7d0-delete_snapshot" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:51:19 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-f4edef68-e9ef-48fb-b0e9-34849baaefba tempest-CreateVolumesFromSnapshotTest-248322392 None] Lock "cinder-85fae045-bbd9-456d-9d07-5b0bfeeea7d0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:51:19 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-f4edef68-e9ef-48fb-b0e9-34849baaefba tempest-CreateVolumesFromSnapshotTest-248322392 None] Acquiring lock "cinder-quobyte-647dda22-4632-4787-8372-5fd9f5c1d986" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:51:19 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-f4edef68-e9ef-48fb-b0e9-34849baaefba tempest-CreateVolumesFromSnapshotTest-248322392 None] Lock "cinder-quobyte-647dda22-4632-4787-8372-5fd9f5c1d986" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:51:19 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-f4edef68-e9ef-48fb-b0e9-34849baaefba tempest-CreateVolumesFromSnapshotTest-248322392 None] Acquiring lock "cinder-quobyte-85fae045-bbd9-456d-9d07-5b0bfeeea7d0" by "_delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:51:19 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-f4edef68-e9ef-48fb-b0e9-34849baaefba tempest-CreateVolumesFromSnapshotTest-248322392 None] Lock "cinder-quobyte-85fae045-bbd9-456d-9d07-5b0bfeeea7d0" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:51:19 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-f4edef68-e9ef-48fb-b0e9-34849baaefba tempest-CreateVolumesFromSnapshotTest-248322392 None] Deleting offline snapshot 85fae045-bbd9-456d-9d07-5b0bfeeea7d0 of volume 647dda22-4632-4787-8372-5fd9f5c1d986 {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 21:51:19 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-f4edef68-e9ef-48fb-b0e9-34849baaefba tempest-CreateVolumesFromSnapshotTest-248322392 None] snapshot_file for this snap is: volume-647dda22-4632-4787-8372-5fd9f5c1d986.85fae045-bbd9-456d-9d07-5b0bfeeea7d0 {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 21:51:19 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb616ad9-f72c-4ef8-ab87-540bef8c4fb3]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:51:19 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f4edef68-e9ef-48fb-b0e9-34849baaefba tempest-CreateVolumesFromSnapshotTest-248322392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-647dda22-4632-4787-8372-5fd9f5c1d986.85fae045-bbd9-456d-9d07-5b0bfeeea7d0 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:19 devstack sudo[104453]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:19 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0674e1bb-90b8-4c29-8fb4-d6043d0a924e tempest-CinderUnicodeTest-1242393573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-53e002ff-2432-4e4e-9310-be5023d7dc9f" returned: 0 in 0.396s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:19 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0674e1bb-90b8-4c29-8fb4-d6043d0a924e tempest-CinderUnicodeTest-1242393573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-53e002ff-2432-4e4e-9310-be5023d7dc9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-53e002ff-2432-4e4e-9310-be5023d7dc9f.e507ec0f-192f-43bb-97ef-32ea6666f341 1G {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:19 devstack sudo[104455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-647dda22-4632-4787-8372-5fd9f5c1d986.85fae045-bbd9-456d-9d07-5b0bfeeea7d0 Sep 18 21:51:20 devstack sudo[104455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:20 devstack sudo[104459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-53e002ff-2432-4e4e-9310-be5023d7dc9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-53e002ff-2432-4e4e-9310-be5023d7dc9f.e507ec0f-192f-43bb-97ef-32ea6666f341 1G Sep 18 21:51:20 devstack sudo[104459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:20 devstack sudo[104455]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:20 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f4edef68-e9ef-48fb-b0e9-34849baaefba tempest-CreateVolumesFromSnapshotTest-248322392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-647dda22-4632-4787-8372-5fd9f5c1d986.85fae045-bbd9-456d-9d07-5b0bfeeea7d0" returned: 0 in 0.439s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:20 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-f4edef68-e9ef-48fb-b0e9-34849baaefba tempest-CreateVolumesFromSnapshotTest-248322392 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-647dda22-4632-4787-8372-5fd9f5c1d986(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86136) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 21:51:20 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d43ff4-8317-4813-9587-6d61ffc0c40f]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:51:20 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f4edef68-e9ef-48fb-b0e9-34849baaefba tempest-CreateVolumesFromSnapshotTest-248322392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-647dda22-4632-4787-8372-5fd9f5c1d986 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:20 devstack sudo[104459]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:20 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0674e1bb-90b8-4c29-8fb4-d6043d0a924e tempest-CinderUnicodeTest-1242393573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-53e002ff-2432-4e4e-9310-be5023d7dc9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-53e002ff-2432-4e4e-9310-be5023d7dc9f.e507ec0f-192f-43bb-97ef-32ea6666f341 1G" returned: 0 in 0.455s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:20 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0674e1bb-90b8-4c29-8fb4-d6043d0a924e tempest-CinderUnicodeTest-1242393573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53e002ff-2432-4e4e-9310-be5023d7dc9f -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-53e002ff-2432-4e4e-9310-be5023d7dc9f.e507ec0f-192f-43bb-97ef-32ea6666f341 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:20 devstack sudo[104468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-647dda22-4632-4787-8372-5fd9f5c1d986 Sep 18 21:51:20 devstack sudo[104468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:20 devstack sudo[104469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53e002ff-2432-4e4e-9310-be5023d7dc9f -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-53e002ff-2432-4e4e-9310-be5023d7dc9f.e507ec0f-192f-43bb-97ef-32ea6666f341 Sep 18 21:51:20 devstack sudo[104469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:20 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f4edef68-e9ef-48fb-b0e9-34849baaefba tempest-CreateVolumesFromSnapshotTest-248322392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-647dda22-4632-4787-8372-5fd9f5c1d986" returned: 0 in 0.427s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:20 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f4edef68-e9ef-48fb-b0e9-34849baaefba tempest-CreateVolumesFromSnapshotTest-248322392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-647dda22-4632-4787-8372-5fd9f5c1d986.85fae045-bbd9-456d-9d07-5b0bfeeea7d0 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:20 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0674e1bb-90b8-4c29-8fb4-d6043d0a924e tempest-CinderUnicodeTest-1242393573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53e002ff-2432-4e4e-9310-be5023d7dc9f -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-53e002ff-2432-4e4e-9310-be5023d7dc9f.e507ec0f-192f-43bb-97ef-32ea6666f341" returned: 0 in 0.352s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:20 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-0674e1bb-90b8-4c29-8fb4-d6043d0a924e tempest-CinderUnicodeTest-1242393573 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-53e002ff-2432-4e4e-9310-be5023d7dc9f.e507ec0f-192f-43bb-97ef-32ea6666f341 is being set with open permissions: ugo+rw Sep 18 21:51:20 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0674e1bb-90b8-4c29-8fb4-d6043d0a924e tempest-CinderUnicodeTest-1242393573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-53e002ff-2432-4e4e-9310-be5023d7dc9f.e507ec0f-192f-43bb-97ef-32ea6666f341 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:20 devstack sudo[104468]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:20 devstack sudo[104469]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:20 devstack sudo[104479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-647dda22-4632-4787-8372-5fd9f5c1d986.85fae045-bbd9-456d-9d07-5b0bfeeea7d0 Sep 18 21:51:20 devstack sudo[104479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:20 devstack sudo[104482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-53e002ff-2432-4e4e-9310-be5023d7dc9f.e507ec0f-192f-43bb-97ef-32ea6666f341 Sep 18 21:51:20 devstack sudo[104482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:21 devstack sudo[104482]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0674e1bb-90b8-4c29-8fb4-d6043d0a924e tempest-CinderUnicodeTest-1242393573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-53e002ff-2432-4e4e-9310-be5023d7dc9f.e507ec0f-192f-43bb-97ef-32ea6666f341" returned: 0 in 0.273s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0674e1bb-90b8-4c29-8fb4-d6043d0a924e tempest-CinderUnicodeTest-1242393573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-53e002ff-2432-4e4e-9310-be5023d7dc9f.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:21 devstack sudo[104490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-53e002ff-2432-4e4e-9310-be5023d7dc9f.info Sep 18 21:51:21 devstack sudo[104490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:21 devstack sudo[104479]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f4edef68-e9ef-48fb-b0e9-34849baaefba tempest-CreateVolumesFromSnapshotTest-248322392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-647dda22-4632-4787-8372-5fd9f5c1d986.85fae045-bbd9-456d-9d07-5b0bfeeea7d0" returned: 0 in 0.431s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f4edef68-e9ef-48fb-b0e9-34849baaefba tempest-CreateVolumesFromSnapshotTest-248322392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-647dda22-4632-4787-8372-5fd9f5c1d986.85fae045-bbd9-456d-9d07-5b0bfeeea7d0 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:21 devstack sudo[104492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-647dda22-4632-4787-8372-5fd9f5c1d986.85fae045-bbd9-456d-9d07-5b0bfeeea7d0 Sep 18 21:51:21 devstack sudo[104492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:21 devstack sudo[104490]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0674e1bb-90b8-4c29-8fb4-d6043d0a924e tempest-CinderUnicodeTest-1242393573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-53e002ff-2432-4e4e-9310-be5023d7dc9f.info" returned: 0 in 0.282s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:21 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-0674e1bb-90b8-4c29-8fb4-d6043d0a924e tempest-CinderUnicodeTest-1242393573 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-53e002ff-2432-4e4e-9310-be5023d7dc9f.info is being set with open permissions: ugo+rw Sep 18 21:51:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0674e1bb-90b8-4c29-8fb4-d6043d0a924e tempest-CinderUnicodeTest-1242393573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-53e002ff-2432-4e4e-9310-be5023d7dc9f.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:21 devstack sudo[104496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-53e002ff-2432-4e4e-9310-be5023d7dc9f.info Sep 18 21:51:21 devstack sudo[104496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:21 devstack sudo[104492]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f4edef68-e9ef-48fb-b0e9-34849baaefba tempest-CreateVolumesFromSnapshotTest-248322392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-647dda22-4632-4787-8372-5fd9f5c1d986.85fae045-bbd9-456d-9d07-5b0bfeeea7d0" returned: 0 in 0.251s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:21 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-f4edef68-e9ef-48fb-b0e9-34849baaefba tempest-CreateVolumesFromSnapshotTest-248322392 None] Lock "cinder-quobyte-85fae045-bbd9-456d-9d07-5b0bfeeea7d0" released by "_delete_snapshot" :: held 1.683s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:51:21 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-f4edef68-e9ef-48fb-b0e9-34849baaefba tempest-CreateVolumesFromSnapshotTest-248322392 None] Lock "cinder-quobyte-647dda22-4632-4787-8372-5fd9f5c1d986" released by "delete_snapshot" :: held 1.710s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:51:21 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-f4edef68-e9ef-48fb-b0e9-34849baaefba tempest-CreateVolumesFromSnapshotTest-248322392 None] Created reservations ['79a879a5-bf2d-49c3-869c-df183f4eeecf', '7c15b2a0-8383-4812-9dc6-ecaebfb9f2bc', 'ecbf5fac-5d17-4312-bfbc-d32709905233', '6bbcbd18-6547-409d-9020-53bfb57c9e1e'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:51:21 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-f4edef68-e9ef-48fb-b0e9-34849baaefba tempest-CreateVolumesFromSnapshotTest-248322392 None] Delete snapshot completed successfully. Sep 18 21:51:21 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-f4edef68-e9ef-48fb-b0e9-34849baaefba tempest-CreateVolumesFromSnapshotTest-248322392 None] Lock "cinder-85fae045-bbd9-456d-9d07-5b0bfeeea7d0-delete_snapshot" released by "delete_snapshot" :: held 1.932s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:51:21 devstack sudo[104496]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0674e1bb-90b8-4c29-8fb4-d6043d0a924e tempest-CinderUnicodeTest-1242393573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-53e002ff-2432-4e4e-9310-be5023d7dc9f.info" returned: 0 in 0.307s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-0674e1bb-90b8-4c29-8fb4-d6043d0a924e tempest-CinderUnicodeTest-1242393573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.208s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:51:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-ec76d21c-8df9-4526-b245-e20e6efb0b7a tempest-CreateVolumesFromImageTest-1864121411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.693s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:51:21 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-ec76d21c-8df9-4526-b245-e20e6efb0b7a tempest-CreateVolumesFromImageTest-1864121411 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:51:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-893117719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe6a79a8-4727-4792-bfbb-8dd00ebfc3c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db4333441bc74b98ab3cf7d0e2a810f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:51:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:51:18Z,use_quota=True,user_id='7a110f349fa74887aaf9ede7e1c3302c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:51:21 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-ec76d21c-8df9-4526-b245-e20e6efb0b7a tempest-CreateVolumesFromImageTest-1864121411 None] Creating volume fe6a79a8-4727-4792-bfbb-8dd00ebfc3c8 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:51:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-ec76d21c-8df9-4526-b245-e20e6efb0b7a tempest-CreateVolumesFromImageTest-1864121411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:51:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-ec76d21c-8df9-4526-b245-e20e6efb0b7a tempest-CreateVolumesFromImageTest-1864121411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:51:21 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-ec76d21c-8df9-4526-b245-e20e6efb0b7a tempest-CreateVolumesFromImageTest-1864121411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:51:21 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-ec76d21c-8df9-4526-b245-e20e6efb0b7a tempest-CreateVolumesFromImageTest-1864121411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:51:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-ec76d21c-8df9-4526-b245-e20e6efb0b7a tempest-CreateVolumesFromImageTest-1864121411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:51:21 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-ec76d21c-8df9-4526-b245-e20e6efb0b7a tempest-CreateVolumesFromImageTest-1864121411 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:51:21 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-ec76d21c-8df9-4526-b245-e20e6efb0b7a tempest-CreateVolumesFromImageTest-1864121411 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:51:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ec76d21c-8df9-4526-b245-e20e6efb0b7a tempest-CreateVolumesFromImageTest-1864121411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fe6a79a8-4727-4792-bfbb-8dd00ebfc3c8 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:21 devstack sudo[104499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fe6a79a8-4727-4792-bfbb-8dd00ebfc3c8 1073741824 Sep 18 21:51:21 devstack sudo[104499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:21 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-0674e1bb-90b8-4c29-8fb4-d6043d0a924e tempest-CinderUnicodeTest-1242393573 None] Create snapshot completed successfully Sep 18 21:51:21 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-bfda5720-860a-412e-8776-7154a1df7e61 tempest-CreateVolumesFromSnapshotTest-248322392 None] Acquiring lock "cinder-647dda22-4632-4787-8372-5fd9f5c1d986-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:51:21 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-bfda5720-860a-412e-8776-7154a1df7e61 tempest-CreateVolumesFromSnapshotTest-248322392 None] Lock "cinder-647dda22-4632-4787-8372-5fd9f5c1d986-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:51:22 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-bfda5720-860a-412e-8776-7154a1df7e61 tempest-CreateVolumesFromSnapshotTest-248322392 None] Acquiring lock "cinder-quobyte-647dda22-4632-4787-8372-5fd9f5c1d986" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:51:22 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-bfda5720-860a-412e-8776-7154a1df7e61 tempest-CreateVolumesFromSnapshotTest-248322392 None] Lock "cinder-quobyte-647dda22-4632-4787-8372-5fd9f5c1d986" acquired by "delete_volume" :: waited 0.017s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:51:22 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e70e9da-45cd-48fa-84c6-e779c400c4cc]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:51:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-bfda5720-860a-412e-8776-7154a1df7e61 tempest-CreateVolumesFromSnapshotTest-248322392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-647dda22-4632-4787-8372-5fd9f5c1d986 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:22 devstack sudo[104504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-647dda22-4632-4787-8372-5fd9f5c1d986 Sep 18 21:51:22 devstack sudo[104504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:22 devstack sudo[104499]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ec76d21c-8df9-4526-b245-e20e6efb0b7a tempest-CreateVolumesFromImageTest-1864121411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fe6a79a8-4727-4792-bfbb-8dd00ebfc3c8 1073741824" returned: 0 in 0.562s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ec76d21c-8df9-4526-b245-e20e6efb0b7a tempest-CreateVolumesFromImageTest-1864121411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fe6a79a8-4727-4792-bfbb-8dd00ebfc3c8 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:22 devstack sudo[104507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fe6a79a8-4727-4792-bfbb-8dd00ebfc3c8 Sep 18 21:51:22 devstack sudo[104507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:22 devstack sudo[104504]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-bfda5720-860a-412e-8776-7154a1df7e61 tempest-CreateVolumesFromSnapshotTest-248322392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-647dda22-4632-4787-8372-5fd9f5c1d986" returned: 0 in 0.405s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-bfda5720-860a-412e-8776-7154a1df7e61 tempest-CreateVolumesFromSnapshotTest-248322392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-647dda22-4632-4787-8372-5fd9f5c1d986 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:22 devstack sudo[104512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-647dda22-4632-4787-8372-5fd9f5c1d986 Sep 18 21:51:22 devstack sudo[104512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:22 devstack sudo[104507]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ec76d21c-8df9-4526-b245-e20e6efb0b7a tempest-CreateVolumesFromImageTest-1864121411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fe6a79a8-4727-4792-bfbb-8dd00ebfc3c8" returned: 0 in 0.353s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:22 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-ec76d21c-8df9-4526-b245-e20e6efb0b7a tempest-CreateVolumesFromImageTest-1864121411 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:51:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-ec76d21c-8df9-4526-b245-e20e6efb0b7a tempest-CreateVolumesFromImageTest-1864121411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:51:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6e6e7904-dd37-4640-b2e9-21b13870a515 tempest-CreateVolumesFromImageTest-1864121411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.200s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:51:22 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-6e6e7904-dd37-4640-b2e9-21b13870a515 tempest-CreateVolumesFromImageTest-1864121411 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:51:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1339349183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1275f311-b80d-4a15-850a-336bce223ce1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db4333441bc74b98ab3cf7d0e2a810f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:51:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:51:18Z,use_quota=True,user_id='7a110f349fa74887aaf9ede7e1c3302c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:51:22 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-6e6e7904-dd37-4640-b2e9-21b13870a515 tempest-CreateVolumesFromImageTest-1864121411 None] Creating volume 1275f311-b80d-4a15-850a-336bce223ce1 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:51:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6e6e7904-dd37-4640-b2e9-21b13870a515 tempest-CreateVolumesFromImageTest-1864121411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:51:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6e6e7904-dd37-4640-b2e9-21b13870a515 tempest-CreateVolumesFromImageTest-1864121411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:51:22 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-6e6e7904-dd37-4640-b2e9-21b13870a515 tempest-CreateVolumesFromImageTest-1864121411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:51:22 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-6e6e7904-dd37-4640-b2e9-21b13870a515 tempest-CreateVolumesFromImageTest-1864121411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:51:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6e6e7904-dd37-4640-b2e9-21b13870a515 tempest-CreateVolumesFromImageTest-1864121411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:51:22 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-6e6e7904-dd37-4640-b2e9-21b13870a515 tempest-CreateVolumesFromImageTest-1864121411 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:51:22 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-6e6e7904-dd37-4640-b2e9-21b13870a515 tempest-CreateVolumesFromImageTest-1864121411 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:51:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6e6e7904-dd37-4640-b2e9-21b13870a515 tempest-CreateVolumesFromImageTest-1864121411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-1275f311-b80d-4a15-850a-336bce223ce1 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:22 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d46d1e5a-1a3c-4b4a-995a-1e233c50d6fc tempest-CinderUnicodeTest-1242393573 None] Acquiring lock "cinder-e507ec0f-192f-43bb-97ef-32ea6666f341-delete_snapshot" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:51:22 devstack sudo[104515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-1275f311-b80d-4a15-850a-336bce223ce1 1073741824 Sep 18 21:51:22 devstack sudo[104515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:22 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ec76d21c-8df9-4526-b245-e20e6efb0b7a tempest-CreateVolumesFromImageTest-1864121411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fffe3e5c-6ead-452d-9f5d-7b36234c51a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe6a79a8-4727-4792-bfbb-8dd00ebfc3c8', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:22 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ec76d21c-8df9-4526-b245-e20e6efb0b7a tempest-CreateVolumesFromImageTest-1864121411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0fb65cf-325d-4911-9b4a-1281b0f5374f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:22 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d46d1e5a-1a3c-4b4a-995a-1e233c50d6fc tempest-CinderUnicodeTest-1242393573 None] Lock "cinder-e507ec0f-192f-43bb-97ef-32ea6666f341-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:51:22 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d46d1e5a-1a3c-4b4a-995a-1e233c50d6fc tempest-CinderUnicodeTest-1242393573 None] Acquiring lock "cinder-quobyte-53e002ff-2432-4e4e-9310-be5023d7dc9f" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:51:22 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-ec76d21c-8df9-4526-b245-e20e6efb0b7a tempest-CreateVolumesFromImageTest-1864121411 None] Volume volume-fe6a79a8-4727-4792-bfbb-8dd00ebfc3c8 (fe6a79a8-4727-4792-bfbb-8dd00ebfc3c8): created successfully Sep 18 21:51:22 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ec76d21c-8df9-4526-b245-e20e6efb0b7a tempest-CreateVolumesFromImageTest-1864121411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0fb65cf-325d-4911-9b4a-1281b0f5374f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:22 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ec76d21c-8df9-4526-b245-e20e6efb0b7a tempest-CreateVolumesFromImageTest-1864121411 None] Flow 'volume_create_manager' (064a8b14-0ad6-4b29-a4dd-06a6b6799e25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:51:22 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d46d1e5a-1a3c-4b4a-995a-1e233c50d6fc tempest-CinderUnicodeTest-1242393573 None] Lock "cinder-quobyte-53e002ff-2432-4e4e-9310-be5023d7dc9f" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:51:22 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d46d1e5a-1a3c-4b4a-995a-1e233c50d6fc tempest-CinderUnicodeTest-1242393573 None] Acquiring lock "cinder-quobyte-e507ec0f-192f-43bb-97ef-32ea6666f341" by "_delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:51:22 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-ec76d21c-8df9-4526-b245-e20e6efb0b7a tempest-CreateVolumesFromImageTest-1864121411 None] Created volume successfully. Sep 18 21:51:22 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d46d1e5a-1a3c-4b4a-995a-1e233c50d6fc tempest-CinderUnicodeTest-1242393573 None] Lock "cinder-quobyte-e507ec0f-192f-43bb-97ef-32ea6666f341" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:51:22 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-d46d1e5a-1a3c-4b4a-995a-1e233c50d6fc tempest-CinderUnicodeTest-1242393573 None] Deleting offline snapshot e507ec0f-192f-43bb-97ef-32ea6666f341 of volume 53e002ff-2432-4e4e-9310-be5023d7dc9f {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 21:51:22 devstack sudo[104512]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:22 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-d46d1e5a-1a3c-4b4a-995a-1e233c50d6fc tempest-CinderUnicodeTest-1242393573 None] snapshot_file for this snap is: volume-53e002ff-2432-4e4e-9310-be5023d7dc9f.e507ec0f-192f-43bb-97ef-32ea6666f341 {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 21:51:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-bfda5720-860a-412e-8776-7154a1df7e61 tempest-CreateVolumesFromSnapshotTest-248322392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-647dda22-4632-4787-8372-5fd9f5c1d986" returned: 0 in 0.428s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:22 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b49a8e-2afd-42de-8aa6-05660ef56b2b]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:51:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d46d1e5a-1a3c-4b4a-995a-1e233c50d6fc tempest-CinderUnicodeTest-1242393573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-53e002ff-2432-4e4e-9310-be5023d7dc9f.e507ec0f-192f-43bb-97ef-32ea6666f341 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:22 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-bfda5720-860a-412e-8776-7154a1df7e61 tempest-CreateVolumesFromSnapshotTest-248322392 None] Lock "cinder-quobyte-647dda22-4632-4787-8372-5fd9f5c1d986" released by "delete_volume" :: held 0.913s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:51:23 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-bfda5720-860a-412e-8776-7154a1df7e61 tempest-CreateVolumesFromSnapshotTest-248322392 None] Created reservations ['85b8afc6-fc2d-400b-b23f-ae2d46544209', '28e77940-e446-457e-bba1-040f6ba44a2c', 'e966806a-51b2-46e8-bf73-c96f16320f79', '053237b4-1d39-4a77-bff9-cf515e033ba6'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:51:23 devstack sudo[104518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-53e002ff-2432-4e4e-9310-be5023d7dc9f.e507ec0f-192f-43bb-97ef-32ea6666f341 Sep 18 21:51:23 devstack sudo[104518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-bfda5720-860a-412e-8776-7154a1df7e61 tempest-CreateVolumesFromSnapshotTest-248322392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:51:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-bfda5720-860a-412e-8776-7154a1df7e61 tempest-CreateVolumesFromSnapshotTest-248322392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:51:23 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-bfda5720-860a-412e-8776-7154a1df7e61 tempest-CreateVolumesFromSnapshotTest-248322392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:51:23 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-bfda5720-860a-412e-8776-7154a1df7e61 tempest-CreateVolumesFromSnapshotTest-248322392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:51:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-bfda5720-860a-412e-8776-7154a1df7e61 tempest-CreateVolumesFromSnapshotTest-248322392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:51:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-bfda5720-860a-412e-8776-7154a1df7e61 tempest-CreateVolumesFromSnapshotTest-248322392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:23 devstack sudo[104523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:51:23 devstack sudo[104523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:23 devstack sudo[104515]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6e6e7904-dd37-4640-b2e9-21b13870a515 tempest-CreateVolumesFromImageTest-1864121411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-1275f311-b80d-4a15-850a-336bce223ce1 1073741824" returned: 0 in 0.591s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6e6e7904-dd37-4640-b2e9-21b13870a515 tempest-CreateVolumesFromImageTest-1864121411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-1275f311-b80d-4a15-850a-336bce223ce1 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:23 devstack sudo[104529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-1275f311-b80d-4a15-850a-336bce223ce1 Sep 18 21:51:23 devstack sudo[104529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:23 devstack sudo[104518]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d46d1e5a-1a3c-4b4a-995a-1e233c50d6fc tempest-CinderUnicodeTest-1242393573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-53e002ff-2432-4e4e-9310-be5023d7dc9f.e507ec0f-192f-43bb-97ef-32ea6666f341" returned: 0 in 0.498s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:23 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-d46d1e5a-1a3c-4b4a-995a-1e233c50d6fc tempest-CinderUnicodeTest-1242393573 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53e002ff-2432-4e4e-9310-be5023d7dc9f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86136) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 21:51:23 devstack sudo[104523]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-bfda5720-860a-412e-8776-7154a1df7e61 tempest-CreateVolumesFromSnapshotTest-248322392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.318s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:23 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-bfda5720-860a-412e-8776-7154a1df7e61 tempest-CreateVolumesFromSnapshotTest-248322392 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:51:23 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-bfda5720-860a-412e-8776-7154a1df7e61 tempest-CreateVolumesFromSnapshotTest-248322392 None] Deleted volume successfully. Sep 18 21:51:23 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16a5b08-7ccf-4f44-9843-4687a91bc038]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:51:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d46d1e5a-1a3c-4b4a-995a-1e233c50d6fc tempest-CinderUnicodeTest-1242393573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-53e002ff-2432-4e4e-9310-be5023d7dc9f {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:23 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-bfda5720-860a-412e-8776-7154a1df7e61 tempest-CreateVolumesFromSnapshotTest-248322392 None] Lock "cinder-647dda22-4632-4787-8372-5fd9f5c1d986-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:51:23 devstack sudo[104531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-53e002ff-2432-4e4e-9310-be5023d7dc9f Sep 18 21:51:23 devstack sudo[104531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:23 devstack sudo[104529]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6e6e7904-dd37-4640-b2e9-21b13870a515 tempest-CreateVolumesFromImageTest-1864121411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-1275f311-b80d-4a15-850a-336bce223ce1" returned: 0 in 0.290s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:23 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-6e6e7904-dd37-4640-b2e9-21b13870a515 tempest-CreateVolumesFromImageTest-1864121411 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:51:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6e6e7904-dd37-4640-b2e9-21b13870a515 tempest-CreateVolumesFromImageTest-1864121411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:51:23 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6e6e7904-dd37-4640-b2e9-21b13870a515 tempest-CreateVolumesFromImageTest-1864121411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (503f4356-a064-419c-8be3-8dc9328f6710) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1275f311-b80d-4a15-850a-336bce223ce1', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:23 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6e6e7904-dd37-4640-b2e9-21b13870a515 tempest-CreateVolumesFromImageTest-1864121411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (491085de-9977-4527-8e7c-f49027f4bb40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:23 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-6e6e7904-dd37-4640-b2e9-21b13870a515 tempest-CreateVolumesFromImageTest-1864121411 None] Volume volume-1275f311-b80d-4a15-850a-336bce223ce1 (1275f311-b80d-4a15-850a-336bce223ce1): created successfully Sep 18 21:51:23 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6e6e7904-dd37-4640-b2e9-21b13870a515 tempest-CreateVolumesFromImageTest-1864121411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (491085de-9977-4527-8e7c-f49027f4bb40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:23 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-6e6e7904-dd37-4640-b2e9-21b13870a515 tempest-CreateVolumesFromImageTest-1864121411 None] Flow 'volume_create_manager' (e02d4ce9-dee2-4db4-8ea8-2b5bcc0a4f2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:51:23 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-6e6e7904-dd37-4640-b2e9-21b13870a515 tempest-CreateVolumesFromImageTest-1864121411 None] Created volume successfully. Sep 18 21:51:23 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-3840ad91-fa49-479a-8dee-5716d6c6d647 tempest-CreateVolumesFromImageTest-1864121411 None] Acquiring lock "cinder-1275f311-b80d-4a15-850a-336bce223ce1-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:51:23 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-3840ad91-fa49-479a-8dee-5716d6c6d647 tempest-CreateVolumesFromImageTest-1864121411 None] Lock "cinder-1275f311-b80d-4a15-850a-336bce223ce1-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:51:24 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-3840ad91-fa49-479a-8dee-5716d6c6d647 tempest-CreateVolumesFromImageTest-1864121411 None] Acquiring lock "cinder-quobyte-1275f311-b80d-4a15-850a-336bce223ce1" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:51:24 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-3840ad91-fa49-479a-8dee-5716d6c6d647 tempest-CreateVolumesFromImageTest-1864121411 None] Lock "cinder-quobyte-1275f311-b80d-4a15-850a-336bce223ce1" acquired by "delete_volume" :: waited 0.027s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:51:24 devstack sudo[104531]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d46d1e5a-1a3c-4b4a-995a-1e233c50d6fc tempest-CinderUnicodeTest-1242393573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-53e002ff-2432-4e4e-9310-be5023d7dc9f" returned: 0 in 0.652s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d46d1e5a-1a3c-4b4a-995a-1e233c50d6fc tempest-CinderUnicodeTest-1242393573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-53e002ff-2432-4e4e-9310-be5023d7dc9f.e507ec0f-192f-43bb-97ef-32ea6666f341 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:24 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[925ec910-50c1-43f6-addb-fd6f21675ab0]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:51:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3840ad91-fa49-479a-8dee-5716d6c6d647 tempest-CreateVolumesFromImageTest-1864121411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-1275f311-b80d-4a15-850a-336bce223ce1 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:24 devstack sudo[104537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-53e002ff-2432-4e4e-9310-be5023d7dc9f.e507ec0f-192f-43bb-97ef-32ea6666f341 Sep 18 21:51:24 devstack sudo[104537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:24 devstack sudo[104538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-1275f311-b80d-4a15-850a-336bce223ce1 Sep 18 21:51:24 devstack sudo[104538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:24 devstack sudo[104537]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:24 devstack sudo[104538]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d46d1e5a-1a3c-4b4a-995a-1e233c50d6fc tempest-CinderUnicodeTest-1242393573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-53e002ff-2432-4e4e-9310-be5023d7dc9f.e507ec0f-192f-43bb-97ef-32ea6666f341" returned: 0 in 0.491s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d46d1e5a-1a3c-4b4a-995a-1e233c50d6fc tempest-CinderUnicodeTest-1242393573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-53e002ff-2432-4e4e-9310-be5023d7dc9f.e507ec0f-192f-43bb-97ef-32ea6666f341 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3840ad91-fa49-479a-8dee-5716d6c6d647 tempest-CreateVolumesFromImageTest-1864121411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-1275f311-b80d-4a15-850a-336bce223ce1" returned: 0 in 0.483s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3840ad91-fa49-479a-8dee-5716d6c6d647 tempest-CreateVolumesFromImageTest-1864121411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-1275f311-b80d-4a15-850a-336bce223ce1 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:24 devstack sudo[104549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-53e002ff-2432-4e4e-9310-be5023d7dc9f.e507ec0f-192f-43bb-97ef-32ea6666f341 Sep 18 21:51:24 devstack sudo[104549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:24 devstack sudo[104550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-1275f311-b80d-4a15-850a-336bce223ce1 Sep 18 21:51:24 devstack sudo[104550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:24 devstack sudo[104550]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3840ad91-fa49-479a-8dee-5716d6c6d647 tempest-CreateVolumesFromImageTest-1864121411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-1275f311-b80d-4a15-850a-336bce223ce1" returned: 0 in 0.306s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:24 devstack sudo[104549]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d46d1e5a-1a3c-4b4a-995a-1e233c50d6fc tempest-CinderUnicodeTest-1242393573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-53e002ff-2432-4e4e-9310-be5023d7dc9f.e507ec0f-192f-43bb-97ef-32ea6666f341" returned: 0 in 0.337s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:24 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-3840ad91-fa49-479a-8dee-5716d6c6d647 tempest-CreateVolumesFromImageTest-1864121411 None] Lock "cinder-quobyte-1275f311-b80d-4a15-850a-336bce223ce1" released by "delete_volume" :: held 0.867s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:51:25 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d46d1e5a-1a3c-4b4a-995a-1e233c50d6fc tempest-CinderUnicodeTest-1242393573 None] Lock "cinder-quobyte-e507ec0f-192f-43bb-97ef-32ea6666f341" released by "_delete_snapshot" :: held 2.130s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:51:25 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d46d1e5a-1a3c-4b4a-995a-1e233c50d6fc tempest-CinderUnicodeTest-1242393573 None] Lock "cinder-quobyte-53e002ff-2432-4e4e-9310-be5023d7dc9f" released by "delete_snapshot" :: held 2.176s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:51:25 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-3840ad91-fa49-479a-8dee-5716d6c6d647 tempest-CreateVolumesFromImageTest-1864121411 None] Created reservations ['a36ecd73-181c-4940-9d8c-12ae7eb9dfa8', 'd94e3089-b747-4847-8e48-ab626698e59f', '43bd7296-a7d3-4234-88df-25d592a1cc4a', '36f0cadc-ef20-4bca-b913-658cc904b9f4'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:51:25 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-d46d1e5a-1a3c-4b4a-995a-1e233c50d6fc tempest-CinderUnicodeTest-1242393573 None] Created reservations ['ca627d77-6186-4817-93ad-a8b001733e90', 'e1b066e3-dd9f-44cd-b1be-733426294626', 'cb39f827-514d-4efa-835e-355dd06ec802', 'a268e187-871b-405e-9cdf-2175800d3de6'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:51:25 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-3840ad91-fa49-479a-8dee-5716d6c6d647 tempest-CreateVolumesFromImageTest-1864121411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:51:25 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-3840ad91-fa49-479a-8dee-5716d6c6d647 tempest-CreateVolumesFromImageTest-1864121411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:51:25 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-3840ad91-fa49-479a-8dee-5716d6c6d647 tempest-CreateVolumesFromImageTest-1864121411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:51:25 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-3840ad91-fa49-479a-8dee-5716d6c6d647 tempest-CreateVolumesFromImageTest-1864121411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:51:25 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-3840ad91-fa49-479a-8dee-5716d6c6d647 tempest-CreateVolumesFromImageTest-1864121411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:51:25 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3840ad91-fa49-479a-8dee-5716d6c6d647 tempest-CreateVolumesFromImageTest-1864121411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:25 devstack sudo[104555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:51:25 devstack sudo[104555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:25 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-d46d1e5a-1a3c-4b4a-995a-1e233c50d6fc tempest-CinderUnicodeTest-1242393573 None] Delete snapshot completed successfully. Sep 18 21:51:25 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d46d1e5a-1a3c-4b4a-995a-1e233c50d6fc tempest-CinderUnicodeTest-1242393573 None] Lock "cinder-e507ec0f-192f-43bb-97ef-32ea6666f341-delete_snapshot" released by "delete_snapshot" :: held 2.491s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:51:25 devstack sudo[104555]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:25 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3840ad91-fa49-479a-8dee-5716d6c6d647 tempest-CreateVolumesFromImageTest-1864121411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.305s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:25 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-3840ad91-fa49-479a-8dee-5716d6c6d647 tempest-CreateVolumesFromImageTest-1864121411 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:51:25 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-3840ad91-fa49-479a-8dee-5716d6c6d647 tempest-CreateVolumesFromImageTest-1864121411 None] Deleted volume successfully. Sep 18 21:51:25 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-3840ad91-fa49-479a-8dee-5716d6c6d647 tempest-CreateVolumesFromImageTest-1864121411 None] Lock "cinder-1275f311-b80d-4a15-850a-336bce223ce1-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:51:26 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-38262d0a-0fe6-4855-a955-64b486e08cee tempest-CinderUnicodeTest-1242393573 None] Acquiring lock "cinder-53e002ff-2432-4e4e-9310-be5023d7dc9f-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:51:26 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-38262d0a-0fe6-4855-a955-64b486e08cee tempest-CinderUnicodeTest-1242393573 None] Lock "cinder-53e002ff-2432-4e4e-9310-be5023d7dc9f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:51:26 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-38262d0a-0fe6-4855-a955-64b486e08cee tempest-CinderUnicodeTest-1242393573 None] Acquiring lock "cinder-quobyte-53e002ff-2432-4e4e-9310-be5023d7dc9f" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:51:26 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-38262d0a-0fe6-4855-a955-64b486e08cee tempest-CinderUnicodeTest-1242393573 None] Lock "cinder-quobyte-53e002ff-2432-4e4e-9310-be5023d7dc9f" acquired by "delete_volume" :: waited 0.022s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:51:26 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[9638ebb7-d40e-4c32-b988-56f555843c15]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:51:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-38262d0a-0fe6-4855-a955-64b486e08cee tempest-CinderUnicodeTest-1242393573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-53e002ff-2432-4e4e-9310-be5023d7dc9f {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:26 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-80af9d0b-97c2-42fc-a1d1-e514e9582912 tempest-CreateVolumesFromImageTest-1864121411 None] Acquiring lock "cinder-fe6a79a8-4727-4792-bfbb-8dd00ebfc3c8-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:51:26 devstack sudo[104558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-53e002ff-2432-4e4e-9310-be5023d7dc9f Sep 18 21:51:26 devstack sudo[104558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:26 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-80af9d0b-97c2-42fc-a1d1-e514e9582912 tempest-CreateVolumesFromImageTest-1864121411 None] Lock "cinder-fe6a79a8-4727-4792-bfbb-8dd00ebfc3c8-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:51:26 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-80af9d0b-97c2-42fc-a1d1-e514e9582912 tempest-CreateVolumesFromImageTest-1864121411 None] Acquiring lock "cinder-quobyte-fe6a79a8-4727-4792-bfbb-8dd00ebfc3c8" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:51:26 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-80af9d0b-97c2-42fc-a1d1-e514e9582912 tempest-CreateVolumesFromImageTest-1864121411 None] Lock "cinder-quobyte-fe6a79a8-4727-4792-bfbb-8dd00ebfc3c8" acquired by "delete_volume" :: waited 0.029s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:51:26 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[0efb1870-4626-411f-957b-f446d3e88a29]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:51:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-80af9d0b-97c2-42fc-a1d1-e514e9582912 tempest-CreateVolumesFromImageTest-1864121411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fe6a79a8-4727-4792-bfbb-8dd00ebfc3c8 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:26 devstack sudo[104560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fe6a79a8-4727-4792-bfbb-8dd00ebfc3c8 Sep 18 21:51:26 devstack sudo[104560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:26 devstack sudo[104558]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-38262d0a-0fe6-4855-a955-64b486e08cee tempest-CinderUnicodeTest-1242393573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-53e002ff-2432-4e4e-9310-be5023d7dc9f" returned: 0 in 0.506s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-38262d0a-0fe6-4855-a955-64b486e08cee tempest-CinderUnicodeTest-1242393573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-53e002ff-2432-4e4e-9310-be5023d7dc9f {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:26 devstack sudo[104565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-53e002ff-2432-4e4e-9310-be5023d7dc9f Sep 18 21:51:26 devstack sudo[104565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:26 devstack sudo[104565]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-38262d0a-0fe6-4855-a955-64b486e08cee tempest-CinderUnicodeTest-1242393573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-53e002ff-2432-4e4e-9310-be5023d7dc9f" returned: 0 in 0.288s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:26 devstack sudo[104560]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-80af9d0b-97c2-42fc-a1d1-e514e9582912 tempest-CreateVolumesFromImageTest-1864121411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fe6a79a8-4727-4792-bfbb-8dd00ebfc3c8" returned: 0 in 0.524s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-80af9d0b-97c2-42fc-a1d1-e514e9582912 tempest-CreateVolumesFromImageTest-1864121411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fe6a79a8-4727-4792-bfbb-8dd00ebfc3c8 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:26 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-38262d0a-0fe6-4855-a955-64b486e08cee tempest-CinderUnicodeTest-1242393573 None] Lock "cinder-quobyte-53e002ff-2432-4e4e-9310-be5023d7dc9f" released by "delete_volume" :: held 0.887s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:51:27 devstack sudo[104571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fe6a79a8-4727-4792-bfbb-8dd00ebfc3c8 Sep 18 21:51:27 devstack sudo[104571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:27 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-38262d0a-0fe6-4855-a955-64b486e08cee tempest-CinderUnicodeTest-1242393573 None] Created reservations ['fb48b0f4-115c-4124-b5fe-d3258e9cbe5d', '04ecb3ec-abe5-4292-9d1e-c9ffe0944699', '6170f9bd-85e9-4bda-8c3e-c44856511df3', 'f96c5e2c-a1ce-4b59-82d7-bd23a2a1d4cc'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:51:27 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-fdde724b-b459-4d84-9b9e-ba6050897044 tempest-ProjectAdminTests-1254609713 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6893119812012, 'free_capacity_gb': 1775.6893119812012, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86136) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 18 21:51:27 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-38262d0a-0fe6-4855-a955-64b486e08cee tempest-CinderUnicodeTest-1242393573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:51:27 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-38262d0a-0fe6-4855-a955-64b486e08cee tempest-CinderUnicodeTest-1242393573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:51:27 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-38262d0a-0fe6-4855-a955-64b486e08cee tempest-CinderUnicodeTest-1242393573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:51:27 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-38262d0a-0fe6-4855-a955-64b486e08cee tempest-CinderUnicodeTest-1242393573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:51:27 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-38262d0a-0fe6-4855-a955-64b486e08cee tempest-CinderUnicodeTest-1242393573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:51:27 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-38262d0a-0fe6-4855-a955-64b486e08cee tempest-CinderUnicodeTest-1242393573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:27 devstack sudo[104610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:51:27 devstack sudo[104610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:27 devstack sudo[104571]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:27 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-80af9d0b-97c2-42fc-a1d1-e514e9582912 tempest-CreateVolumesFromImageTest-1864121411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fe6a79a8-4727-4792-bfbb-8dd00ebfc3c8" returned: 0 in 0.387s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:27 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-80af9d0b-97c2-42fc-a1d1-e514e9582912 tempest-CreateVolumesFromImageTest-1864121411 None] Lock "cinder-quobyte-fe6a79a8-4727-4792-bfbb-8dd00ebfc3c8" released by "delete_volume" :: held 0.981s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:51:27 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-80af9d0b-97c2-42fc-a1d1-e514e9582912 tempest-CreateVolumesFromImageTest-1864121411 None] Created reservations ['16746102-2b1f-44b0-8aa9-644dd4c30004', 'a9679414-0130-4114-8876-025b5b77bb90', '5c4c5f95-32ea-46d3-b73f-ba570e23e343', 'c5e1821a-f8b2-40ce-8c19-02966d682e30'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:51:27 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-80af9d0b-97c2-42fc-a1d1-e514e9582912 tempest-CreateVolumesFromImageTest-1864121411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:51:27 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-80af9d0b-97c2-42fc-a1d1-e514e9582912 tempest-CreateVolumesFromImageTest-1864121411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:51:27 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-80af9d0b-97c2-42fc-a1d1-e514e9582912 tempest-CreateVolumesFromImageTest-1864121411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:51:27 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-80af9d0b-97c2-42fc-a1d1-e514e9582912 tempest-CreateVolumesFromImageTest-1864121411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:51:27 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-80af9d0b-97c2-42fc-a1d1-e514e9582912 tempest-CreateVolumesFromImageTest-1864121411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:51:27 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-80af9d0b-97c2-42fc-a1d1-e514e9582912 tempest-CreateVolumesFromImageTest-1864121411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:27 devstack sudo[104610]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:27 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-38262d0a-0fe6-4855-a955-64b486e08cee tempest-CinderUnicodeTest-1242393573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.393s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:27 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-38262d0a-0fe6-4855-a955-64b486e08cee tempest-CinderUnicodeTest-1242393573 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:51:27 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-38262d0a-0fe6-4855-a955-64b486e08cee tempest-CinderUnicodeTest-1242393573 None] Deleted volume successfully. Sep 18 21:51:27 devstack sudo[104617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:51:27 devstack sudo[104617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:27 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-38262d0a-0fe6-4855-a955-64b486e08cee tempest-CinderUnicodeTest-1242393573 None] Lock "cinder-53e002ff-2432-4e4e-9310-be5023d7dc9f-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:51:27 devstack sudo[104617]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:27 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-80af9d0b-97c2-42fc-a1d1-e514e9582912 tempest-CreateVolumesFromImageTest-1864121411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.325s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:27 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-80af9d0b-97c2-42fc-a1d1-e514e9582912 tempest-CreateVolumesFromImageTest-1864121411 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:51:27 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-80af9d0b-97c2-42fc-a1d1-e514e9582912 tempest-CreateVolumesFromImageTest-1864121411 None] Deleted volume successfully. Sep 18 21:51:27 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-80af9d0b-97c2-42fc-a1d1-e514e9582912 tempest-CreateVolumesFromImageTest-1864121411 None] Lock "cinder-fe6a79a8-4727-4792-bfbb-8dd00ebfc3c8-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:51:28 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-f093a633-e11b-44f8-a929-23cdd078a563 tempest-CinderUnicodeTest-1242393573 None] Acquiring lock "cinder-20be7eb6-7e75-48e1-97bc-be48d5e01690-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:51:28 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-f093a633-e11b-44f8-a929-23cdd078a563 tempest-CinderUnicodeTest-1242393573 None] Lock "cinder-20be7eb6-7e75-48e1-97bc-be48d5e01690-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:51:28 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-f093a633-e11b-44f8-a929-23cdd078a563 tempest-CinderUnicodeTest-1242393573 None] Acquiring lock "cinder-quobyte-20be7eb6-7e75-48e1-97bc-be48d5e01690" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:51:28 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-f093a633-e11b-44f8-a929-23cdd078a563 tempest-CinderUnicodeTest-1242393573 None] Lock "cinder-quobyte-20be7eb6-7e75-48e1-97bc-be48d5e01690" acquired by "delete_volume" :: waited 0.031s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:51:28 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e981a8-1295-4599-8b45-6de5d287f4a1]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:51:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f093a633-e11b-44f8-a929-23cdd078a563 tempest-CinderUnicodeTest-1242393573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-20be7eb6-7e75-48e1-97bc-be48d5e01690 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:28 devstack sudo[104622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-20be7eb6-7e75-48e1-97bc-be48d5e01690 Sep 18 21:51:28 devstack sudo[104622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:28 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-7ba07f0e-a8eb-44f7-88e7-cf517ca274fc tempest-CreateVolumesFromImageTest-1864121411 None] Acquiring lock "cinder-9e41793c-de88-48ad-867e-33f0dfa35359-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:51:28 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-7ba07f0e-a8eb-44f7-88e7-cf517ca274fc tempest-CreateVolumesFromImageTest-1864121411 None] Lock "cinder-9e41793c-de88-48ad-867e-33f0dfa35359-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:51:28 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-7ba07f0e-a8eb-44f7-88e7-cf517ca274fc tempest-CreateVolumesFromImageTest-1864121411 None] Acquiring lock "cinder-quobyte-9e41793c-de88-48ad-867e-33f0dfa35359" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:51:28 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-7ba07f0e-a8eb-44f7-88e7-cf517ca274fc tempest-CreateVolumesFromImageTest-1864121411 None] Lock "cinder-quobyte-9e41793c-de88-48ad-867e-33f0dfa35359" acquired by "delete_volume" :: waited 0.024s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:51:28 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8aa277f-47ec-44de-b9a7-3b978f3d1aeb]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:51:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-7ba07f0e-a8eb-44f7-88e7-cf517ca274fc tempest-CreateVolumesFromImageTest-1864121411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9e41793c-de88-48ad-867e-33f0dfa35359 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:28 devstack sudo[104622]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f093a633-e11b-44f8-a929-23cdd078a563 tempest-CinderUnicodeTest-1242393573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-20be7eb6-7e75-48e1-97bc-be48d5e01690" returned: 0 in 0.515s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f093a633-e11b-44f8-a929-23cdd078a563 tempest-CinderUnicodeTest-1242393573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-20be7eb6-7e75-48e1-97bc-be48d5e01690 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:29 devstack sudo[104624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9e41793c-de88-48ad-867e-33f0dfa35359 Sep 18 21:51:29 devstack sudo[104624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:29 devstack sudo[104629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-20be7eb6-7e75-48e1-97bc-be48d5e01690 Sep 18 21:51:29 devstack sudo[104629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:29 devstack sudo[104629]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f093a633-e11b-44f8-a929-23cdd078a563 tempest-CinderUnicodeTest-1242393573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-20be7eb6-7e75-48e1-97bc-be48d5e01690" returned: 0 in 0.305s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:29 devstack sudo[104624]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-7ba07f0e-a8eb-44f7-88e7-cf517ca274fc tempest-CreateVolumesFromImageTest-1864121411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9e41793c-de88-48ad-867e-33f0dfa35359" returned: 0 in 0.459s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-7ba07f0e-a8eb-44f7-88e7-cf517ca274fc tempest-CreateVolumesFromImageTest-1864121411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9e41793c-de88-48ad-867e-33f0dfa35359 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:29 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-f093a633-e11b-44f8-a929-23cdd078a563 tempest-CinderUnicodeTest-1242393573 None] Lock "cinder-quobyte-20be7eb6-7e75-48e1-97bc-be48d5e01690" released by "delete_volume" :: held 0.892s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:51:29 devstack sudo[104636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9e41793c-de88-48ad-867e-33f0dfa35359 Sep 18 21:51:29 devstack sudo[104636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:29 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-f093a633-e11b-44f8-a929-23cdd078a563 tempest-CinderUnicodeTest-1242393573 None] Created reservations ['9ed331de-8031-4738-b556-bc7957fe1e64', '88956792-e570-43bb-a437-b132b0e7b65d', '0b9675e8-445a-45be-b3ad-048833b7daae', '97ccdee9-e5cb-4bed-94f8-f33d37cab477'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:51:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-f093a633-e11b-44f8-a929-23cdd078a563 tempest-CinderUnicodeTest-1242393573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:51:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-f093a633-e11b-44f8-a929-23cdd078a563 tempest-CinderUnicodeTest-1242393573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:51:29 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-f093a633-e11b-44f8-a929-23cdd078a563 tempest-CinderUnicodeTest-1242393573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:51:29 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-f093a633-e11b-44f8-a929-23cdd078a563 tempest-CinderUnicodeTest-1242393573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:51:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-f093a633-e11b-44f8-a929-23cdd078a563 tempest-CinderUnicodeTest-1242393573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:51:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f093a633-e11b-44f8-a929-23cdd078a563 tempest-CinderUnicodeTest-1242393573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:29 devstack sudo[104638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:51:29 devstack sudo[104638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:29 devstack sudo[104636]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-7ba07f0e-a8eb-44f7-88e7-cf517ca274fc tempest-CreateVolumesFromImageTest-1864121411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9e41793c-de88-48ad-867e-33f0dfa35359" returned: 0 in 0.305s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:29 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-7ba07f0e-a8eb-44f7-88e7-cf517ca274fc tempest-CreateVolumesFromImageTest-1864121411 None] Lock "cinder-quobyte-9e41793c-de88-48ad-867e-33f0dfa35359" released by "delete_volume" :: held 0.843s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:51:29 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-7ba07f0e-a8eb-44f7-88e7-cf517ca274fc tempest-CreateVolumesFromImageTest-1864121411 None] Created reservations ['daa729f1-3ace-444c-ab7a-7744c2b30003', 'c5ae1ea6-6a92-4cd2-a0dc-89441be4acf6', '03b3a5d9-515d-4dbd-ba41-5e2e90cc0cae', '7de08653-f045-4a88-a75b-536920fc5d77'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:51:29 devstack sudo[104638]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f093a633-e11b-44f8-a929-23cdd078a563 tempest-CinderUnicodeTest-1242393573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.310s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:29 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-f093a633-e11b-44f8-a929-23cdd078a563 tempest-CinderUnicodeTest-1242393573 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:51:29 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-f093a633-e11b-44f8-a929-23cdd078a563 tempest-CinderUnicodeTest-1242393573 None] Deleted volume successfully. Sep 18 21:51:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-7ba07f0e-a8eb-44f7-88e7-cf517ca274fc tempest-CreateVolumesFromImageTest-1864121411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:51:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-7ba07f0e-a8eb-44f7-88e7-cf517ca274fc tempest-CreateVolumesFromImageTest-1864121411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:51:29 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-7ba07f0e-a8eb-44f7-88e7-cf517ca274fc tempest-CreateVolumesFromImageTest-1864121411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:51:29 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-7ba07f0e-a8eb-44f7-88e7-cf517ca274fc tempest-CreateVolumesFromImageTest-1864121411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:51:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-7ba07f0e-a8eb-44f7-88e7-cf517ca274fc tempest-CreateVolumesFromImageTest-1864121411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:51:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-7ba07f0e-a8eb-44f7-88e7-cf517ca274fc tempest-CreateVolumesFromImageTest-1864121411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:29 devstack sudo[104642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:51:29 devstack sudo[104642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:29 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-f093a633-e11b-44f8-a929-23cdd078a563 tempest-CinderUnicodeTest-1242393573 None] Lock "cinder-20be7eb6-7e75-48e1-97bc-be48d5e01690-delete_volume" released by "delete_volume" :: held 1.494s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:51:29 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-60283ea0-b96d-4ada-b902-10d68d2298c2 tempest-CreateVolumesFromImageTest-1864121411 None] Acquiring lock "cinder-8aa87c6f-dcd6-4f9d-884b-2ef9c74cb100-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:51:29 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-60283ea0-b96d-4ada-b902-10d68d2298c2 tempest-CreateVolumesFromImageTest-1864121411 None] Lock "cinder-8aa87c6f-dcd6-4f9d-884b-2ef9c74cb100-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:51:30 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-60283ea0-b96d-4ada-b902-10d68d2298c2 tempest-CreateVolumesFromImageTest-1864121411 None] Acquiring lock "cinder-quobyte-8aa87c6f-dcd6-4f9d-884b-2ef9c74cb100" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:51:30 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-60283ea0-b96d-4ada-b902-10d68d2298c2 tempest-CreateVolumesFromImageTest-1864121411 None] Lock "cinder-quobyte-8aa87c6f-dcd6-4f9d-884b-2ef9c74cb100" acquired by "delete_volume" :: waited 0.029s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:51:30 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[769dc365-ba5a-4414-a924-dc154ecc1394]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:51:30 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-60283ea0-b96d-4ada-b902-10d68d2298c2 tempest-CreateVolumesFromImageTest-1864121411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-8aa87c6f-dcd6-4f9d-884b-2ef9c74cb100 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:30 devstack sudo[104642]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:30 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-7ba07f0e-a8eb-44f7-88e7-cf517ca274fc tempest-CreateVolumesFromImageTest-1864121411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.383s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:30 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-7ba07f0e-a8eb-44f7-88e7-cf517ca274fc tempest-CreateVolumesFromImageTest-1864121411 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:51:30 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-7ba07f0e-a8eb-44f7-88e7-cf517ca274fc tempest-CreateVolumesFromImageTest-1864121411 None] Deleted volume successfully. Sep 18 21:51:30 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-7ba07f0e-a8eb-44f7-88e7-cf517ca274fc tempest-CreateVolumesFromImageTest-1864121411 None] Lock "cinder-9e41793c-de88-48ad-867e-33f0dfa35359-delete_volume" released by "delete_volume" :: held 1.520s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:51:30 devstack sudo[104644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-8aa87c6f-dcd6-4f9d-884b-2ef9c74cb100 Sep 18 21:51:30 devstack sudo[104644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:30 devstack sudo[104644]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:30 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-60283ea0-b96d-4ada-b902-10d68d2298c2 tempest-CreateVolumesFromImageTest-1864121411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-8aa87c6f-dcd6-4f9d-884b-2ef9c74cb100" returned: 0 in 0.434s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:30 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-60283ea0-b96d-4ada-b902-10d68d2298c2 tempest-CreateVolumesFromImageTest-1864121411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-8aa87c6f-dcd6-4f9d-884b-2ef9c74cb100 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:30 devstack sudo[104650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-8aa87c6f-dcd6-4f9d-884b-2ef9c74cb100 Sep 18 21:51:30 devstack sudo[104650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:30 devstack sudo[104650]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:30 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-60283ea0-b96d-4ada-b902-10d68d2298c2 tempest-CreateVolumesFromImageTest-1864121411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-8aa87c6f-dcd6-4f9d-884b-2ef9c74cb100" returned: 0 in 0.324s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:30 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-60283ea0-b96d-4ada-b902-10d68d2298c2 tempest-CreateVolumesFromImageTest-1864121411 None] Lock "cinder-quobyte-8aa87c6f-dcd6-4f9d-884b-2ef9c74cb100" released by "delete_volume" :: held 0.829s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:51:30 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-60283ea0-b96d-4ada-b902-10d68d2298c2 tempest-CreateVolumesFromImageTest-1864121411 None] Created reservations ['521b67a0-7217-490d-b347-94b3a9a967c3', '55a72df6-7f5d-4971-9933-2a7593f3d908', 'ff43142c-4612-4d9b-acf6-af136028ee47', 'dd57d58f-096e-4020-a5fe-afb8cbef0b3b'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:51:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-60283ea0-b96d-4ada-b902-10d68d2298c2 tempest-CreateVolumesFromImageTest-1864121411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:51:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-60283ea0-b96d-4ada-b902-10d68d2298c2 tempest-CreateVolumesFromImageTest-1864121411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:51:31 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-60283ea0-b96d-4ada-b902-10d68d2298c2 tempest-CreateVolumesFromImageTest-1864121411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:51:31 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-60283ea0-b96d-4ada-b902-10d68d2298c2 tempest-CreateVolumesFromImageTest-1864121411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:51:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-60283ea0-b96d-4ada-b902-10d68d2298c2 tempest-CreateVolumesFromImageTest-1864121411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:51:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-60283ea0-b96d-4ada-b902-10d68d2298c2 tempest-CreateVolumesFromImageTest-1864121411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:31 devstack sudo[104654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:51:31 devstack sudo[104654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:31 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-64aa7657-8d53-4b72-b827-ce14a17ca6d1 tempest-CreateVolumesFromImageTest-1864121411 None] Acquiring lock "cinder-2abb92cd-4f2d-4355-b9e9-0f2ab3b0246a-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:51:31 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-64aa7657-8d53-4b72-b827-ce14a17ca6d1 tempest-CreateVolumesFromImageTest-1864121411 None] Lock "cinder-2abb92cd-4f2d-4355-b9e9-0f2ab3b0246a-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:51:31 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-64aa7657-8d53-4b72-b827-ce14a17ca6d1 tempest-CreateVolumesFromImageTest-1864121411 None] Acquiring lock "cinder-quobyte-2abb92cd-4f2d-4355-b9e9-0f2ab3b0246a" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:51:31 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-64aa7657-8d53-4b72-b827-ce14a17ca6d1 tempest-CreateVolumesFromImageTest-1864121411 None] Lock "cinder-quobyte-2abb92cd-4f2d-4355-b9e9-0f2ab3b0246a" acquired by "delete_volume" :: waited 0.030s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:51:31 devstack sudo[104654]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-60283ea0-b96d-4ada-b902-10d68d2298c2 tempest-CreateVolumesFromImageTest-1864121411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.388s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:31 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-60283ea0-b96d-4ada-b902-10d68d2298c2 tempest-CreateVolumesFromImageTest-1864121411 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:51:31 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-60283ea0-b96d-4ada-b902-10d68d2298c2 tempest-CreateVolumesFromImageTest-1864121411 None] Deleted volume successfully. Sep 18 21:51:31 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[70738fcf-1c3f-490d-9fd6-73b12349df85]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:51:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-64aa7657-8d53-4b72-b827-ce14a17ca6d1 tempest-CreateVolumesFromImageTest-1864121411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2abb92cd-4f2d-4355-b9e9-0f2ab3b0246a {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:31 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-60283ea0-b96d-4ada-b902-10d68d2298c2 tempest-CreateVolumesFromImageTest-1864121411 None] Lock "cinder-8aa87c6f-dcd6-4f9d-884b-2ef9c74cb100-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:51:31 devstack sudo[104657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2abb92cd-4f2d-4355-b9e9-0f2ab3b0246a Sep 18 21:51:31 devstack sudo[104657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:31 devstack sudo[104657]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-64aa7657-8d53-4b72-b827-ce14a17ca6d1 tempest-CreateVolumesFromImageTest-1864121411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2abb92cd-4f2d-4355-b9e9-0f2ab3b0246a" returned: 0 in 0.449s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-64aa7657-8d53-4b72-b827-ce14a17ca6d1 tempest-CreateVolumesFromImageTest-1864121411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2abb92cd-4f2d-4355-b9e9-0f2ab3b0246a {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:31 devstack sudo[104662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2abb92cd-4f2d-4355-b9e9-0f2ab3b0246a Sep 18 21:51:31 devstack sudo[104662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:32 devstack sudo[104662]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-64aa7657-8d53-4b72-b827-ce14a17ca6d1 tempest-CreateVolumesFromImageTest-1864121411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2abb92cd-4f2d-4355-b9e9-0f2ab3b0246a" returned: 0 in 0.285s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:32 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-64aa7657-8d53-4b72-b827-ce14a17ca6d1 tempest-CreateVolumesFromImageTest-1864121411 None] Lock "cinder-quobyte-2abb92cd-4f2d-4355-b9e9-0f2ab3b0246a" released by "delete_volume" :: held 0.801s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:51:32 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-64aa7657-8d53-4b72-b827-ce14a17ca6d1 tempest-CreateVolumesFromImageTest-1864121411 None] Created reservations ['03693136-f9f5-4482-9420-0b5b6e3e576b', '1040d2a6-9b83-4065-9504-d9aeec02366e', '99777e98-80f2-4180-9e33-b8c527e972b2', '390c94b6-3f27-45c8-bc84-baf8127b3d48'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:51:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-64aa7657-8d53-4b72-b827-ce14a17ca6d1 tempest-CreateVolumesFromImageTest-1864121411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:51:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-64aa7657-8d53-4b72-b827-ce14a17ca6d1 tempest-CreateVolumesFromImageTest-1864121411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:51:32 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-64aa7657-8d53-4b72-b827-ce14a17ca6d1 tempest-CreateVolumesFromImageTest-1864121411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:51:32 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-64aa7657-8d53-4b72-b827-ce14a17ca6d1 tempest-CreateVolumesFromImageTest-1864121411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:51:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-64aa7657-8d53-4b72-b827-ce14a17ca6d1 tempest-CreateVolumesFromImageTest-1864121411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:51:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-64aa7657-8d53-4b72-b827-ce14a17ca6d1 tempest-CreateVolumesFromImageTest-1864121411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:32 devstack sudo[104665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:51:32 devstack sudo[104665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:32 devstack sudo[104665]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-64aa7657-8d53-4b72-b827-ce14a17ca6d1 tempest-CreateVolumesFromImageTest-1864121411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.286s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:32 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-64aa7657-8d53-4b72-b827-ce14a17ca6d1 tempest-CreateVolumesFromImageTest-1864121411 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:51:32 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-64aa7657-8d53-4b72-b827-ce14a17ca6d1 tempest-CreateVolumesFromImageTest-1864121411 None] Deleted volume successfully. Sep 18 21:51:32 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-64aa7657-8d53-4b72-b827-ce14a17ca6d1 tempest-CreateVolumesFromImageTest-1864121411 None] Lock "cinder-2abb92cd-4f2d-4355-b9e9-0f2ab3b0246a-delete_volume" released by "delete_volume" :: held 1.405s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:51:37 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-51dbd711-4943-42d3-b902-22a53ffa5b7e tempest-VolumeDependencyTests-1764889188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:51:37 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-51dbd711-4943-42d3-b902-22a53ffa5b7e tempest-VolumeDependencyTests-1764889188 None] Flow 'volume_create_manager' (659d1691-8dc5-44ed-8633-8ba111028fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:51:37 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-51dbd711-4943-42d3-b902-22a53ffa5b7e tempest-VolumeDependencyTests-1764889188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (370781e1-a1e6-4f8d-be46-eb01316220b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:37 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-51dbd711-4943-42d3-b902-22a53ffa5b7e tempest-VolumeDependencyTests-1764889188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (370781e1-a1e6-4f8d-be46-eb01316220b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:51:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2030096801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb5525e3-8df7-4d97-af58-e332e733ffc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52fc2a4b74414aeab3dc99e1b90f341e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:51:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:51:37Z,use_quota=True,user_id='9664aa63e0e346d7aac512fdc7635ff2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:37 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-51dbd711-4943-42d3-b902-22a53ffa5b7e tempest-VolumeDependencyTests-1764889188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aec04e1c-3268-49f7-8789-d9a81a35e2fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:37 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-51dbd711-4943-42d3-b902-22a53ffa5b7e tempest-VolumeDependencyTests-1764889188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aec04e1c-3268-49f7-8789-d9a81a35e2fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:37 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-51dbd711-4943-42d3-b902-22a53ffa5b7e tempest-VolumeDependencyTests-1764889188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ccddcd3-412f-427e-bcd9-c2b562c0b646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:37 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-51dbd711-4943-42d3-b902-22a53ffa5b7e tempest-VolumeDependencyTests-1764889188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ccddcd3-412f-427e-bcd9-c2b562c0b646) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb5525e3-8df7-4d97-af58-e332e733ffc4', 'volume_name': 'volume-fb5525e3-8df7-4d97-af58-e332e733ffc4', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:37 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-51dbd711-4943-42d3-b902-22a53ffa5b7e tempest-VolumeDependencyTests-1764889188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0da80e51-4fa1-4dcf-8dfe-b09daee0f48b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:37 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-51dbd711-4943-42d3-b902-22a53ffa5b7e tempest-VolumeDependencyTests-1764889188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0da80e51-4fa1-4dcf-8dfe-b09daee0f48b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:37 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-51dbd711-4943-42d3-b902-22a53ffa5b7e tempest-VolumeDependencyTests-1764889188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (870dbbc1-219b-4c6d-b5e1-34db8bfec858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:37 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-51dbd711-4943-42d3-b902-22a53ffa5b7e tempest-VolumeDependencyTests-1764889188 None] Volume fb5525e3-8df7-4d97-af58-e332e733ffc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb5525e3-8df7-4d97-af58-e332e733ffc4', 'volume_size': 1} Sep 18 21:51:37 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-51dbd711-4943-42d3-b902-22a53ffa5b7e tempest-VolumeDependencyTests-1764889188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:51:37 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-51dbd711-4943-42d3-b902-22a53ffa5b7e tempest-VolumeDependencyTests-1764889188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:51:37 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-51dbd711-4943-42d3-b902-22a53ffa5b7e tempest-VolumeDependencyTests-1764889188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:51:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2030096801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb5525e3-8df7-4d97-af58-e332e733ffc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52fc2a4b74414aeab3dc99e1b90f341e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:51:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:51:37Z,use_quota=True,user_id='9664aa63e0e346d7aac512fdc7635ff2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:51:37 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-51dbd711-4943-42d3-b902-22a53ffa5b7e tempest-VolumeDependencyTests-1764889188 None] Creating volume fb5525e3-8df7-4d97-af58-e332e733ffc4 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:51:37 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-51dbd711-4943-42d3-b902-22a53ffa5b7e tempest-VolumeDependencyTests-1764889188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:51:37 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-51dbd711-4943-42d3-b902-22a53ffa5b7e tempest-VolumeDependencyTests-1764889188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:51:37 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-51dbd711-4943-42d3-b902-22a53ffa5b7e tempest-VolumeDependencyTests-1764889188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:51:37 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-51dbd711-4943-42d3-b902-22a53ffa5b7e tempest-VolumeDependencyTests-1764889188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:51:37 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-51dbd711-4943-42d3-b902-22a53ffa5b7e tempest-VolumeDependencyTests-1764889188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:51:37 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-51dbd711-4943-42d3-b902-22a53ffa5b7e tempest-VolumeDependencyTests-1764889188 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:51:37 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-51dbd711-4943-42d3-b902-22a53ffa5b7e tempest-VolumeDependencyTests-1764889188 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:51:37 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-51dbd711-4943-42d3-b902-22a53ffa5b7e tempest-VolumeDependencyTests-1764889188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fb5525e3-8df7-4d97-af58-e332e733ffc4 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:37 devstack sudo[104668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fb5525e3-8df7-4d97-af58-e332e733ffc4 1073741824 Sep 18 21:51:37 devstack sudo[104668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:37 devstack sudo[104668]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:37 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-51dbd711-4943-42d3-b902-22a53ffa5b7e tempest-VolumeDependencyTests-1764889188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fb5525e3-8df7-4d97-af58-e332e733ffc4 1073741824" returned: 0 in 0.585s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:37 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-51dbd711-4943-42d3-b902-22a53ffa5b7e tempest-VolumeDependencyTests-1764889188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fb5525e3-8df7-4d97-af58-e332e733ffc4 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:37 devstack sudo[104674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fb5525e3-8df7-4d97-af58-e332e733ffc4 Sep 18 21:51:37 devstack sudo[104674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:38 devstack sudo[104674]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:38 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-51dbd711-4943-42d3-b902-22a53ffa5b7e tempest-VolumeDependencyTests-1764889188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fb5525e3-8df7-4d97-af58-e332e733ffc4" returned: 0 in 0.280s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:38 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-51dbd711-4943-42d3-b902-22a53ffa5b7e tempest-VolumeDependencyTests-1764889188 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:51:38 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-51dbd711-4943-42d3-b902-22a53ffa5b7e tempest-VolumeDependencyTests-1764889188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:51:38 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-51dbd711-4943-42d3-b902-22a53ffa5b7e tempest-VolumeDependencyTests-1764889188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (870dbbc1-219b-4c6d-b5e1-34db8bfec858) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb5525e3-8df7-4d97-af58-e332e733ffc4', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:38 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-51dbd711-4943-42d3-b902-22a53ffa5b7e tempest-VolumeDependencyTests-1764889188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a1caaf0-c615-4f8e-8e7c-c65871c8e4f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:38 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-51dbd711-4943-42d3-b902-22a53ffa5b7e tempest-VolumeDependencyTests-1764889188 None] Volume volume-fb5525e3-8df7-4d97-af58-e332e733ffc4 (fb5525e3-8df7-4d97-af58-e332e733ffc4): created successfully Sep 18 21:51:38 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-51dbd711-4943-42d3-b902-22a53ffa5b7e tempest-VolumeDependencyTests-1764889188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a1caaf0-c615-4f8e-8e7c-c65871c8e4f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:38 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-51dbd711-4943-42d3-b902-22a53ffa5b7e tempest-VolumeDependencyTests-1764889188 None] Flow 'volume_create_manager' (659d1691-8dc5-44ed-8633-8ba111028fbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:51:38 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-51dbd711-4943-42d3-b902-22a53ffa5b7e tempest-VolumeDependencyTests-1764889188 None] Created volume successfully. Sep 18 21:51:38 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-36acdcae-5cea-4838-9abf-35f61ca27e63 tempest-ProjectReaderTests-462787125 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:51:38 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-36acdcae-5cea-4838-9abf-35f61ca27e63 tempest-ProjectReaderTests-462787125 None] Flow 'volume_create_manager' (423f9c8b-7d7e-4eb6-a4fe-c6dff3d02a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:51:38 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-36acdcae-5cea-4838-9abf-35f61ca27e63 tempest-ProjectReaderTests-462787125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (625f224b-ea0c-4556-a4ea-f49e13c4dbae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:38 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-36acdcae-5cea-4838-9abf-35f61ca27e63 tempest-ProjectReaderTests-462787125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (625f224b-ea0c-4556-a4ea-f49e13c4dbae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:51:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-934045072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19396d76-f167-4422-ab53-9c4d4faf43fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dcc87503f13406caa33014a7a149d33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:51:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:51:39Z,use_quota=True,user_id='fd17cfd02234487cb53e780b5c3781e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:38 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-36acdcae-5cea-4838-9abf-35f61ca27e63 tempest-ProjectReaderTests-462787125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bff0738-6c93-4ffa-b111-b807171df9b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:38 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-36acdcae-5cea-4838-9abf-35f61ca27e63 tempest-ProjectReaderTests-462787125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bff0738-6c93-4ffa-b111-b807171df9b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:38 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-36acdcae-5cea-4838-9abf-35f61ca27e63 tempest-ProjectReaderTests-462787125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (937b15c2-6c3e-424e-be6a-23ded0078c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:38 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-36acdcae-5cea-4838-9abf-35f61ca27e63 tempest-ProjectReaderTests-462787125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (937b15c2-6c3e-424e-be6a-23ded0078c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19396d76-f167-4422-ab53-9c4d4faf43fb', 'volume_name': 'volume-19396d76-f167-4422-ab53-9c4d4faf43fb', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:38 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-36acdcae-5cea-4838-9abf-35f61ca27e63 tempest-ProjectReaderTests-462787125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0db3f46-798e-4fd1-8b8a-918ac073496d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:38 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-36acdcae-5cea-4838-9abf-35f61ca27e63 tempest-ProjectReaderTests-462787125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0db3f46-798e-4fd1-8b8a-918ac073496d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:38 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-36acdcae-5cea-4838-9abf-35f61ca27e63 tempest-ProjectReaderTests-462787125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (808393c4-ce8d-46ad-a767-6a3fb66ba9dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:38 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-36acdcae-5cea-4838-9abf-35f61ca27e63 tempest-ProjectReaderTests-462787125 None] Volume 19396d76-f167-4422-ab53-9c4d4faf43fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19396d76-f167-4422-ab53-9c4d4faf43fb', 'volume_size': 1} Sep 18 21:51:38 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-36acdcae-5cea-4838-9abf-35f61ca27e63 tempest-ProjectReaderTests-462787125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:51:38 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-36acdcae-5cea-4838-9abf-35f61ca27e63 tempest-ProjectReaderTests-462787125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:51:38 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-36acdcae-5cea-4838-9abf-35f61ca27e63 tempest-ProjectReaderTests-462787125 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:51:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-934045072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19396d76-f167-4422-ab53-9c4d4faf43fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dcc87503f13406caa33014a7a149d33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:51:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:51:39Z,use_quota=True,user_id='fd17cfd02234487cb53e780b5c3781e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:51:38 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-36acdcae-5cea-4838-9abf-35f61ca27e63 tempest-ProjectReaderTests-462787125 None] Creating volume 19396d76-f167-4422-ab53-9c4d4faf43fb {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:51:38 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-36acdcae-5cea-4838-9abf-35f61ca27e63 tempest-ProjectReaderTests-462787125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:51:38 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-36acdcae-5cea-4838-9abf-35f61ca27e63 tempest-ProjectReaderTests-462787125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:51:38 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-36acdcae-5cea-4838-9abf-35f61ca27e63 tempest-ProjectReaderTests-462787125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:51:38 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-36acdcae-5cea-4838-9abf-35f61ca27e63 tempest-ProjectReaderTests-462787125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:51:38 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-36acdcae-5cea-4838-9abf-35f61ca27e63 tempest-ProjectReaderTests-462787125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:51:38 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-36acdcae-5cea-4838-9abf-35f61ca27e63 tempest-ProjectReaderTests-462787125 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:51:38 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-36acdcae-5cea-4838-9abf-35f61ca27e63 tempest-ProjectReaderTests-462787125 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:51:38 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-36acdcae-5cea-4838-9abf-35f61ca27e63 tempest-ProjectReaderTests-462787125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-19396d76-f167-4422-ab53-9c4d4faf43fb 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:38 devstack sudo[104677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-19396d76-f167-4422-ab53-9c4d4faf43fb 1073741824 Sep 18 21:51:38 devstack sudo[104677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:39 devstack sudo[104677]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:39 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-36acdcae-5cea-4838-9abf-35f61ca27e63 tempest-ProjectReaderTests-462787125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-19396d76-f167-4422-ab53-9c4d4faf43fb 1073741824" returned: 0 in 0.587s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:39 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-36acdcae-5cea-4838-9abf-35f61ca27e63 tempest-ProjectReaderTests-462787125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-19396d76-f167-4422-ab53-9c4d4faf43fb {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:39 devstack sudo[104683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-19396d76-f167-4422-ab53-9c4d4faf43fb Sep 18 21:51:39 devstack sudo[104683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:39 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-51489a7d-73e2-4eed-8657-2a39c085b613 tempest-VolumeDependencyTests-1764889188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:51:39 devstack sudo[104683]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:39 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-36acdcae-5cea-4838-9abf-35f61ca27e63 tempest-ProjectReaderTests-462787125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-19396d76-f167-4422-ab53-9c4d4faf43fb" returned: 0 in 0.302s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:39 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-36acdcae-5cea-4838-9abf-35f61ca27e63 tempest-ProjectReaderTests-462787125 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:51:39 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-36acdcae-5cea-4838-9abf-35f61ca27e63 tempest-ProjectReaderTests-462787125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:51:39 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-51489a7d-73e2-4eed-8657-2a39c085b613 tempest-VolumeDependencyTests-1764889188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.081s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:51:39 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-51489a7d-73e2-4eed-8657-2a39c085b613 tempest-VolumeDependencyTests-1764889188 None] Creating offline snapshot a16215aa-7b15-4f6c-8be5-c275c39181fd of volume fb5525e3-8df7-4d97-af58-e332e733ffc4 {{(pid=86136) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 21:51:39 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-36acdcae-5cea-4838-9abf-35f61ca27e63 tempest-ProjectReaderTests-462787125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (808393c4-ce8d-46ad-a767-6a3fb66ba9dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19396d76-f167-4422-ab53-9c4d4faf43fb', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:39 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-36acdcae-5cea-4838-9abf-35f61ca27e63 tempest-ProjectReaderTests-462787125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ed722ac-9f4e-488d-93a1-70ab7b49371a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:39 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f7853a5-1a5b-4fac-b617-486962b6f011]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:51:39 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-51489a7d-73e2-4eed-8657-2a39c085b613 tempest-VolumeDependencyTests-1764889188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fb5525e3-8df7-4d97-af58-e332e733ffc4 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:39 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-36acdcae-5cea-4838-9abf-35f61ca27e63 tempest-ProjectReaderTests-462787125 None] Volume volume-19396d76-f167-4422-ab53-9c4d4faf43fb (19396d76-f167-4422-ab53-9c4d4faf43fb): created successfully Sep 18 21:51:39 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-36acdcae-5cea-4838-9abf-35f61ca27e63 tempest-ProjectReaderTests-462787125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ed722ac-9f4e-488d-93a1-70ab7b49371a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:39 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-36acdcae-5cea-4838-9abf-35f61ca27e63 tempest-ProjectReaderTests-462787125 None] Flow 'volume_create_manager' (423f9c8b-7d7e-4eb6-a4fe-c6dff3d02a1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:51:39 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-36acdcae-5cea-4838-9abf-35f61ca27e63 tempest-ProjectReaderTests-462787125 None] Created volume successfully. Sep 18 21:51:39 devstack sudo[104686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fb5525e3-8df7-4d97-af58-e332e733ffc4 Sep 18 21:51:39 devstack sudo[104686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:40 devstack sudo[104686]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:40 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-51489a7d-73e2-4eed-8657-2a39c085b613 tempest-VolumeDependencyTests-1764889188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fb5525e3-8df7-4d97-af58-e332e733ffc4" returned: 0 in 0.440s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:40 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-51489a7d-73e2-4eed-8657-2a39c085b613 tempest-VolumeDependencyTests-1764889188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fb5525e3-8df7-4d97-af58-e332e733ffc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fb5525e3-8df7-4d97-af58-e332e733ffc4.a16215aa-7b15-4f6c-8be5-c275c39181fd 1G {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:40 devstack sudo[104691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fb5525e3-8df7-4d97-af58-e332e733ffc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fb5525e3-8df7-4d97-af58-e332e733ffc4.a16215aa-7b15-4f6c-8be5-c275c39181fd 1G Sep 18 21:51:40 devstack sudo[104691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:40 devstack sudo[104691]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:40 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-51489a7d-73e2-4eed-8657-2a39c085b613 tempest-VolumeDependencyTests-1764889188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fb5525e3-8df7-4d97-af58-e332e733ffc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fb5525e3-8df7-4d97-af58-e332e733ffc4.a16215aa-7b15-4f6c-8be5-c275c39181fd 1G" returned: 0 in 0.547s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:40 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-51489a7d-73e2-4eed-8657-2a39c085b613 tempest-VolumeDependencyTests-1764889188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb5525e3-8df7-4d97-af58-e332e733ffc4 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fb5525e3-8df7-4d97-af58-e332e733ffc4.a16215aa-7b15-4f6c-8be5-c275c39181fd {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:40 devstack sudo[104697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb5525e3-8df7-4d97-af58-e332e733ffc4 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fb5525e3-8df7-4d97-af58-e332e733ffc4.a16215aa-7b15-4f6c-8be5-c275c39181fd Sep 18 21:51:40 devstack sudo[104697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:41 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-909aa7db-8c2f-472e-9877-1371f687e642 tempest-ProjectReaderTests-462787125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:51:41 devstack sudo[104697]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:41 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-51489a7d-73e2-4eed-8657-2a39c085b613 tempest-VolumeDependencyTests-1764889188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb5525e3-8df7-4d97-af58-e332e733ffc4 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fb5525e3-8df7-4d97-af58-e332e733ffc4.a16215aa-7b15-4f6c-8be5-c275c39181fd" returned: 0 in 0.410s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:41 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-51489a7d-73e2-4eed-8657-2a39c085b613 tempest-VolumeDependencyTests-1764889188 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fb5525e3-8df7-4d97-af58-e332e733ffc4.a16215aa-7b15-4f6c-8be5-c275c39181fd is being set with open permissions: ugo+rw Sep 18 21:51:41 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-51489a7d-73e2-4eed-8657-2a39c085b613 tempest-VolumeDependencyTests-1764889188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fb5525e3-8df7-4d97-af58-e332e733ffc4.a16215aa-7b15-4f6c-8be5-c275c39181fd {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:41 devstack sudo[104704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fb5525e3-8df7-4d97-af58-e332e733ffc4.a16215aa-7b15-4f6c-8be5-c275c39181fd Sep 18 21:51:41 devstack sudo[104704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:41 devstack sudo[104704]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:41 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-51489a7d-73e2-4eed-8657-2a39c085b613 tempest-VolumeDependencyTests-1764889188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fb5525e3-8df7-4d97-af58-e332e733ffc4.a16215aa-7b15-4f6c-8be5-c275c39181fd" returned: 0 in 0.287s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:41 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-51489a7d-73e2-4eed-8657-2a39c085b613 tempest-VolumeDependencyTests-1764889188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fb5525e3-8df7-4d97-af58-e332e733ffc4.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:41 devstack sudo[104707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fb5525e3-8df7-4d97-af58-e332e733ffc4.info Sep 18 21:51:41 devstack sudo[104707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:41 devstack sudo[104707]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:41 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-51489a7d-73e2-4eed-8657-2a39c085b613 tempest-VolumeDependencyTests-1764889188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fb5525e3-8df7-4d97-af58-e332e733ffc4.info" returned: 0 in 0.317s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:41 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-51489a7d-73e2-4eed-8657-2a39c085b613 tempest-VolumeDependencyTests-1764889188 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fb5525e3-8df7-4d97-af58-e332e733ffc4.info is being set with open permissions: ugo+rw Sep 18 21:51:41 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-51489a7d-73e2-4eed-8657-2a39c085b613 tempest-VolumeDependencyTests-1764889188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fb5525e3-8df7-4d97-af58-e332e733ffc4.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:41 devstack sudo[104710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fb5525e3-8df7-4d97-af58-e332e733ffc4.info Sep 18 21:51:41 devstack sudo[104710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:42 devstack sudo[104710]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:42 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-51489a7d-73e2-4eed-8657-2a39c085b613 tempest-VolumeDependencyTests-1764889188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fb5525e3-8df7-4d97-af58-e332e733ffc4.info" returned: 0 in 0.284s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:42 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-51489a7d-73e2-4eed-8657-2a39c085b613 tempest-VolumeDependencyTests-1764889188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.415s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:51:42 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-909aa7db-8c2f-472e-9877-1371f687e642 tempest-ProjectReaderTests-462787125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.061s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:51:42 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-909aa7db-8c2f-472e-9877-1371f687e642 tempest-ProjectReaderTests-462787125 None] Creating offline snapshot 9ed5a828-99ce-48ff-b7f6-6a107133d31b of volume 19396d76-f167-4422-ab53-9c4d4faf43fb {{(pid=86136) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 21:51:42 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-51489a7d-73e2-4eed-8657-2a39c085b613 tempest-VolumeDependencyTests-1764889188 None] Create snapshot completed successfully Sep 18 21:51:42 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[84902bc3-b13d-4edf-8a97-eb5cb42be3ac]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:51:42 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-909aa7db-8c2f-472e-9877-1371f687e642 tempest-ProjectReaderTests-462787125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-19396d76-f167-4422-ab53-9c4d4faf43fb {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:42 devstack sudo[104713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-19396d76-f167-4422-ab53-9c4d4faf43fb Sep 18 21:51:42 devstack sudo[104713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:42 devstack sudo[104713]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:42 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-909aa7db-8c2f-472e-9877-1371f687e642 tempest-ProjectReaderTests-462787125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-19396d76-f167-4422-ab53-9c4d4faf43fb" returned: 0 in 0.402s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:42 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-909aa7db-8c2f-472e-9877-1371f687e642 tempest-ProjectReaderTests-462787125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-19396d76-f167-4422-ab53-9c4d4faf43fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-19396d76-f167-4422-ab53-9c4d4faf43fb.9ed5a828-99ce-48ff-b7f6-6a107133d31b 1G {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:42 devstack sudo[104718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-19396d76-f167-4422-ab53-9c4d4faf43fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-19396d76-f167-4422-ab53-9c4d4faf43fb.9ed5a828-99ce-48ff-b7f6-6a107133d31b 1G Sep 18 21:51:42 devstack sudo[104718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:43 devstack sudo[104718]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:43 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-909aa7db-8c2f-472e-9877-1371f687e642 tempest-ProjectReaderTests-462787125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-19396d76-f167-4422-ab53-9c4d4faf43fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-19396d76-f167-4422-ab53-9c4d4faf43fb.9ed5a828-99ce-48ff-b7f6-6a107133d31b 1G" returned: 0 in 0.545s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:43 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-909aa7db-8c2f-472e-9877-1371f687e642 tempest-ProjectReaderTests-462787125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19396d76-f167-4422-ab53-9c4d4faf43fb -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-19396d76-f167-4422-ab53-9c4d4faf43fb.9ed5a828-99ce-48ff-b7f6-6a107133d31b {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:43 devstack sudo[104724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19396d76-f167-4422-ab53-9c4d4faf43fb -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-19396d76-f167-4422-ab53-9c4d4faf43fb.9ed5a828-99ce-48ff-b7f6-6a107133d31b Sep 18 21:51:43 devstack sudo[104724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:43 devstack sudo[104724]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:43 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-909aa7db-8c2f-472e-9877-1371f687e642 tempest-ProjectReaderTests-462787125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19396d76-f167-4422-ab53-9c4d4faf43fb -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-19396d76-f167-4422-ab53-9c4d4faf43fb.9ed5a828-99ce-48ff-b7f6-6a107133d31b" returned: 0 in 0.398s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:43 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-909aa7db-8c2f-472e-9877-1371f687e642 tempest-ProjectReaderTests-462787125 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-19396d76-f167-4422-ab53-9c4d4faf43fb.9ed5a828-99ce-48ff-b7f6-6a107133d31b is being set with open permissions: ugo+rw Sep 18 21:51:43 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-909aa7db-8c2f-472e-9877-1371f687e642 tempest-ProjectReaderTests-462787125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-19396d76-f167-4422-ab53-9c4d4faf43fb.9ed5a828-99ce-48ff-b7f6-6a107133d31b {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:43 devstack cinder-volume[86136]: DEBUG dbcounter [-] [86136] Writing DB stats cinder:SELECT=184,cinder:INSERT=62,cinder:UPDATE=269,cinder:DELETE=24 {{(pid=86136) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 21:51:43 devstack sudo[104730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-19396d76-f167-4422-ab53-9c4d4faf43fb.9ed5a828-99ce-48ff-b7f6-6a107133d31b Sep 18 21:51:43 devstack sudo[104730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:43 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae506979-09ca-4499-a57e-3a3efdb854da tempest-VolumeDependencyTests-1764889188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:51:43 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ae506979-09ca-4499-a57e-3a3efdb854da tempest-VolumeDependencyTests-1764889188 None] Flow 'volume_create_manager' (e3e27e7b-cd7c-4aa3-ad20-aa91bcce5d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:51:43 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ae506979-09ca-4499-a57e-3a3efdb854da tempest-VolumeDependencyTests-1764889188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eabc1ade-8efe-441e-8a49-26942f65ecf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:43 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ae506979-09ca-4499-a57e-3a3efdb854da tempest-VolumeDependencyTests-1764889188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eabc1ade-8efe-441e-8a49-26942f65ecf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:51:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1868391114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=527ddfdf-0fe7-460e-a902-c5407be6a664,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52fc2a4b74414aeab3dc99e1b90f341e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:51:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a16215aa-7b15-4f6c-8be5-c275c39181fd,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:51:43Z,use_quota=True,user_id='9664aa63e0e346d7aac512fdc7635ff2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:43 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ae506979-09ca-4499-a57e-3a3efdb854da tempest-VolumeDependencyTests-1764889188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41c026c5-6b79-4f81-97a9-74cd2278c170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:43 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ae506979-09ca-4499-a57e-3a3efdb854da tempest-VolumeDependencyTests-1764889188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41c026c5-6b79-4f81-97a9-74cd2278c170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:43 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ae506979-09ca-4499-a57e-3a3efdb854da tempest-VolumeDependencyTests-1764889188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0593b87d-7d3b-43f4-96e6-82a0b89525d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:43 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ae506979-09ca-4499-a57e-3a3efdb854da tempest-VolumeDependencyTests-1764889188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0593b87d-7d3b-43f4-96e6-82a0b89525d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '527ddfdf-0fe7-460e-a902-c5407be6a664', 'volume_name': 'volume-527ddfdf-0fe7-460e-a902-c5407be6a664', 'volume_size': 1, 'snapshot_id': 'a16215aa-7b15-4f6c-8be5-c275c39181fd'}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:43 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ae506979-09ca-4499-a57e-3a3efdb854da tempest-VolumeDependencyTests-1764889188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (754f94af-1c77-493f-923c-80162f886572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:43 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ae506979-09ca-4499-a57e-3a3efdb854da tempest-VolumeDependencyTests-1764889188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (754f94af-1c77-493f-923c-80162f886572) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:43 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ae506979-09ca-4499-a57e-3a3efdb854da tempest-VolumeDependencyTests-1764889188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (376c29ea-fd63-47c5-ab93-aa384c73903b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:43 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-ae506979-09ca-4499-a57e-3a3efdb854da tempest-VolumeDependencyTests-1764889188 None] Volume 527ddfdf-0fe7-460e-a902-c5407be6a664: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-527ddfdf-0fe7-460e-a902-c5407be6a664', 'volume_size': 1, 'snapshot_id': 'a16215aa-7b15-4f6c-8be5-c275c39181fd'} Sep 18 21:51:43 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-ae506979-09ca-4499-a57e-3a3efdb854da tempest-VolumeDependencyTests-1764889188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:51:43 devstack sudo[104730]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:43 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-909aa7db-8c2f-472e-9877-1371f687e642 tempest-ProjectReaderTests-462787125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-19396d76-f167-4422-ab53-9c4d4faf43fb.9ed5a828-99ce-48ff-b7f6-6a107133d31b" returned: 0 in 0.317s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:43 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-909aa7db-8c2f-472e-9877-1371f687e642 tempest-ProjectReaderTests-462787125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-19396d76-f167-4422-ab53-9c4d4faf43fb.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:43 devstack sudo[104733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-19396d76-f167-4422-ab53-9c4d4faf43fb.info Sep 18 21:51:43 devstack sudo[104733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:44 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-122d1564-4d24-411e-be2f-490f6bf130a2 tempest-ProjectReaderTests-1147372370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:51:44 devstack sudo[104733]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:44 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-122d1564-4d24-411e-be2f-490f6bf130a2 tempest-ProjectReaderTests-1147372370 None] Flow 'volume_create_manager' (75b9d60c-67b7-42b1-883b-0cff33472f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:51:44 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-122d1564-4d24-411e-be2f-490f6bf130a2 tempest-ProjectReaderTests-1147372370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (410b6087-374e-435d-886d-64fbebda0ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:44 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-909aa7db-8c2f-472e-9877-1371f687e642 tempest-ProjectReaderTests-462787125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-19396d76-f167-4422-ab53-9c4d4faf43fb.info" returned: 0 in 0.317s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:44 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-909aa7db-8c2f-472e-9877-1371f687e642 tempest-ProjectReaderTests-462787125 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-19396d76-f167-4422-ab53-9c4d4faf43fb.info is being set with open permissions: ugo+rw Sep 18 21:51:44 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-909aa7db-8c2f-472e-9877-1371f687e642 tempest-ProjectReaderTests-462787125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-19396d76-f167-4422-ab53-9c4d4faf43fb.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:44 devstack sudo[104736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-19396d76-f167-4422-ab53-9c4d4faf43fb.info Sep 18 21:51:44 devstack sudo[104736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:44 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-122d1564-4d24-411e-be2f-490f6bf130a2 tempest-ProjectReaderTests-1147372370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (410b6087-374e-435d-886d-64fbebda0ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:51:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1687675237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b4b250d-2123-4f21-b206-615d528e17d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d75ee007f0034ac994412b81b79f4c47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:51:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:51:44Z,use_quota=True,user_id='d5299d381c41405db9a80c86bdc14379',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:44 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-122d1564-4d24-411e-be2f-490f6bf130a2 tempest-ProjectReaderTests-1147372370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e97786e-51b2-4c09-a447-adf09d5d308a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:44 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-122d1564-4d24-411e-be2f-490f6bf130a2 tempest-ProjectReaderTests-1147372370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e97786e-51b2-4c09-a447-adf09d5d308a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:44 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-122d1564-4d24-411e-be2f-490f6bf130a2 tempest-ProjectReaderTests-1147372370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15a68b0d-9a58-4107-b3f8-3ca6d106047f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:44 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-122d1564-4d24-411e-be2f-490f6bf130a2 tempest-ProjectReaderTests-1147372370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15a68b0d-9a58-4107-b3f8-3ca6d106047f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b4b250d-2123-4f21-b206-615d528e17d8', 'volume_name': 'volume-9b4b250d-2123-4f21-b206-615d528e17d8', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:44 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-122d1564-4d24-411e-be2f-490f6bf130a2 tempest-ProjectReaderTests-1147372370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2614842f-afe5-43be-958b-8e4d24ee7e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:44 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-122d1564-4d24-411e-be2f-490f6bf130a2 tempest-ProjectReaderTests-1147372370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2614842f-afe5-43be-958b-8e4d24ee7e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:44 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-122d1564-4d24-411e-be2f-490f6bf130a2 tempest-ProjectReaderTests-1147372370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdbe5d63-278e-4bec-a8aa-8cb391d47845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:44 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-122d1564-4d24-411e-be2f-490f6bf130a2 tempest-ProjectReaderTests-1147372370 None] Volume 9b4b250d-2123-4f21-b206-615d528e17d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b4b250d-2123-4f21-b206-615d528e17d8', 'volume_size': 1} Sep 18 21:51:44 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-122d1564-4d24-411e-be2f-490f6bf130a2 tempest-ProjectReaderTests-1147372370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:51:44 devstack sudo[104736]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:44 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-909aa7db-8c2f-472e-9877-1371f687e642 tempest-ProjectReaderTests-462787125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-19396d76-f167-4422-ab53-9c4d4faf43fb.info" returned: 0 in 0.256s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:44 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-909aa7db-8c2f-472e-9877-1371f687e642 tempest-ProjectReaderTests-462787125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.343s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:51:44 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-ae506979-09ca-4499-a57e-3a3efdb854da tempest-VolumeDependencyTests-1764889188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.721s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:51:44 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-ae506979-09ca-4499-a57e-3a3efdb854da tempest-VolumeDependencyTests-1764889188 None] Acquiring lock "cinder-quobyte-a16215aa-7b15-4f6c-8be5-c275c39181fd-527ddfdf-0fe7-460e-a902-c5407be6a664" by "_create_volume_from_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:51:44 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-ae506979-09ca-4499-a57e-3a3efdb854da tempest-VolumeDependencyTests-1764889188 None] Lock "cinder-quobyte-a16215aa-7b15-4f6c-8be5-c275c39181fd-527ddfdf-0fe7-460e-a902-c5407be6a664" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:51:44 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-ae506979-09ca-4499-a57e-3a3efdb854da tempest-VolumeDependencyTests-1764889188 None] Creating volume 527ddfdf-0fe7-460e-a902-c5407be6a664 from snapshot a16215aa-7b15-4f6c-8be5-c275c39181fd {{(pid=86136) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 18 21:51:44 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-ae506979-09ca-4499-a57e-3a3efdb854da tempest-VolumeDependencyTests-1764889188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:51:44 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-ae506979-09ca-4499-a57e-3a3efdb854da tempest-VolumeDependencyTests-1764889188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:51:44 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-ae506979-09ca-4499-a57e-3a3efdb854da tempest-VolumeDependencyTests-1764889188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:51:44 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-ae506979-09ca-4499-a57e-3a3efdb854da tempest-VolumeDependencyTests-1764889188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:51:44 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-ae506979-09ca-4499-a57e-3a3efdb854da tempest-VolumeDependencyTests-1764889188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:51:44 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-ae506979-09ca-4499-a57e-3a3efdb854da tempest-VolumeDependencyTests-1764889188 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:51:44 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-ae506979-09ca-4499-a57e-3a3efdb854da tempest-VolumeDependencyTests-1764889188 None] Acquiring lock "cinder-quobyte-527ddfdf-0fe7-460e-a902-c5407be6a664" by "_copy_volume_from_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:51:44 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-909aa7db-8c2f-472e-9877-1371f687e642 tempest-ProjectReaderTests-462787125 None] Create snapshot completed successfully Sep 18 21:51:44 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-ae506979-09ca-4499-a57e-3a3efdb854da tempest-VolumeDependencyTests-1764889188 None] Lock "cinder-quobyte-527ddfdf-0fe7-460e-a902-c5407be6a664" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:51:44 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-ae506979-09ca-4499-a57e-3a3efdb854da tempest-VolumeDependencyTests-1764889188 None] snapshot: a16215aa-7b15-4f6c-8be5-c275c39181fd, volume: 527ddfdf-0fe7-460e-a902-c5407be6a664, {{(pid=86136) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 18 21:51:44 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-ae506979-09ca-4499-a57e-3a3efdb854da tempest-VolumeDependencyTests-1764889188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:51:44 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-ae506979-09ca-4499-a57e-3a3efdb854da tempest-VolumeDependencyTests-1764889188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:51:44 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-ae506979-09ca-4499-a57e-3a3efdb854da tempest-VolumeDependencyTests-1764889188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:51:44 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-ae506979-09ca-4499-a57e-3a3efdb854da tempest-VolumeDependencyTests-1764889188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:51:44 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-ae506979-09ca-4499-a57e-3a3efdb854da tempest-VolumeDependencyTests-1764889188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:51:44 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[1708d84d-9ffd-49c6-9dd8-84bf325f96ef]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:51:44 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ae506979-09ca-4499-a57e-3a3efdb854da tempest-VolumeDependencyTests-1764889188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fb5525e3-8df7-4d97-af58-e332e733ffc4.a16215aa-7b15-4f6c-8be5-c275c39181fd {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:44 devstack sudo[104739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fb5525e3-8df7-4d97-af58-e332e733ffc4.a16215aa-7b15-4f6c-8be5-c275c39181fd Sep 18 21:51:44 devstack sudo[104739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:44 devstack sudo[104739]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:44 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ae506979-09ca-4499-a57e-3a3efdb854da tempest-VolumeDependencyTests-1764889188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fb5525e3-8df7-4d97-af58-e332e733ffc4.a16215aa-7b15-4f6c-8be5-c275c39181fd" returned: 0 in 0.402s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:44 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-ae506979-09ca-4499-a57e-3a3efdb854da tempest-VolumeDependencyTests-1764889188 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb5525e3-8df7-4d97-af58-e332e733ffc4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86136) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 21:51:44 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2223166-4109-4ab4-ac47-cf6949a76824]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:51:44 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ae506979-09ca-4499-a57e-3a3efdb854da tempest-VolumeDependencyTests-1764889188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fb5525e3-8df7-4d97-af58-e332e733ffc4 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:45 devstack sudo[104744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fb5525e3-8df7-4d97-af58-e332e733ffc4 Sep 18 21:51:45 devstack sudo[104744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:45 devstack sudo[104744]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:45 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ae506979-09ca-4499-a57e-3a3efdb854da tempest-VolumeDependencyTests-1764889188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fb5525e3-8df7-4d97-af58-e332e733ffc4" returned: 0 in 0.432s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:45 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-ae506979-09ca-4499-a57e-3a3efdb854da tempest-VolumeDependencyTests-1764889188 None] will copy from snapshot at /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fb5525e3-8df7-4d97-af58-e332e733ffc4 {{(pid=86136) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 18 21:51:45 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-ae506979-09ca-4499-a57e-3a3efdb854da tempest-VolumeDependencyTests-1764889188 None] Creating direct copy from snapshot {{(pid=86136) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 18 21:51:45 devstack cinder-volume[86136]: DEBUG cinder.utils [None req-ae506979-09ca-4499-a57e-3a3efdb854da tempest-VolumeDependencyTests-1764889188 None] Path /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-527ddfdf-0fe7-460e-a902-c5407be6a664 not found in is_blk_device check {{(pid=86136) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 18 21:51:45 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ae506979-09ca-4499-a57e-3a3efdb854da tempest-VolumeDependencyTests-1764889188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fb5525e3-8df7-4d97-af58-e332e733ffc4 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-527ddfdf-0fe7-460e-a902-c5407be6a664 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:45 devstack sudo[104749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fb5525e3-8df7-4d97-af58-e332e733ffc4 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-527ddfdf-0fe7-460e-a902-c5407be6a664 Sep 18 21:51:45 devstack sudo[104749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:45 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-80611d07-f335-4d9f-9c78-713ba691610e tempest-ProjectReaderTests-462787125 None] Acquiring lock "cinder-9ed5a828-99ce-48ff-b7f6-6a107133d31b-delete_snapshot" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:51:45 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-80611d07-f335-4d9f-9c78-713ba691610e tempest-ProjectReaderTests-462787125 None] Lock "cinder-9ed5a828-99ce-48ff-b7f6-6a107133d31b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:51:45 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-80611d07-f335-4d9f-9c78-713ba691610e tempest-ProjectReaderTests-462787125 None] Acquiring lock "cinder-quobyte-19396d76-f167-4422-ab53-9c4d4faf43fb" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:51:45 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-80611d07-f335-4d9f-9c78-713ba691610e tempest-ProjectReaderTests-462787125 None] Lock "cinder-quobyte-19396d76-f167-4422-ab53-9c4d4faf43fb" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:51:45 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-80611d07-f335-4d9f-9c78-713ba691610e tempest-ProjectReaderTests-462787125 None] Acquiring lock "cinder-quobyte-9ed5a828-99ce-48ff-b7f6-6a107133d31b" by "_delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:51:45 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-80611d07-f335-4d9f-9c78-713ba691610e tempest-ProjectReaderTests-462787125 None] Lock "cinder-quobyte-9ed5a828-99ce-48ff-b7f6-6a107133d31b" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:51:45 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-80611d07-f335-4d9f-9c78-713ba691610e tempest-ProjectReaderTests-462787125 None] Deleting offline snapshot 9ed5a828-99ce-48ff-b7f6-6a107133d31b of volume 19396d76-f167-4422-ab53-9c4d4faf43fb {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 21:51:45 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-80611d07-f335-4d9f-9c78-713ba691610e tempest-ProjectReaderTests-462787125 None] snapshot_file for this snap is: volume-19396d76-f167-4422-ab53-9c4d4faf43fb.9ed5a828-99ce-48ff-b7f6-6a107133d31b {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 21:51:45 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b422d76-6ce2-4cb8-8a12-146bffb4c45f]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:51:45 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-80611d07-f335-4d9f-9c78-713ba691610e tempest-ProjectReaderTests-462787125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-19396d76-f167-4422-ab53-9c4d4faf43fb.9ed5a828-99ce-48ff-b7f6-6a107133d31b {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:45 devstack sudo[104751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-19396d76-f167-4422-ab53-9c4d4faf43fb.9ed5a828-99ce-48ff-b7f6-6a107133d31b Sep 18 21:51:45 devstack sudo[104751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:46 devstack sudo[104751]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-80611d07-f335-4d9f-9c78-713ba691610e tempest-ProjectReaderTests-462787125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-19396d76-f167-4422-ab53-9c4d4faf43fb.9ed5a828-99ce-48ff-b7f6-6a107133d31b" returned: 0 in 0.581s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:46 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-80611d07-f335-4d9f-9c78-713ba691610e tempest-ProjectReaderTests-462787125 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19396d76-f167-4422-ab53-9c4d4faf43fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86136) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 21:51:46 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe60427-cf17-4279-8068-08daa85b603b]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:51:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-80611d07-f335-4d9f-9c78-713ba691610e tempest-ProjectReaderTests-462787125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-19396d76-f167-4422-ab53-9c4d4faf43fb {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:46 devstack sudo[104766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-19396d76-f167-4422-ab53-9c4d4faf43fb Sep 18 21:51:46 devstack sudo[104766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:47 devstack sudo[104766]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:47 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-80611d07-f335-4d9f-9c78-713ba691610e tempest-ProjectReaderTests-462787125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-19396d76-f167-4422-ab53-9c4d4faf43fb" returned: 0 in 0.873s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:47 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-80611d07-f335-4d9f-9c78-713ba691610e tempest-ProjectReaderTests-462787125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-19396d76-f167-4422-ab53-9c4d4faf43fb.9ed5a828-99ce-48ff-b7f6-6a107133d31b {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:47 devstack sudo[104773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-19396d76-f167-4422-ab53-9c4d4faf43fb.9ed5a828-99ce-48ff-b7f6-6a107133d31b Sep 18 21:51:47 devstack sudo[104773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:47 devstack sudo[104773]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:47 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-80611d07-f335-4d9f-9c78-713ba691610e tempest-ProjectReaderTests-462787125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-19396d76-f167-4422-ab53-9c4d4faf43fb.9ed5a828-99ce-48ff-b7f6-6a107133d31b" returned: 0 in 0.751s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:47 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-80611d07-f335-4d9f-9c78-713ba691610e tempest-ProjectReaderTests-462787125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-19396d76-f167-4422-ab53-9c4d4faf43fb.9ed5a828-99ce-48ff-b7f6-6a107133d31b {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:47 devstack sudo[104778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-19396d76-f167-4422-ab53-9c4d4faf43fb.9ed5a828-99ce-48ff-b7f6-6a107133d31b Sep 18 21:51:47 devstack sudo[104778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:48 devstack sudo[104778]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:48 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-80611d07-f335-4d9f-9c78-713ba691610e tempest-ProjectReaderTests-462787125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-19396d76-f167-4422-ab53-9c4d4faf43fb.9ed5a828-99ce-48ff-b7f6-6a107133d31b" returned: 0 in 0.323s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:48 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-80611d07-f335-4d9f-9c78-713ba691610e tempest-ProjectReaderTests-462787125 None] Lock "cinder-quobyte-9ed5a828-99ce-48ff-b7f6-6a107133d31b" released by "_delete_snapshot" :: held 2.738s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:51:48 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-80611d07-f335-4d9f-9c78-713ba691610e tempest-ProjectReaderTests-462787125 None] Lock "cinder-quobyte-19396d76-f167-4422-ab53-9c4d4faf43fb" released by "delete_snapshot" :: held 2.779s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:51:48 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-80611d07-f335-4d9f-9c78-713ba691610e tempest-ProjectReaderTests-462787125 None] Created reservations ['231a8c1b-a175-4027-b086-5b64f9b38669', '90567bd5-d648-4c1d-b96a-a89d74280c7d', '58298a09-1151-48ce-b946-75a1430695eb', 'bcb790a0-5cde-4c8b-9a75-ea11bdfccac1'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:51:48 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-80611d07-f335-4d9f-9c78-713ba691610e tempest-ProjectReaderTests-462787125 None] Delete snapshot completed successfully. Sep 18 21:51:48 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-80611d07-f335-4d9f-9c78-713ba691610e tempest-ProjectReaderTests-462787125 None] Lock "cinder-9ed5a828-99ce-48ff-b7f6-6a107133d31b-delete_snapshot" released by "delete_snapshot" :: held 3.126s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:51:48 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-bdf1627d-1547-4724-b2a5-e9226a3c3192 tempest-ProjectReaderTests-462787125 None] Acquiring lock "cinder-19396d76-f167-4422-ab53-9c4d4faf43fb-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:51:48 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-bdf1627d-1547-4724-b2a5-e9226a3c3192 tempest-ProjectReaderTests-462787125 None] Lock "cinder-19396d76-f167-4422-ab53-9c4d4faf43fb-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:51:49 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-bdf1627d-1547-4724-b2a5-e9226a3c3192 tempest-ProjectReaderTests-462787125 None] Acquiring lock "cinder-quobyte-19396d76-f167-4422-ab53-9c4d4faf43fb" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:51:49 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-bdf1627d-1547-4724-b2a5-e9226a3c3192 tempest-ProjectReaderTests-462787125 None] Lock "cinder-quobyte-19396d76-f167-4422-ab53-9c4d4faf43fb" acquired by "delete_volume" :: waited 0.038s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:51:49 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[688b95df-4e17-42d4-aede-9d7c42c1c82f]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:51:49 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-bdf1627d-1547-4724-b2a5-e9226a3c3192 tempest-ProjectReaderTests-462787125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-19396d76-f167-4422-ab53-9c4d4faf43fb {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:49 devstack sudo[104781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-19396d76-f167-4422-ab53-9c4d4faf43fb Sep 18 21:51:49 devstack sudo[104781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:49 devstack sudo[104781]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:50 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-bdf1627d-1547-4724-b2a5-e9226a3c3192 tempest-ProjectReaderTests-462787125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-19396d76-f167-4422-ab53-9c4d4faf43fb" returned: 0 in 0.856s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:50 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-bdf1627d-1547-4724-b2a5-e9226a3c3192 tempest-ProjectReaderTests-462787125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-19396d76-f167-4422-ab53-9c4d4faf43fb {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:50 devstack sudo[104788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-19396d76-f167-4422-ab53-9c4d4faf43fb Sep 18 21:51:50 devstack sudo[104788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:50 devstack sudo[104788]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:50 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-bdf1627d-1547-4724-b2a5-e9226a3c3192 tempest-ProjectReaderTests-462787125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-19396d76-f167-4422-ab53-9c4d4faf43fb" returned: 0 in 0.535s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:50 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-bdf1627d-1547-4724-b2a5-e9226a3c3192 tempest-ProjectReaderTests-462787125 None] Lock "cinder-quobyte-19396d76-f167-4422-ab53-9c4d4faf43fb" released by "delete_volume" :: held 1.551s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:51:50 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-bdf1627d-1547-4724-b2a5-e9226a3c3192 tempest-ProjectReaderTests-462787125 None] Created reservations ['8bbedcd6-320d-4963-b7c2-f585da20157e', '733c579c-6910-4d18-8e3d-b29dfbf6a6a8', '12e8b783-beee-4013-a6db-b93dc60ba382', 'e9a47af3-1dc1-458d-904f-2990d09c3c03'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:51:50 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-bdf1627d-1547-4724-b2a5-e9226a3c3192 tempest-ProjectReaderTests-462787125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:51:50 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-bdf1627d-1547-4724-b2a5-e9226a3c3192 tempest-ProjectReaderTests-462787125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:51:50 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-bdf1627d-1547-4724-b2a5-e9226a3c3192 tempest-ProjectReaderTests-462787125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:51:50 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-bdf1627d-1547-4724-b2a5-e9226a3c3192 tempest-ProjectReaderTests-462787125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:51:50 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-bdf1627d-1547-4724-b2a5-e9226a3c3192 tempest-ProjectReaderTests-462787125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:51:50 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-bdf1627d-1547-4724-b2a5-e9226a3c3192 tempest-ProjectReaderTests-462787125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:51 devstack sudo[104792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:51:51 devstack sudo[104792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:51 devstack sudo[104792]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:51 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-bdf1627d-1547-4724-b2a5-e9226a3c3192 tempest-ProjectReaderTests-462787125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.561s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:51 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-bdf1627d-1547-4724-b2a5-e9226a3c3192 tempest-ProjectReaderTests-462787125 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:51:51 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-bdf1627d-1547-4724-b2a5-e9226a3c3192 tempest-ProjectReaderTests-462787125 None] Deleted volume successfully. Sep 18 21:51:51 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-bdf1627d-1547-4724-b2a5-e9226a3c3192 tempest-ProjectReaderTests-462787125 None] Lock "cinder-19396d76-f167-4422-ab53-9c4d4faf43fb-delete_volume" released by "delete_volume" :: held 2.664s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:51:52 devstack cinder-volume[86136]: DEBUG dbcounter [-] [86136] Writing DB stats cinder:UPDATE=259,cinder:SELECT=201,cinder:DELETE=23,cinder:INSERT=81 {{(pid=86136) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 21:51:52 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba267d3f-8f44-4a50-a92c-dc381dc792e7 tempest-ProjectReaderTests-462787125 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:51:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ba267d3f-8f44-4a50-a92c-dc381dc792e7 tempest-ProjectReaderTests-462787125 None] Flow 'volume_create_manager' (7c5b360c-38e3-47c5-be60-393b4a430297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:51:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ba267d3f-8f44-4a50-a92c-dc381dc792e7 tempest-ProjectReaderTests-462787125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8eb920ee-33a6-42ce-8d9d-33ad347d279a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ba267d3f-8f44-4a50-a92c-dc381dc792e7 tempest-ProjectReaderTests-462787125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8eb920ee-33a6-42ce-8d9d-33ad347d279a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:51:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-25458092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f04097dd-f33c-4794-a06a-ff2b4ee4c6d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dcc87503f13406caa33014a7a149d33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:51:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:51:52Z,use_quota=True,user_id='fd17cfd02234487cb53e780b5c3781e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ba267d3f-8f44-4a50-a92c-dc381dc792e7 tempest-ProjectReaderTests-462787125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9426f38-fc8a-456a-890c-d393a317d5e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ba267d3f-8f44-4a50-a92c-dc381dc792e7 tempest-ProjectReaderTests-462787125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9426f38-fc8a-456a-890c-d393a317d5e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ba267d3f-8f44-4a50-a92c-dc381dc792e7 tempest-ProjectReaderTests-462787125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45f9b303-5d10-477e-988a-d2dd978fdbef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ba267d3f-8f44-4a50-a92c-dc381dc792e7 tempest-ProjectReaderTests-462787125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45f9b303-5d10-477e-988a-d2dd978fdbef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f04097dd-f33c-4794-a06a-ff2b4ee4c6d3', 'volume_name': 'volume-f04097dd-f33c-4794-a06a-ff2b4ee4c6d3', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ba267d3f-8f44-4a50-a92c-dc381dc792e7 tempest-ProjectReaderTests-462787125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15b9a779-6971-46c0-b2e6-08d22861f86c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ba267d3f-8f44-4a50-a92c-dc381dc792e7 tempest-ProjectReaderTests-462787125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15b9a779-6971-46c0-b2e6-08d22861f86c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:52 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ba267d3f-8f44-4a50-a92c-dc381dc792e7 tempest-ProjectReaderTests-462787125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3327839f-9296-4c1e-b750-fd3b895e5e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:52 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-ba267d3f-8f44-4a50-a92c-dc381dc792e7 tempest-ProjectReaderTests-462787125 None] Volume f04097dd-f33c-4794-a06a-ff2b4ee4c6d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f04097dd-f33c-4794-a06a-ff2b4ee4c6d3', 'volume_size': 1} Sep 18 21:51:52 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-ba267d3f-8f44-4a50-a92c-dc381dc792e7 tempest-ProjectReaderTests-462787125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:51:53 devstack sudo[104749]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:53 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ae506979-09ca-4499-a57e-3a3efdb854da tempest-VolumeDependencyTests-1764889188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fb5525e3-8df7-4d97-af58-e332e733ffc4 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-527ddfdf-0fe7-460e-a902-c5407be6a664" returned: 0 in 8.279s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:53 devstack cinder-volume[86136]: DEBUG cinder.image.image_utils [None req-ae506979-09ca-4499-a57e-3a3efdb854da tempest-VolumeDependencyTests-1764889188 None] Image conversion details: src /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fb5525e3-8df7-4d97-af58-e332e733ffc4, size 1024.00 MB, duration 8.28 sec, destination /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-527ddfdf-0fe7-460e-a902-c5407be6a664 {{(pid=86136) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 18 21:51:53 devstack cinder-volume[86136]: INFO cinder.image.image_utils [None req-ae506979-09ca-4499-a57e-3a3efdb854da tempest-VolumeDependencyTests-1764889188 None] Converted 1024.00 MB image at 123.67 MB/s Sep 18 21:51:53 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-ae506979-09ca-4499-a57e-3a3efdb854da tempest-VolumeDependencyTests-1764889188 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-527ddfdf-0fe7-460e-a902-c5407be6a664 is being set with open permissions: ugo+rw Sep 18 21:51:53 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ae506979-09ca-4499-a57e-3a3efdb854da tempest-VolumeDependencyTests-1764889188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-527ddfdf-0fe7-460e-a902-c5407be6a664 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:53 devstack sudo[104795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-527ddfdf-0fe7-460e-a902-c5407be6a664 Sep 18 21:51:53 devstack sudo[104795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:53 devstack sudo[104795]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:53 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ae506979-09ca-4499-a57e-3a3efdb854da tempest-VolumeDependencyTests-1764889188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-527ddfdf-0fe7-460e-a902-c5407be6a664" returned: 0 in 0.306s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:53 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-ae506979-09ca-4499-a57e-3a3efdb854da tempest-VolumeDependencyTests-1764889188 None] Lock "cinder-quobyte-527ddfdf-0fe7-460e-a902-c5407be6a664" released by "_copy_volume_from_snapshot" :: held 9.520s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:51:54 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-ae506979-09ca-4499-a57e-3a3efdb854da tempest-VolumeDependencyTests-1764889188 None] Lock "cinder-quobyte-a16215aa-7b15-4f6c-8be5-c275c39181fd-527ddfdf-0fe7-460e-a902-c5407be6a664" released by "_create_volume_from_snapshot" :: held 9.604s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:51:54 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-ae506979-09ca-4499-a57e-3a3efdb854da tempest-VolumeDependencyTests-1764889188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.628s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:51:54 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-122d1564-4d24-411e-be2f-490f6bf130a2 tempest-ProjectReaderTests-1147372370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.838s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:51:54 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-122d1564-4d24-411e-be2f-490f6bf130a2 tempest-ProjectReaderTests-1147372370 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:51:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1687675237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b4b250d-2123-4f21-b206-615d528e17d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d75ee007f0034ac994412b81b79f4c47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:51:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:51:44Z,use_quota=True,user_id='d5299d381c41405db9a80c86bdc14379',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:51:54 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-122d1564-4d24-411e-be2f-490f6bf130a2 tempest-ProjectReaderTests-1147372370 None] Creating volume 9b4b250d-2123-4f21-b206-615d528e17d8 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:51:54 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-122d1564-4d24-411e-be2f-490f6bf130a2 tempest-ProjectReaderTests-1147372370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:51:54 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-122d1564-4d24-411e-be2f-490f6bf130a2 tempest-ProjectReaderTests-1147372370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:51:54 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-122d1564-4d24-411e-be2f-490f6bf130a2 tempest-ProjectReaderTests-1147372370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:51:54 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-122d1564-4d24-411e-be2f-490f6bf130a2 tempest-ProjectReaderTests-1147372370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:51:54 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-122d1564-4d24-411e-be2f-490f6bf130a2 tempest-ProjectReaderTests-1147372370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:51:54 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-122d1564-4d24-411e-be2f-490f6bf130a2 tempest-ProjectReaderTests-1147372370 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:51:54 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-122d1564-4d24-411e-be2f-490f6bf130a2 tempest-ProjectReaderTests-1147372370 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:51:54 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-122d1564-4d24-411e-be2f-490f6bf130a2 tempest-ProjectReaderTests-1147372370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9b4b250d-2123-4f21-b206-615d528e17d8 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:54 devstack sudo[104798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9b4b250d-2123-4f21-b206-615d528e17d8 1073741824 Sep 18 21:51:54 devstack sudo[104798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:54 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ae506979-09ca-4499-a57e-3a3efdb854da tempest-VolumeDependencyTests-1764889188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (376c29ea-fd63-47c5-ab93-aa384c73903b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-527ddfdf-0fe7-460e-a902-c5407be6a664', 'volume_size': 1, 'snapshot_id': 'a16215aa-7b15-4f6c-8be5-c275c39181fd'}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:54 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ae506979-09ca-4499-a57e-3a3efdb854da tempest-VolumeDependencyTests-1764889188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70036172-e1e1-4641-81dc-9da8cf78128c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:54 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-ae506979-09ca-4499-a57e-3a3efdb854da tempest-VolumeDependencyTests-1764889188 None] Volume volume-527ddfdf-0fe7-460e-a902-c5407be6a664 (527ddfdf-0fe7-460e-a902-c5407be6a664): created successfully Sep 18 21:51:54 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ae506979-09ca-4499-a57e-3a3efdb854da tempest-VolumeDependencyTests-1764889188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70036172-e1e1-4641-81dc-9da8cf78128c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:54 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ae506979-09ca-4499-a57e-3a3efdb854da tempest-VolumeDependencyTests-1764889188 None] Flow 'volume_create_manager' (e3e27e7b-cd7c-4aa3-ad20-aa91bcce5d79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:51:54 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-ae506979-09ca-4499-a57e-3a3efdb854da tempest-VolumeDependencyTests-1764889188 None] Created volume successfully. Sep 18 21:51:54 devstack sudo[104798]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:54 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-122d1564-4d24-411e-be2f-490f6bf130a2 tempest-ProjectReaderTests-1147372370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9b4b250d-2123-4f21-b206-615d528e17d8 1073741824" returned: 0 in 0.519s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:54 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-122d1564-4d24-411e-be2f-490f6bf130a2 tempest-ProjectReaderTests-1147372370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9b4b250d-2123-4f21-b206-615d528e17d8 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:54 devstack sudo[104804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9b4b250d-2123-4f21-b206-615d528e17d8 Sep 18 21:51:54 devstack sudo[104804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:54 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-4169c023-814e-43af-92a2-170b7c7bf3c5 tempest-VolumeDependencyTests-1764889188 None] Acquiring lock "cinder-a16215aa-7b15-4f6c-8be5-c275c39181fd-delete_snapshot" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:51:54 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-4169c023-814e-43af-92a2-170b7c7bf3c5 tempest-VolumeDependencyTests-1764889188 None] Lock "cinder-a16215aa-7b15-4f6c-8be5-c275c39181fd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:51:54 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-4169c023-814e-43af-92a2-170b7c7bf3c5 tempest-VolumeDependencyTests-1764889188 None] Acquiring lock "cinder-quobyte-fb5525e3-8df7-4d97-af58-e332e733ffc4" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:51:54 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-4169c023-814e-43af-92a2-170b7c7bf3c5 tempest-VolumeDependencyTests-1764889188 None] Lock "cinder-quobyte-fb5525e3-8df7-4d97-af58-e332e733ffc4" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:51:54 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-4169c023-814e-43af-92a2-170b7c7bf3c5 tempest-VolumeDependencyTests-1764889188 None] Acquiring lock "cinder-quobyte-a16215aa-7b15-4f6c-8be5-c275c39181fd" by "_delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:51:54 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-4169c023-814e-43af-92a2-170b7c7bf3c5 tempest-VolumeDependencyTests-1764889188 None] Lock "cinder-quobyte-a16215aa-7b15-4f6c-8be5-c275c39181fd" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:51:54 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-4169c023-814e-43af-92a2-170b7c7bf3c5 tempest-VolumeDependencyTests-1764889188 None] Deleting offline snapshot a16215aa-7b15-4f6c-8be5-c275c39181fd of volume fb5525e3-8df7-4d97-af58-e332e733ffc4 {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 21:51:54 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-4169c023-814e-43af-92a2-170b7c7bf3c5 tempest-VolumeDependencyTests-1764889188 None] snapshot_file for this snap is: volume-fb5525e3-8df7-4d97-af58-e332e733ffc4.a16215aa-7b15-4f6c-8be5-c275c39181fd {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 21:51:54 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[0485db3b-bd68-4a46-ac29-7e13198ed369]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:51:54 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-4169c023-814e-43af-92a2-170b7c7bf3c5 tempest-VolumeDependencyTests-1764889188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fb5525e3-8df7-4d97-af58-e332e733ffc4.a16215aa-7b15-4f6c-8be5-c275c39181fd {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:54 devstack sudo[104806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fb5525e3-8df7-4d97-af58-e332e733ffc4.a16215aa-7b15-4f6c-8be5-c275c39181fd Sep 18 21:51:54 devstack sudo[104806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:54 devstack sudo[104804]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:54 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-122d1564-4d24-411e-be2f-490f6bf130a2 tempest-ProjectReaderTests-1147372370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9b4b250d-2123-4f21-b206-615d528e17d8" returned: 0 in 0.345s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:54 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-122d1564-4d24-411e-be2f-490f6bf130a2 tempest-ProjectReaderTests-1147372370 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:51:54 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-122d1564-4d24-411e-be2f-490f6bf130a2 tempest-ProjectReaderTests-1147372370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:51:54 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-ba267d3f-8f44-4a50-a92c-dc381dc792e7 tempest-ProjectReaderTests-462787125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.527s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:51:54 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-ba267d3f-8f44-4a50-a92c-dc381dc792e7 tempest-ProjectReaderTests-462787125 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:51:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-25458092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f04097dd-f33c-4794-a06a-ff2b4ee4c6d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dcc87503f13406caa33014a7a149d33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:51:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:51:52Z,use_quota=True,user_id='fd17cfd02234487cb53e780b5c3781e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:51:54 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-ba267d3f-8f44-4a50-a92c-dc381dc792e7 tempest-ProjectReaderTests-462787125 None] Creating volume f04097dd-f33c-4794-a06a-ff2b4ee4c6d3 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:51:54 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-ba267d3f-8f44-4a50-a92c-dc381dc792e7 tempest-ProjectReaderTests-462787125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:51:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-ba267d3f-8f44-4a50-a92c-dc381dc792e7 tempest-ProjectReaderTests-462787125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:51:55 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-ba267d3f-8f44-4a50-a92c-dc381dc792e7 tempest-ProjectReaderTests-462787125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:51:55 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-ba267d3f-8f44-4a50-a92c-dc381dc792e7 tempest-ProjectReaderTests-462787125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:51:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-ba267d3f-8f44-4a50-a92c-dc381dc792e7 tempest-ProjectReaderTests-462787125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:51:55 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-ba267d3f-8f44-4a50-a92c-dc381dc792e7 tempest-ProjectReaderTests-462787125 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:51:55 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-ba267d3f-8f44-4a50-a92c-dc381dc792e7 tempest-ProjectReaderTests-462787125 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:51:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ba267d3f-8f44-4a50-a92c-dc381dc792e7 tempest-ProjectReaderTests-462787125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f04097dd-f33c-4794-a06a-ff2b4ee4c6d3 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-122d1564-4d24-411e-be2f-490f6bf130a2 tempest-ProjectReaderTests-1147372370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdbe5d63-278e-4bec-a8aa-8cb391d47845) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b4b250d-2123-4f21-b206-615d528e17d8', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-122d1564-4d24-411e-be2f-490f6bf130a2 tempest-ProjectReaderTests-1147372370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95c552cc-9fc1-4f54-ad2c-b6a4c26c77df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:55 devstack sudo[104809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f04097dd-f33c-4794-a06a-ff2b4ee4c6d3 1073741824 Sep 18 21:51:55 devstack sudo[104809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:55 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-122d1564-4d24-411e-be2f-490f6bf130a2 tempest-ProjectReaderTests-1147372370 None] Volume volume-9b4b250d-2123-4f21-b206-615d528e17d8 (9b4b250d-2123-4f21-b206-615d528e17d8): created successfully Sep 18 21:51:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-122d1564-4d24-411e-be2f-490f6bf130a2 tempest-ProjectReaderTests-1147372370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95c552cc-9fc1-4f54-ad2c-b6a4c26c77df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-122d1564-4d24-411e-be2f-490f6bf130a2 tempest-ProjectReaderTests-1147372370 None] Flow 'volume_create_manager' (75b9d60c-67b7-42b1-883b-0cff33472f5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:51:55 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-122d1564-4d24-411e-be2f-490f6bf130a2 tempest-ProjectReaderTests-1147372370 None] Created volume successfully. Sep 18 21:51:55 devstack sudo[104806]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-4169c023-814e-43af-92a2-170b7c7bf3c5 tempest-VolumeDependencyTests-1764889188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fb5525e3-8df7-4d97-af58-e332e733ffc4.a16215aa-7b15-4f6c-8be5-c275c39181fd" returned: 0 in 0.484s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:55 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-4169c023-814e-43af-92a2-170b7c7bf3c5 tempest-VolumeDependencyTests-1764889188 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb5525e3-8df7-4d97-af58-e332e733ffc4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86136) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 21:51:55 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c23076-5859-4cc5-a615-aaa59b6372d0]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:51:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-4169c023-814e-43af-92a2-170b7c7bf3c5 tempest-VolumeDependencyTests-1764889188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fb5525e3-8df7-4d97-af58-e332e733ffc4 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:55 devstack sudo[104817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fb5525e3-8df7-4d97-af58-e332e733ffc4 Sep 18 21:51:55 devstack sudo[104817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:55 devstack sudo[104809]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ba267d3f-8f44-4a50-a92c-dc381dc792e7 tempest-ProjectReaderTests-462787125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f04097dd-f33c-4794-a06a-ff2b4ee4c6d3 1073741824" returned: 0 in 0.510s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ba267d3f-8f44-4a50-a92c-dc381dc792e7 tempest-ProjectReaderTests-462787125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f04097dd-f33c-4794-a06a-ff2b4ee4c6d3 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:55 devstack sudo[104820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f04097dd-f33c-4794-a06a-ff2b4ee4c6d3 Sep 18 21:51:55 devstack sudo[104820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:55 devstack sudo[104820]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ba267d3f-8f44-4a50-a92c-dc381dc792e7 tempest-ProjectReaderTests-462787125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f04097dd-f33c-4794-a06a-ff2b4ee4c6d3" returned: 0 in 0.313s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:55 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-ba267d3f-8f44-4a50-a92c-dc381dc792e7 tempest-ProjectReaderTests-462787125 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:51:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-ba267d3f-8f44-4a50-a92c-dc381dc792e7 tempest-ProjectReaderTests-462787125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:51:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ba267d3f-8f44-4a50-a92c-dc381dc792e7 tempest-ProjectReaderTests-462787125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3327839f-9296-4c1e-b750-fd3b895e5e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f04097dd-f33c-4794-a06a-ff2b4ee4c6d3', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:55 devstack sudo[104817]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ba267d3f-8f44-4a50-a92c-dc381dc792e7 tempest-ProjectReaderTests-462787125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dad5aff1-0b81-4888-a56b-1f9a0aa52755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-4169c023-814e-43af-92a2-170b7c7bf3c5 tempest-VolumeDependencyTests-1764889188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fb5525e3-8df7-4d97-af58-e332e733ffc4" returned: 0 in 0.587s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-4169c023-814e-43af-92a2-170b7c7bf3c5 tempest-VolumeDependencyTests-1764889188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fb5525e3-8df7-4d97-af58-e332e733ffc4.a16215aa-7b15-4f6c-8be5-c275c39181fd {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:55 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-ba267d3f-8f44-4a50-a92c-dc381dc792e7 tempest-ProjectReaderTests-462787125 None] Volume volume-f04097dd-f33c-4794-a06a-ff2b4ee4c6d3 (f04097dd-f33c-4794-a06a-ff2b4ee4c6d3): created successfully Sep 18 21:51:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ba267d3f-8f44-4a50-a92c-dc381dc792e7 tempest-ProjectReaderTests-462787125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dad5aff1-0b81-4888-a56b-1f9a0aa52755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-ba267d3f-8f44-4a50-a92c-dc381dc792e7 tempest-ProjectReaderTests-462787125 None] Flow 'volume_create_manager' (7c5b360c-38e3-47c5-be60-393b4a430297) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:51:55 devstack sudo[104826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fb5525e3-8df7-4d97-af58-e332e733ffc4.a16215aa-7b15-4f6c-8be5-c275c39181fd Sep 18 21:51:55 devstack sudo[104826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:55 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-ba267d3f-8f44-4a50-a92c-dc381dc792e7 tempest-ProjectReaderTests-462787125 None] Created volume successfully. Sep 18 21:51:56 devstack sudo[104826]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-4169c023-814e-43af-92a2-170b7c7bf3c5 tempest-VolumeDependencyTests-1764889188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fb5525e3-8df7-4d97-af58-e332e733ffc4.a16215aa-7b15-4f6c-8be5-c275c39181fd" returned: 0 in 0.427s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-4169c023-814e-43af-92a2-170b7c7bf3c5 tempest-VolumeDependencyTests-1764889188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fb5525e3-8df7-4d97-af58-e332e733ffc4.a16215aa-7b15-4f6c-8be5-c275c39181fd {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:56 devstack sudo[104832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fb5525e3-8df7-4d97-af58-e332e733ffc4.a16215aa-7b15-4f6c-8be5-c275c39181fd Sep 18 21:51:56 devstack sudo[104832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:56 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-497e4ec3-802b-4e50-81b2-fdae82db4a6c tempest-ProjectReaderTests-1147372370 None] Acquiring lock "cinder-9b4b250d-2123-4f21-b206-615d528e17d8-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:51:56 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-497e4ec3-802b-4e50-81b2-fdae82db4a6c tempest-ProjectReaderTests-1147372370 None] Lock "cinder-9b4b250d-2123-4f21-b206-615d528e17d8-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:51:56 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-497e4ec3-802b-4e50-81b2-fdae82db4a6c tempest-ProjectReaderTests-1147372370 None] Acquiring lock "cinder-quobyte-9b4b250d-2123-4f21-b206-615d528e17d8" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:51:56 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-497e4ec3-802b-4e50-81b2-fdae82db4a6c tempest-ProjectReaderTests-1147372370 None] Lock "cinder-quobyte-9b4b250d-2123-4f21-b206-615d528e17d8" acquired by "delete_volume" :: waited 0.033s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:51:56 devstack sudo[104832]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-4169c023-814e-43af-92a2-170b7c7bf3c5 tempest-VolumeDependencyTests-1764889188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fb5525e3-8df7-4d97-af58-e332e733ffc4.a16215aa-7b15-4f6c-8be5-c275c39181fd" returned: 0 in 0.342s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:56 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[eafac492-6253-4e3e-ab75-7458a35823c9]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:51:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-497e4ec3-802b-4e50-81b2-fdae82db4a6c tempest-ProjectReaderTests-1147372370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9b4b250d-2123-4f21-b206-615d528e17d8 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:56 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-4169c023-814e-43af-92a2-170b7c7bf3c5 tempest-VolumeDependencyTests-1764889188 None] Lock "cinder-quobyte-a16215aa-7b15-4f6c-8be5-c275c39181fd" released by "_delete_snapshot" :: held 1.990s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:51:56 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-4169c023-814e-43af-92a2-170b7c7bf3c5 tempest-VolumeDependencyTests-1764889188 None] Lock "cinder-quobyte-fb5525e3-8df7-4d97-af58-e332e733ffc4" released by "delete_snapshot" :: held 2.032s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:51:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-bccdc1a5-beed-4490-9f77-11855ef93450 tempest-ProjectReaderTests-462787125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:51:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-bccdc1a5-beed-4490-9f77-11855ef93450 tempest-ProjectReaderTests-462787125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:51:56 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-bccdc1a5-beed-4490-9f77-11855ef93450 tempest-ProjectReaderTests-462787125 None] Creating offline snapshot bd5ba661-2a4f-42eb-8832-ea4929603b85 of volume f04097dd-f33c-4794-a06a-ff2b4ee4c6d3 {{(pid=86136) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 21:51:56 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca22ea98-1dfa-43fc-bae0-15f23d62ad99]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:51:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-bccdc1a5-beed-4490-9f77-11855ef93450 tempest-ProjectReaderTests-462787125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f04097dd-f33c-4794-a06a-ff2b4ee4c6d3 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:56 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-4169c023-814e-43af-92a2-170b7c7bf3c5 tempest-VolumeDependencyTests-1764889188 None] Created reservations ['1f916c9e-3b04-483c-bce7-4d72d5888905', '3cdfb898-e13f-471e-a518-1231d9345a5f', '9ee7bae0-ea33-4dec-8bf9-f7ade26cc2b9', 'eaf9c99b-4208-4e27-bd4e-e2a32f802e0c'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:51:56 devstack sudo[104835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9b4b250d-2123-4f21-b206-615d528e17d8 Sep 18 21:51:56 devstack sudo[104835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:56 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-4169c023-814e-43af-92a2-170b7c7bf3c5 tempest-VolumeDependencyTests-1764889188 None] Delete snapshot completed successfully. Sep 18 21:51:56 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-4169c023-814e-43af-92a2-170b7c7bf3c5 tempest-VolumeDependencyTests-1764889188 None] Lock "cinder-a16215aa-7b15-4f6c-8be5-c275c39181fd-delete_snapshot" released by "delete_snapshot" :: held 2.264s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:51:57 devstack sudo[104836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f04097dd-f33c-4794-a06a-ff2b4ee4c6d3 Sep 18 21:51:57 devstack sudo[104836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:57 devstack sudo[104835]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-497e4ec3-802b-4e50-81b2-fdae82db4a6c tempest-ProjectReaderTests-1147372370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9b4b250d-2123-4f21-b206-615d528e17d8" returned: 0 in 0.490s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-497e4ec3-802b-4e50-81b2-fdae82db4a6c tempest-ProjectReaderTests-1147372370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9b4b250d-2123-4f21-b206-615d528e17d8 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:57 devstack sudo[104844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9b4b250d-2123-4f21-b206-615d528e17d8 Sep 18 21:51:57 devstack sudo[104844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:57 devstack sudo[104836]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-bccdc1a5-beed-4490-9f77-11855ef93450 tempest-ProjectReaderTests-462787125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f04097dd-f33c-4794-a06a-ff2b4ee4c6d3" returned: 0 in 0.451s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-bccdc1a5-beed-4490-9f77-11855ef93450 tempest-ProjectReaderTests-462787125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f04097dd-f33c-4794-a06a-ff2b4ee4c6d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f04097dd-f33c-4794-a06a-ff2b4ee4c6d3.bd5ba661-2a4f-42eb-8832-ea4929603b85 1G {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:57 devstack sudo[104849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f04097dd-f33c-4794-a06a-ff2b4ee4c6d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f04097dd-f33c-4794-a06a-ff2b4ee4c6d3.bd5ba661-2a4f-42eb-8832-ea4929603b85 1G Sep 18 21:51:57 devstack sudo[104849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:57 devstack sudo[104844]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-497e4ec3-802b-4e50-81b2-fdae82db4a6c tempest-ProjectReaderTests-1147372370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-9b4b250d-2123-4f21-b206-615d528e17d8" returned: 0 in 0.343s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:57 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-497e4ec3-802b-4e50-81b2-fdae82db4a6c tempest-ProjectReaderTests-1147372370 None] Lock "cinder-quobyte-9b4b250d-2123-4f21-b206-615d528e17d8" released by "delete_volume" :: held 0.916s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:51:57 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-497e4ec3-802b-4e50-81b2-fdae82db4a6c tempest-ProjectReaderTests-1147372370 None] Created reservations ['d6baa518-59e8-45cf-b8bb-b85931f85dcd', '255588d7-ef92-433a-8f8a-0761066b115e', 'a2b3c12d-9586-4e6f-99ee-30b8fdfbc8ed', '8ff56b51-3c94-4ea8-a131-8b097bea9ad5'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:51:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-497e4ec3-802b-4e50-81b2-fdae82db4a6c tempest-ProjectReaderTests-1147372370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:51:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-497e4ec3-802b-4e50-81b2-fdae82db4a6c tempest-ProjectReaderTests-1147372370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:51:57 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-497e4ec3-802b-4e50-81b2-fdae82db4a6c tempest-ProjectReaderTests-1147372370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:51:57 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-497e4ec3-802b-4e50-81b2-fdae82db4a6c tempest-ProjectReaderTests-1147372370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:51:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-497e4ec3-802b-4e50-81b2-fdae82db4a6c tempest-ProjectReaderTests-1147372370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:51:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-497e4ec3-802b-4e50-81b2-fdae82db4a6c tempest-ProjectReaderTests-1147372370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:57 devstack sudo[104855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:51:57 devstack sudo[104855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:57 devstack sudo[104849]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-bccdc1a5-beed-4490-9f77-11855ef93450 tempest-ProjectReaderTests-462787125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f04097dd-f33c-4794-a06a-ff2b4ee4c6d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f04097dd-f33c-4794-a06a-ff2b4ee4c6d3.bd5ba661-2a4f-42eb-8832-ea4929603b85 1G" returned: 0 in 0.628s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-bccdc1a5-beed-4490-9f77-11855ef93450 tempest-ProjectReaderTests-462787125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f04097dd-f33c-4794-a06a-ff2b4ee4c6d3 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f04097dd-f33c-4794-a06a-ff2b4ee4c6d3.bd5ba661-2a4f-42eb-8832-ea4929603b85 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:58 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-5a22c23a-f970-49ec-b783-86eae779a3f8 tempest-VolumeDependencyTests-1764889188 None] Acquiring lock "cinder-fb5525e3-8df7-4d97-af58-e332e733ffc4-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:51:58 devstack sudo[104858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f04097dd-f33c-4794-a06a-ff2b4ee4c6d3 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f04097dd-f33c-4794-a06a-ff2b4ee4c6d3.bd5ba661-2a4f-42eb-8832-ea4929603b85 Sep 18 21:51:58 devstack sudo[104858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:58 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-5a22c23a-f970-49ec-b783-86eae779a3f8 tempest-VolumeDependencyTests-1764889188 None] Lock "cinder-fb5525e3-8df7-4d97-af58-e332e733ffc4-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:51:58 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-5a22c23a-f970-49ec-b783-86eae779a3f8 tempest-VolumeDependencyTests-1764889188 None] Acquiring lock "cinder-quobyte-fb5525e3-8df7-4d97-af58-e332e733ffc4" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:51:58 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-5a22c23a-f970-49ec-b783-86eae779a3f8 tempest-VolumeDependencyTests-1764889188 None] Lock "cinder-quobyte-fb5525e3-8df7-4d97-af58-e332e733ffc4" acquired by "delete_volume" :: waited 0.038s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:51:58 devstack sudo[104855]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:58 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e8a001-629e-41a7-bc10-52d3044e9d5a]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:51:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5a22c23a-f970-49ec-b783-86eae779a3f8 tempest-VolumeDependencyTests-1764889188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fb5525e3-8df7-4d97-af58-e332e733ffc4 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-497e4ec3-802b-4e50-81b2-fdae82db4a6c tempest-ProjectReaderTests-1147372370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.462s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:58 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-497e4ec3-802b-4e50-81b2-fdae82db4a6c tempest-ProjectReaderTests-1147372370 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:51:58 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-497e4ec3-802b-4e50-81b2-fdae82db4a6c tempest-ProjectReaderTests-1147372370 None] Deleted volume successfully. Sep 18 21:51:58 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-497e4ec3-802b-4e50-81b2-fdae82db4a6c tempest-ProjectReaderTests-1147372370 None] Lock "cinder-9b4b250d-2123-4f21-b206-615d528e17d8-delete_volume" released by "delete_volume" :: held 1.781s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:51:58 devstack sudo[104861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fb5525e3-8df7-4d97-af58-e332e733ffc4 Sep 18 21:51:58 devstack sudo[104861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:58 devstack sudo[104858]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-bccdc1a5-beed-4490-9f77-11855ef93450 tempest-ProjectReaderTests-462787125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f04097dd-f33c-4794-a06a-ff2b4ee4c6d3 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f04097dd-f33c-4794-a06a-ff2b4ee4c6d3.bd5ba661-2a4f-42eb-8832-ea4929603b85" returned: 0 in 0.454s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:58 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-bccdc1a5-beed-4490-9f77-11855ef93450 tempest-ProjectReaderTests-462787125 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f04097dd-f33c-4794-a06a-ff2b4ee4c6d3.bd5ba661-2a4f-42eb-8832-ea4929603b85 is being set with open permissions: ugo+rw Sep 18 21:51:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-bccdc1a5-beed-4490-9f77-11855ef93450 tempest-ProjectReaderTests-462787125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f04097dd-f33c-4794-a06a-ff2b4ee4c6d3.bd5ba661-2a4f-42eb-8832-ea4929603b85 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:58 devstack sudo[104866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f04097dd-f33c-4794-a06a-ff2b4ee4c6d3.bd5ba661-2a4f-42eb-8832-ea4929603b85 Sep 18 21:51:58 devstack sudo[104866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:58 devstack sudo[104861]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5a22c23a-f970-49ec-b783-86eae779a3f8 tempest-VolumeDependencyTests-1764889188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fb5525e3-8df7-4d97-af58-e332e733ffc4" returned: 0 in 0.462s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5a22c23a-f970-49ec-b783-86eae779a3f8 tempest-VolumeDependencyTests-1764889188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fb5525e3-8df7-4d97-af58-e332e733ffc4 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:58 devstack sudo[104872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fb5525e3-8df7-4d97-af58-e332e733ffc4 Sep 18 21:51:58 devstack sudo[104872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:58 devstack sudo[104866]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-bccdc1a5-beed-4490-9f77-11855ef93450 tempest-ProjectReaderTests-462787125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f04097dd-f33c-4794-a06a-ff2b4ee4c6d3.bd5ba661-2a4f-42eb-8832-ea4929603b85" returned: 0 in 0.303s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-bccdc1a5-beed-4490-9f77-11855ef93450 tempest-ProjectReaderTests-462787125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f04097dd-f33c-4794-a06a-ff2b4ee4c6d3.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:58 devstack sudo[104874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f04097dd-f33c-4794-a06a-ff2b4ee4c6d3.info Sep 18 21:51:58 devstack sudo[104874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:58 devstack sudo[104872]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5a22c23a-f970-49ec-b783-86eae779a3f8 tempest-VolumeDependencyTests-1764889188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-fb5525e3-8df7-4d97-af58-e332e733ffc4" returned: 0 in 0.304s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:59 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-5a22c23a-f970-49ec-b783-86eae779a3f8 tempest-VolumeDependencyTests-1764889188 None] Lock "cinder-quobyte-fb5525e3-8df7-4d97-af58-e332e733ffc4" released by "delete_volume" :: held 0.884s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:51:59 devstack sudo[104874]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-bccdc1a5-beed-4490-9f77-11855ef93450 tempest-ProjectReaderTests-462787125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f04097dd-f33c-4794-a06a-ff2b4ee4c6d3.info" returned: 0 in 0.331s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:59 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-5a22c23a-f970-49ec-b783-86eae779a3f8 tempest-VolumeDependencyTests-1764889188 None] Created reservations ['49be1dc8-76b0-421c-96e1-c781fb84a4ae', 'e5dca7a3-76d4-4fc8-a784-d2aa810d948f', 'fe2d4b51-c60a-467c-8a27-02cb57f34ce1', '44dc8fcd-b378-402f-8c35-3accf80f41e8'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:51:59 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-bccdc1a5-beed-4490-9f77-11855ef93450 tempest-ProjectReaderTests-462787125 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f04097dd-f33c-4794-a06a-ff2b4ee4c6d3.info is being set with open permissions: ugo+rw Sep 18 21:51:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-bccdc1a5-beed-4490-9f77-11855ef93450 tempest-ProjectReaderTests-462787125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f04097dd-f33c-4794-a06a-ff2b4ee4c6d3.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:59 devstack sudo[104878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f04097dd-f33c-4794-a06a-ff2b4ee4c6d3.info Sep 18 21:51:59 devstack sudo[104878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-5a22c23a-f970-49ec-b783-86eae779a3f8 tempest-VolumeDependencyTests-1764889188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:51:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-5a22c23a-f970-49ec-b783-86eae779a3f8 tempest-VolumeDependencyTests-1764889188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:51:59 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-5a22c23a-f970-49ec-b783-86eae779a3f8 tempest-VolumeDependencyTests-1764889188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:51:59 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-5a22c23a-f970-49ec-b783-86eae779a3f8 tempest-VolumeDependencyTests-1764889188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:51:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-5a22c23a-f970-49ec-b783-86eae779a3f8 tempest-VolumeDependencyTests-1764889188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:51:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5a22c23a-f970-49ec-b783-86eae779a3f8 tempest-VolumeDependencyTests-1764889188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:59 devstack sudo[104880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:51:59 devstack sudo[104880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:59 devstack sudo[104878]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-bccdc1a5-beed-4490-9f77-11855ef93450 tempest-ProjectReaderTests-462787125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f04097dd-f33c-4794-a06a-ff2b4ee4c6d3.info" returned: 0 in 0.326s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-bccdc1a5-beed-4490-9f77-11855ef93450 tempest-ProjectReaderTests-462787125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.612s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:51:59 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-bccdc1a5-beed-4490-9f77-11855ef93450 tempest-ProjectReaderTests-462787125 None] Create snapshot completed successfully Sep 18 21:51:59 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-599a2e11-d837-472d-b623-66b1099af870 tempest-ProjectReaderTests-1147372370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:51:59 devstack sudo[104880]: pam_unix(sudo:session): session closed for user root Sep 18 21:51:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-599a2e11-d837-472d-b623-66b1099af870 tempest-ProjectReaderTests-1147372370 None] Flow 'volume_create_manager' (8681a37c-f12b-4caa-940b-dd6134ae49ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:51:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-599a2e11-d837-472d-b623-66b1099af870 tempest-ProjectReaderTests-1147372370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27f492f8-a98f-4181-be0e-834c44e1fbdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5a22c23a-f970-49ec-b783-86eae779a3f8 tempest-VolumeDependencyTests-1764889188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.306s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:51:59 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-5a22c23a-f970-49ec-b783-86eae779a3f8 tempest-VolumeDependencyTests-1764889188 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:51:59 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-5a22c23a-f970-49ec-b783-86eae779a3f8 tempest-VolumeDependencyTests-1764889188 None] Deleted volume successfully. Sep 18 21:51:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-599a2e11-d837-472d-b623-66b1099af870 tempest-ProjectReaderTests-1147372370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27f492f8-a98f-4181-be0e-834c44e1fbdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1752762942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31f84956-b20a-43d6-8626-4a2bf46b8c08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d75ee007f0034ac994412b81b79f4c47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:51:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:51:59Z,use_quota=True,user_id='d5299d381c41405db9a80c86bdc14379',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-599a2e11-d837-472d-b623-66b1099af870 tempest-ProjectReaderTests-1147372370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16b0407a-d864-4dc4-866d-24f76df52dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-599a2e11-d837-472d-b623-66b1099af870 tempest-ProjectReaderTests-1147372370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16b0407a-d864-4dc4-866d-24f76df52dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-599a2e11-d837-472d-b623-66b1099af870 tempest-ProjectReaderTests-1147372370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26fe2038-4cdf-49d6-bd61-e8a728bd4561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-599a2e11-d837-472d-b623-66b1099af870 tempest-ProjectReaderTests-1147372370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26fe2038-4cdf-49d6-bd61-e8a728bd4561) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31f84956-b20a-43d6-8626-4a2bf46b8c08', 'volume_name': 'volume-31f84956-b20a-43d6-8626-4a2bf46b8c08', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-599a2e11-d837-472d-b623-66b1099af870 tempest-ProjectReaderTests-1147372370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d04e8ced-1d9f-4bf9-b905-d77d25440a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-599a2e11-d837-472d-b623-66b1099af870 tempest-ProjectReaderTests-1147372370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d04e8ced-1d9f-4bf9-b905-d77d25440a0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:51:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-599a2e11-d837-472d-b623-66b1099af870 tempest-ProjectReaderTests-1147372370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90d7d671-f80f-49aa-b3b8-ee767dffe212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:51:59 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-599a2e11-d837-472d-b623-66b1099af870 tempest-ProjectReaderTests-1147372370 None] Volume 31f84956-b20a-43d6-8626-4a2bf46b8c08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31f84956-b20a-43d6-8626-4a2bf46b8c08', 'volume_size': 1} Sep 18 21:51:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-599a2e11-d837-472d-b623-66b1099af870 tempest-ProjectReaderTests-1147372370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:51:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-599a2e11-d837-472d-b623-66b1099af870 tempest-ProjectReaderTests-1147372370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:51:59 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-599a2e11-d837-472d-b623-66b1099af870 tempest-ProjectReaderTests-1147372370 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1752762942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31f84956-b20a-43d6-8626-4a2bf46b8c08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d75ee007f0034ac994412b81b79f4c47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:51:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:51:59Z,use_quota=True,user_id='d5299d381c41405db9a80c86bdc14379',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:51:59 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-599a2e11-d837-472d-b623-66b1099af870 tempest-ProjectReaderTests-1147372370 None] Creating volume 31f84956-b20a-43d6-8626-4a2bf46b8c08 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:51:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-599a2e11-d837-472d-b623-66b1099af870 tempest-ProjectReaderTests-1147372370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:51:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-599a2e11-d837-472d-b623-66b1099af870 tempest-ProjectReaderTests-1147372370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:51:59 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-599a2e11-d837-472d-b623-66b1099af870 tempest-ProjectReaderTests-1147372370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:51:59 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-599a2e11-d837-472d-b623-66b1099af870 tempest-ProjectReaderTests-1147372370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:51:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-599a2e11-d837-472d-b623-66b1099af870 tempest-ProjectReaderTests-1147372370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:51:59 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-599a2e11-d837-472d-b623-66b1099af870 tempest-ProjectReaderTests-1147372370 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:51:59 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-599a2e11-d837-472d-b623-66b1099af870 tempest-ProjectReaderTests-1147372370 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:51:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-599a2e11-d837-472d-b623-66b1099af870 tempest-ProjectReaderTests-1147372370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-31f84956-b20a-43d6-8626-4a2bf46b8c08 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:51:59 devstack sudo[104884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-31f84956-b20a-43d6-8626-4a2bf46b8c08 1073741824 Sep 18 21:51:59 devstack sudo[104884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:51:59 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-5a22c23a-f970-49ec-b783-86eae779a3f8 tempest-VolumeDependencyTests-1764889188 None] Lock "cinder-fb5525e3-8df7-4d97-af58-e332e733ffc4-delete_volume" released by "delete_volume" :: held 1.667s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:52:00 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-6a962737-a261-4843-8091-4e14cc5cf34d tempest-ProjectReaderTests-462787125 None] Acquiring lock "cinder-bd5ba661-2a4f-42eb-8832-ea4929603b85-delete_snapshot" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:52:00 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-6a962737-a261-4843-8091-4e14cc5cf34d tempest-ProjectReaderTests-462787125 None] Lock "cinder-bd5ba661-2a4f-42eb-8832-ea4929603b85-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:52:00 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-6a962737-a261-4843-8091-4e14cc5cf34d tempest-ProjectReaderTests-462787125 None] Acquiring lock "cinder-quobyte-f04097dd-f33c-4794-a06a-ff2b4ee4c6d3" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:52:00 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-6a962737-a261-4843-8091-4e14cc5cf34d tempest-ProjectReaderTests-462787125 None] Lock "cinder-quobyte-f04097dd-f33c-4794-a06a-ff2b4ee4c6d3" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:52:00 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-6a962737-a261-4843-8091-4e14cc5cf34d tempest-ProjectReaderTests-462787125 None] Acquiring lock "cinder-quobyte-bd5ba661-2a4f-42eb-8832-ea4929603b85" by "_delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:52:00 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-6a962737-a261-4843-8091-4e14cc5cf34d tempest-ProjectReaderTests-462787125 None] Lock "cinder-quobyte-bd5ba661-2a4f-42eb-8832-ea4929603b85" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:52:00 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-6a962737-a261-4843-8091-4e14cc5cf34d tempest-ProjectReaderTests-462787125 None] Deleting offline snapshot bd5ba661-2a4f-42eb-8832-ea4929603b85 of volume f04097dd-f33c-4794-a06a-ff2b4ee4c6d3 {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 21:52:00 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-6a962737-a261-4843-8091-4e14cc5cf34d tempest-ProjectReaderTests-462787125 None] snapshot_file for this snap is: volume-f04097dd-f33c-4794-a06a-ff2b4ee4c6d3.bd5ba661-2a4f-42eb-8832-ea4929603b85 {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 21:52:00 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a62e3ab-e4c7-479e-bf9e-45c7c00a8147]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:52:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6a962737-a261-4843-8091-4e14cc5cf34d tempest-ProjectReaderTests-462787125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f04097dd-f33c-4794-a06a-ff2b4ee4c6d3.bd5ba661-2a4f-42eb-8832-ea4929603b85 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:00 devstack sudo[104884]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-599a2e11-d837-472d-b623-66b1099af870 tempest-ProjectReaderTests-1147372370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-31f84956-b20a-43d6-8626-4a2bf46b8c08 1073741824" returned: 0 in 0.550s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-599a2e11-d837-472d-b623-66b1099af870 tempest-ProjectReaderTests-1147372370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-31f84956-b20a-43d6-8626-4a2bf46b8c08 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:00 devstack sudo[104891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-31f84956-b20a-43d6-8626-4a2bf46b8c08 Sep 18 21:52:00 devstack sudo[104891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:00 devstack sudo[104890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f04097dd-f33c-4794-a06a-ff2b4ee4c6d3.bd5ba661-2a4f-42eb-8832-ea4929603b85 Sep 18 21:52:00 devstack sudo[104890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:00 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-72facfd1-748b-4bac-98d3-0d9632b957e9 tempest-VolumeDependencyTests-1764889188 None] Acquiring lock "cinder-527ddfdf-0fe7-460e-a902-c5407be6a664-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:52:00 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-72facfd1-748b-4bac-98d3-0d9632b957e9 tempest-VolumeDependencyTests-1764889188 None] Lock "cinder-527ddfdf-0fe7-460e-a902-c5407be6a664-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:52:00 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-72facfd1-748b-4bac-98d3-0d9632b957e9 tempest-VolumeDependencyTests-1764889188 None] Acquiring lock "cinder-quobyte-527ddfdf-0fe7-460e-a902-c5407be6a664" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:52:00 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-72facfd1-748b-4bac-98d3-0d9632b957e9 tempest-VolumeDependencyTests-1764889188 None] Lock "cinder-quobyte-527ddfdf-0fe7-460e-a902-c5407be6a664" acquired by "delete_volume" :: waited 0.026s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:52:00 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[8150801e-c7e6-4630-95f7-b6d3ba1e128d]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:52:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-72facfd1-748b-4bac-98d3-0d9632b957e9 tempest-VolumeDependencyTests-1764889188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-527ddfdf-0fe7-460e-a902-c5407be6a664 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:00 devstack sudo[104891]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-599a2e11-d837-472d-b623-66b1099af870 tempest-ProjectReaderTests-1147372370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-31f84956-b20a-43d6-8626-4a2bf46b8c08" returned: 0 in 0.355s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:00 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-599a2e11-d837-472d-b623-66b1099af870 tempest-ProjectReaderTests-1147372370 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:52:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-599a2e11-d837-472d-b623-66b1099af870 tempest-ProjectReaderTests-1147372370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:52:00 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-599a2e11-d837-472d-b623-66b1099af870 tempest-ProjectReaderTests-1147372370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90d7d671-f80f-49aa-b3b8-ee767dffe212) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31f84956-b20a-43d6-8626-4a2bf46b8c08', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:52:00 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-599a2e11-d837-472d-b623-66b1099af870 tempest-ProjectReaderTests-1147372370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5e85e9a-58fe-48b8-949a-2e9f293b9cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:52:00 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-599a2e11-d837-472d-b623-66b1099af870 tempest-ProjectReaderTests-1147372370 None] Volume volume-31f84956-b20a-43d6-8626-4a2bf46b8c08 (31f84956-b20a-43d6-8626-4a2bf46b8c08): created successfully Sep 18 21:52:00 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-599a2e11-d837-472d-b623-66b1099af870 tempest-ProjectReaderTests-1147372370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5e85e9a-58fe-48b8-949a-2e9f293b9cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:52:00 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-599a2e11-d837-472d-b623-66b1099af870 tempest-ProjectReaderTests-1147372370 None] Flow 'volume_create_manager' (8681a37c-f12b-4caa-940b-dd6134ae49ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:52:00 devstack sudo[104895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-527ddfdf-0fe7-460e-a902-c5407be6a664 Sep 18 21:52:00 devstack sudo[104895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:00 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-599a2e11-d837-472d-b623-66b1099af870 tempest-ProjectReaderTests-1147372370 None] Created volume successfully. Sep 18 21:52:00 devstack sudo[104890]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6a962737-a261-4843-8091-4e14cc5cf34d tempest-ProjectReaderTests-462787125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f04097dd-f33c-4794-a06a-ff2b4ee4c6d3.bd5ba661-2a4f-42eb-8832-ea4929603b85" returned: 0 in 0.594s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:00 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-6a962737-a261-4843-8091-4e14cc5cf34d tempest-ProjectReaderTests-462787125 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f04097dd-f33c-4794-a06a-ff2b4ee4c6d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86136) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 21:52:00 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb0ef127-f2bd-4c0e-b629-3c0b86f34920]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:52:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6a962737-a261-4843-8091-4e14cc5cf34d tempest-ProjectReaderTests-462787125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f04097dd-f33c-4794-a06a-ff2b4ee4c6d3 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:00 devstack sudo[104900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f04097dd-f33c-4794-a06a-ff2b4ee4c6d3 Sep 18 21:52:00 devstack sudo[104900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:01 devstack sudo[104895]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-72facfd1-748b-4bac-98d3-0d9632b957e9 tempest-VolumeDependencyTests-1764889188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-527ddfdf-0fe7-460e-a902-c5407be6a664" returned: 0 in 0.464s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-72facfd1-748b-4bac-98d3-0d9632b957e9 tempest-VolumeDependencyTests-1764889188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-527ddfdf-0fe7-460e-a902-c5407be6a664 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:01 devstack sudo[104906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-527ddfdf-0fe7-460e-a902-c5407be6a664 Sep 18 21:52:01 devstack sudo[104906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:01 devstack sudo[104900]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6a962737-a261-4843-8091-4e14cc5cf34d tempest-ProjectReaderTests-462787125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f04097dd-f33c-4794-a06a-ff2b4ee4c6d3" returned: 0 in 0.424s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6a962737-a261-4843-8091-4e14cc5cf34d tempest-ProjectReaderTests-462787125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f04097dd-f33c-4794-a06a-ff2b4ee4c6d3.bd5ba661-2a4f-42eb-8832-ea4929603b85 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:01 devstack sudo[104911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f04097dd-f33c-4794-a06a-ff2b4ee4c6d3.bd5ba661-2a4f-42eb-8832-ea4929603b85 Sep 18 21:52:01 devstack sudo[104911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:01 devstack sudo[104906]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-72facfd1-748b-4bac-98d3-0d9632b957e9 tempest-VolumeDependencyTests-1764889188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-527ddfdf-0fe7-460e-a902-c5407be6a664" returned: 0 in 0.315s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:01 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-72facfd1-748b-4bac-98d3-0d9632b957e9 tempest-VolumeDependencyTests-1764889188 None] Lock "cinder-quobyte-527ddfdf-0fe7-460e-a902-c5407be6a664" released by "delete_volume" :: held 0.858s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:52:01 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-72facfd1-748b-4bac-98d3-0d9632b957e9 tempest-VolumeDependencyTests-1764889188 None] Created reservations ['b8e80774-8872-40c5-bd81-56ebf981b368', '46c7e2d5-8e94-4264-9945-2febbc4f0bbf', '9b28af42-34d9-4073-b3d0-64a03eed8138', '545feda3-7690-40f1-a38f-5cc823f20d3d'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:52:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-72facfd1-748b-4bac-98d3-0d9632b957e9 tempest-VolumeDependencyTests-1764889188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:52:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-72facfd1-748b-4bac-98d3-0d9632b957e9 tempest-VolumeDependencyTests-1764889188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:52:01 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-72facfd1-748b-4bac-98d3-0d9632b957e9 tempest-VolumeDependencyTests-1764889188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:52:01 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-72facfd1-748b-4bac-98d3-0d9632b957e9 tempest-VolumeDependencyTests-1764889188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:52:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-72facfd1-748b-4bac-98d3-0d9632b957e9 tempest-VolumeDependencyTests-1764889188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:52:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-72facfd1-748b-4bac-98d3-0d9632b957e9 tempest-VolumeDependencyTests-1764889188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:01 devstack sudo[104917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:52:01 devstack sudo[104917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:01 devstack sudo[104911]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6a962737-a261-4843-8091-4e14cc5cf34d tempest-ProjectReaderTests-462787125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f04097dd-f33c-4794-a06a-ff2b4ee4c6d3.bd5ba661-2a4f-42eb-8832-ea4929603b85" returned: 0 in 0.529s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6a962737-a261-4843-8091-4e14cc5cf34d tempest-ProjectReaderTests-462787125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f04097dd-f33c-4794-a06a-ff2b4ee4c6d3.bd5ba661-2a4f-42eb-8832-ea4929603b85 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:01 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-c7f648ff-3a60-42ce-84f8-7fa3f07d17e8 tempest-ProjectReaderTests-1147372370 None] Acquiring lock "cinder-31f84956-b20a-43d6-8626-4a2bf46b8c08-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:52:01 devstack sudo[104919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f04097dd-f33c-4794-a06a-ff2b4ee4c6d3.bd5ba661-2a4f-42eb-8832-ea4929603b85 Sep 18 21:52:01 devstack sudo[104919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:01 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-c7f648ff-3a60-42ce-84f8-7fa3f07d17e8 tempest-ProjectReaderTests-1147372370 None] Lock "cinder-31f84956-b20a-43d6-8626-4a2bf46b8c08-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:52:01 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-c7f648ff-3a60-42ce-84f8-7fa3f07d17e8 tempest-ProjectReaderTests-1147372370 None] Acquiring lock "cinder-quobyte-31f84956-b20a-43d6-8626-4a2bf46b8c08" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:52:01 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-c7f648ff-3a60-42ce-84f8-7fa3f07d17e8 tempest-ProjectReaderTests-1147372370 None] Lock "cinder-quobyte-31f84956-b20a-43d6-8626-4a2bf46b8c08" acquired by "delete_volume" :: waited 0.019s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:52:01 devstack sudo[104917]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-72facfd1-748b-4bac-98d3-0d9632b957e9 tempest-VolumeDependencyTests-1764889188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.429s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:01 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-72facfd1-748b-4bac-98d3-0d9632b957e9 tempest-VolumeDependencyTests-1764889188 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:52:01 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc165ca-bfcf-4ede-be61-c8e3ae221a2d]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:52:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c7f648ff-3a60-42ce-84f8-7fa3f07d17e8 tempest-ProjectReaderTests-1147372370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-31f84956-b20a-43d6-8626-4a2bf46b8c08 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:01 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-72facfd1-748b-4bac-98d3-0d9632b957e9 tempest-VolumeDependencyTests-1764889188 None] Deleted volume successfully. Sep 18 21:52:02 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-72facfd1-748b-4bac-98d3-0d9632b957e9 tempest-VolumeDependencyTests-1764889188 None] Lock "cinder-527ddfdf-0fe7-460e-a902-c5407be6a664-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:52:02 devstack sudo[104922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-31f84956-b20a-43d6-8626-4a2bf46b8c08 Sep 18 21:52:02 devstack sudo[104922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:02 devstack sudo[104919]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:02 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6a962737-a261-4843-8091-4e14cc5cf34d tempest-ProjectReaderTests-462787125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f04097dd-f33c-4794-a06a-ff2b4ee4c6d3.bd5ba661-2a4f-42eb-8832-ea4929603b85" returned: 0 in 0.445s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:02 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-6a962737-a261-4843-8091-4e14cc5cf34d tempest-ProjectReaderTests-462787125 None] Lock "cinder-quobyte-bd5ba661-2a4f-42eb-8832-ea4929603b85" released by "_delete_snapshot" :: held 2.130s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:52:02 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-6a962737-a261-4843-8091-4e14cc5cf34d tempest-ProjectReaderTests-462787125 None] Lock "cinder-quobyte-f04097dd-f33c-4794-a06a-ff2b4ee4c6d3" released by "delete_snapshot" :: held 2.163s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:52:02 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-6a962737-a261-4843-8091-4e14cc5cf34d tempest-ProjectReaderTests-462787125 None] Created reservations ['ce256e72-a2e7-407f-a2d2-b1ae069be3d9', '9d7c9a79-33f4-4147-ad30-a491e672e9f3', '064daf6f-d0d4-4679-83ec-4f7d2c308287', '8cc9037b-54ec-4aae-b607-100e10975cda'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:52:02 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-6a962737-a261-4843-8091-4e14cc5cf34d tempest-ProjectReaderTests-462787125 None] Delete snapshot completed successfully. Sep 18 21:52:02 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-6a962737-a261-4843-8091-4e14cc5cf34d tempest-ProjectReaderTests-462787125 None] Lock "cinder-bd5ba661-2a4f-42eb-8832-ea4929603b85-delete_snapshot" released by "delete_snapshot" :: held 2.369s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:52:02 devstack sudo[104922]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:02 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c7f648ff-3a60-42ce-84f8-7fa3f07d17e8 tempest-ProjectReaderTests-1147372370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-31f84956-b20a-43d6-8626-4a2bf46b8c08" returned: 0 in 0.493s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:02 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c7f648ff-3a60-42ce-84f8-7fa3f07d17e8 tempest-ProjectReaderTests-1147372370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-31f84956-b20a-43d6-8626-4a2bf46b8c08 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:02 devstack sudo[104928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-31f84956-b20a-43d6-8626-4a2bf46b8c08 Sep 18 21:52:02 devstack sudo[104928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:02 devstack sudo[104928]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:02 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c7f648ff-3a60-42ce-84f8-7fa3f07d17e8 tempest-ProjectReaderTests-1147372370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-31f84956-b20a-43d6-8626-4a2bf46b8c08" returned: 0 in 0.296s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:02 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-c7f648ff-3a60-42ce-84f8-7fa3f07d17e8 tempest-ProjectReaderTests-1147372370 None] Lock "cinder-quobyte-31f84956-b20a-43d6-8626-4a2bf46b8c08" released by "delete_volume" :: held 0.865s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:52:02 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-c7f648ff-3a60-42ce-84f8-7fa3f07d17e8 tempest-ProjectReaderTests-1147372370 None] Created reservations ['9319d207-fac8-442a-aa98-532fb2954c8b', 'bdb6a0fd-ae75-4077-bd75-8ec31c60196d', 'd245940d-2da9-486d-bab9-65b8487d4fc9', '3eaa1de0-f126-4acf-99e3-2bbb7308b155'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:52:02 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c7f648ff-3a60-42ce-84f8-7fa3f07d17e8 tempest-ProjectReaderTests-1147372370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:52:02 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c7f648ff-3a60-42ce-84f8-7fa3f07d17e8 tempest-ProjectReaderTests-1147372370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:52:02 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-c7f648ff-3a60-42ce-84f8-7fa3f07d17e8 tempest-ProjectReaderTests-1147372370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:52:02 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-c7f648ff-3a60-42ce-84f8-7fa3f07d17e8 tempest-ProjectReaderTests-1147372370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:52:02 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c7f648ff-3a60-42ce-84f8-7fa3f07d17e8 tempest-ProjectReaderTests-1147372370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:52:02 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c7f648ff-3a60-42ce-84f8-7fa3f07d17e8 tempest-ProjectReaderTests-1147372370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:02 devstack sudo[104931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:52:02 devstack sudo[104931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:03 devstack sudo[104931]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c7f648ff-3a60-42ce-84f8-7fa3f07d17e8 tempest-ProjectReaderTests-1147372370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.359s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:03 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-c7f648ff-3a60-42ce-84f8-7fa3f07d17e8 tempest-ProjectReaderTests-1147372370 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:52:03 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-c7f648ff-3a60-42ce-84f8-7fa3f07d17e8 tempest-ProjectReaderTests-1147372370 None] Deleted volume successfully. Sep 18 21:52:03 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-119d6dee-743f-47bc-bb10-f0bde70ccdbf tempest-ProjectReaderTests-462787125 None] Acquiring lock "cinder-f04097dd-f33c-4794-a06a-ff2b4ee4c6d3-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:52:03 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-c7f648ff-3a60-42ce-84f8-7fa3f07d17e8 tempest-ProjectReaderTests-1147372370 None] Lock "cinder-31f84956-b20a-43d6-8626-4a2bf46b8c08-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:52:03 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-119d6dee-743f-47bc-bb10-f0bde70ccdbf tempest-ProjectReaderTests-462787125 None] Lock "cinder-f04097dd-f33c-4794-a06a-ff2b4ee4c6d3-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:52:03 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-119d6dee-743f-47bc-bb10-f0bde70ccdbf tempest-ProjectReaderTests-462787125 None] Acquiring lock "cinder-quobyte-f04097dd-f33c-4794-a06a-ff2b4ee4c6d3" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:52:03 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-119d6dee-743f-47bc-bb10-f0bde70ccdbf tempest-ProjectReaderTests-462787125 None] Lock "cinder-quobyte-f04097dd-f33c-4794-a06a-ff2b4ee4c6d3" acquired by "delete_volume" :: waited 0.016s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:52:03 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee47905-d53c-40f9-898a-d56633ea5212]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:52:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-119d6dee-743f-47bc-bb10-f0bde70ccdbf tempest-ProjectReaderTests-462787125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f04097dd-f33c-4794-a06a-ff2b4ee4c6d3 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:03 devstack sudo[104934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f04097dd-f33c-4794-a06a-ff2b4ee4c6d3 Sep 18 21:52:03 devstack sudo[104934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:03 devstack sudo[104934]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-119d6dee-743f-47bc-bb10-f0bde70ccdbf tempest-ProjectReaderTests-462787125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f04097dd-f33c-4794-a06a-ff2b4ee4c6d3" returned: 0 in 0.486s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-119d6dee-743f-47bc-bb10-f0bde70ccdbf tempest-ProjectReaderTests-462787125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f04097dd-f33c-4794-a06a-ff2b4ee4c6d3 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:04 devstack sudo[104940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f04097dd-f33c-4794-a06a-ff2b4ee4c6d3 Sep 18 21:52:04 devstack sudo[104940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:04 devstack sudo[104940]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-119d6dee-743f-47bc-bb10-f0bde70ccdbf tempest-ProjectReaderTests-462787125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f04097dd-f33c-4794-a06a-ff2b4ee4c6d3" returned: 0 in 0.301s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:04 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-119d6dee-743f-47bc-bb10-f0bde70ccdbf tempest-ProjectReaderTests-462787125 None] Lock "cinder-quobyte-f04097dd-f33c-4794-a06a-ff2b4ee4c6d3" released by "delete_volume" :: held 0.877s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:52:04 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-119d6dee-743f-47bc-bb10-f0bde70ccdbf tempest-ProjectReaderTests-462787125 None] Created reservations ['d140bcda-167f-44f9-b191-2ea662d6193f', 'e868bd16-9937-4b14-a189-de7e8a2956c5', '99591674-f19f-407e-8045-d90e0b62991c', 'e7ba4d26-08f5-4ffd-9f5d-000600b205cd'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:52:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-119d6dee-743f-47bc-bb10-f0bde70ccdbf tempest-ProjectReaderTests-462787125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:52:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-119d6dee-743f-47bc-bb10-f0bde70ccdbf tempest-ProjectReaderTests-462787125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:52:04 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-119d6dee-743f-47bc-bb10-f0bde70ccdbf tempest-ProjectReaderTests-462787125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:52:04 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-119d6dee-743f-47bc-bb10-f0bde70ccdbf tempest-ProjectReaderTests-462787125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:52:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-119d6dee-743f-47bc-bb10-f0bde70ccdbf tempest-ProjectReaderTests-462787125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:52:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-119d6dee-743f-47bc-bb10-f0bde70ccdbf tempest-ProjectReaderTests-462787125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:04 devstack sudo[104943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:52:04 devstack sudo[104943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:05 devstack sudo[104943]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-119d6dee-743f-47bc-bb10-f0bde70ccdbf tempest-ProjectReaderTests-462787125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.543s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:05 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-119d6dee-743f-47bc-bb10-f0bde70ccdbf tempest-ProjectReaderTests-462787125 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:52:05 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-119d6dee-743f-47bc-bb10-f0bde70ccdbf tempest-ProjectReaderTests-462787125 None] Deleted volume successfully. Sep 18 21:52:05 devstack cinder-volume[86136]: DEBUG oslo_service.periodic_task [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86136) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 21:52:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:52:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:52:05 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:52:05 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:52:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:52:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:05 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-119d6dee-743f-47bc-bb10-f0bde70ccdbf tempest-ProjectReaderTests-462787125 None] Lock "cinder-f04097dd-f33c-4794-a06a-ff2b4ee4c6d3-delete_volume" released by "delete_volume" :: held 1.881s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:52:05 devstack sudo[104946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:52:05 devstack sudo[104946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:05 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-a04260f1-92bd-4ecf-b4f6-dfa85d8b9f17 tempest-ProjectReaderTests-462787125 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:52:05 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-a04260f1-92bd-4ecf-b4f6-dfa85d8b9f17 tempest-ProjectReaderTests-462787125 None] Flow 'volume_create_manager' (d361c080-c6b6-460f-b41f-e7fdd011fc0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:52:05 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-a04260f1-92bd-4ecf-b4f6-dfa85d8b9f17 tempest-ProjectReaderTests-462787125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d25204e-a4b9-4ba3-b449-657d4a64d26f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:52:05 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-a04260f1-92bd-4ecf-b4f6-dfa85d8b9f17 tempest-ProjectReaderTests-462787125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d25204e-a4b9-4ba3-b449-657d4a64d26f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:52:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1063707261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66bb15dd-78c5-4460-adff-9f9318e88bf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dcc87503f13406caa33014a7a149d33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:52:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:52:05Z,use_quota=True,user_id='fd17cfd02234487cb53e780b5c3781e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:52:05 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-a04260f1-92bd-4ecf-b4f6-dfa85d8b9f17 tempest-ProjectReaderTests-462787125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9a7d1a6-f22f-4fb0-bbbf-c873bebc7aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:52:05 devstack sudo[104946]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:05 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-a04260f1-92bd-4ecf-b4f6-dfa85d8b9f17 tempest-ProjectReaderTests-462787125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9a7d1a6-f22f-4fb0-bbbf-c873bebc7aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:52:05 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-a04260f1-92bd-4ecf-b4f6-dfa85d8b9f17 tempest-ProjectReaderTests-462787125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (009361f6-0af4-40aa-b9f0-a79a461f127e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:52:05 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-a04260f1-92bd-4ecf-b4f6-dfa85d8b9f17 tempest-ProjectReaderTests-462787125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (009361f6-0af4-40aa-b9f0-a79a461f127e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66bb15dd-78c5-4460-adff-9f9318e88bf4', 'volume_name': 'volume-66bb15dd-78c5-4460-adff-9f9318e88bf4', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:52:05 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-a04260f1-92bd-4ecf-b4f6-dfa85d8b9f17 tempest-ProjectReaderTests-462787125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (583f5301-31c0-436f-8133-93474b6318c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:52:05 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-a04260f1-92bd-4ecf-b4f6-dfa85d8b9f17 tempest-ProjectReaderTests-462787125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (583f5301-31c0-436f-8133-93474b6318c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:52:05 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-a04260f1-92bd-4ecf-b4f6-dfa85d8b9f17 tempest-ProjectReaderTests-462787125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c091968a-e328-41a7-a62b-7bc466f1c009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:52:05 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-a04260f1-92bd-4ecf-b4f6-dfa85d8b9f17 tempest-ProjectReaderTests-462787125 None] Volume 66bb15dd-78c5-4460-adff-9f9318e88bf4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66bb15dd-78c5-4460-adff-9f9318e88bf4', 'volume_size': 1} Sep 18 21:52:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-a04260f1-92bd-4ecf-b4f6-dfa85d8b9f17 tempest-ProjectReaderTests-462787125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:52:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-a04260f1-92bd-4ecf-b4f6-dfa85d8b9f17 tempest-ProjectReaderTests-462787125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:52:05 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-a04260f1-92bd-4ecf-b4f6-dfa85d8b9f17 tempest-ProjectReaderTests-462787125 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:52:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1063707261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66bb15dd-78c5-4460-adff-9f9318e88bf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dcc87503f13406caa33014a7a149d33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:52:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:52:05Z,use_quota=True,user_id='fd17cfd02234487cb53e780b5c3781e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:52:05 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-a04260f1-92bd-4ecf-b4f6-dfa85d8b9f17 tempest-ProjectReaderTests-462787125 None] Creating volume 66bb15dd-78c5-4460-adff-9f9318e88bf4 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:52:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-a04260f1-92bd-4ecf-b4f6-dfa85d8b9f17 tempest-ProjectReaderTests-462787125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:52:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-a04260f1-92bd-4ecf-b4f6-dfa85d8b9f17 tempest-ProjectReaderTests-462787125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:52:05 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-a04260f1-92bd-4ecf-b4f6-dfa85d8b9f17 tempest-ProjectReaderTests-462787125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:52:05 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-a04260f1-92bd-4ecf-b4f6-dfa85d8b9f17 tempest-ProjectReaderTests-462787125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:52:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-a04260f1-92bd-4ecf-b4f6-dfa85d8b9f17 tempest-ProjectReaderTests-462787125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:52:05 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-a04260f1-92bd-4ecf-b4f6-dfa85d8b9f17 tempest-ProjectReaderTests-462787125 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:52:05 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-a04260f1-92bd-4ecf-b4f6-dfa85d8b9f17 tempest-ProjectReaderTests-462787125 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:52:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-a04260f1-92bd-4ecf-b4f6-dfa85d8b9f17 tempest-ProjectReaderTests-462787125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-66bb15dd-78c5-4460-adff-9f9318e88bf4 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.460s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:05 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:52:05 devstack cinder-volume[86136]: DEBUG oslo_service.periodic_task [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Running periodic task VolumeManager._thread_info {{(pid=86136) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 21:52:05 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] thread count: 28 {{(pid=86136) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 18 21:52:05 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] thread info: [<_MainThread(MainThread, started 138548347871360)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86136) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 18 21:52:05 devstack sudo[104949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-66bb15dd-78c5-4460-adff-9f9318e88bf4 1073741824 Sep 18 21:52:05 devstack sudo[104949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:06 devstack sudo[104949]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:06 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-a04260f1-92bd-4ecf-b4f6-dfa85d8b9f17 tempest-ProjectReaderTests-462787125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-66bb15dd-78c5-4460-adff-9f9318e88bf4 1073741824" returned: 0 in 0.536s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:06 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-a04260f1-92bd-4ecf-b4f6-dfa85d8b9f17 tempest-ProjectReaderTests-462787125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-66bb15dd-78c5-4460-adff-9f9318e88bf4 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:06 devstack sudo[104955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-66bb15dd-78c5-4460-adff-9f9318e88bf4 Sep 18 21:52:06 devstack sudo[104955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:06 devstack sudo[104955]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:06 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-a04260f1-92bd-4ecf-b4f6-dfa85d8b9f17 tempest-ProjectReaderTests-462787125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-66bb15dd-78c5-4460-adff-9f9318e88bf4" returned: 0 in 0.280s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:06 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-a04260f1-92bd-4ecf-b4f6-dfa85d8b9f17 tempest-ProjectReaderTests-462787125 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:52:06 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-a04260f1-92bd-4ecf-b4f6-dfa85d8b9f17 tempest-ProjectReaderTests-462787125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:52:06 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-a04260f1-92bd-4ecf-b4f6-dfa85d8b9f17 tempest-ProjectReaderTests-462787125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c091968a-e328-41a7-a62b-7bc466f1c009) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66bb15dd-78c5-4460-adff-9f9318e88bf4', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:52:06 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-a04260f1-92bd-4ecf-b4f6-dfa85d8b9f17 tempest-ProjectReaderTests-462787125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39fd5739-7936-48b1-ae1e-17348f9dab23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:52:06 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-a04260f1-92bd-4ecf-b4f6-dfa85d8b9f17 tempest-ProjectReaderTests-462787125 None] Volume volume-66bb15dd-78c5-4460-adff-9f9318e88bf4 (66bb15dd-78c5-4460-adff-9f9318e88bf4): created successfully Sep 18 21:52:06 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-a04260f1-92bd-4ecf-b4f6-dfa85d8b9f17 tempest-ProjectReaderTests-462787125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39fd5739-7936-48b1-ae1e-17348f9dab23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:52:06 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-a04260f1-92bd-4ecf-b4f6-dfa85d8b9f17 tempest-ProjectReaderTests-462787125 None] Flow 'volume_create_manager' (d361c080-c6b6-460f-b41f-e7fdd011fc0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:52:06 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-a04260f1-92bd-4ecf-b4f6-dfa85d8b9f17 tempest-ProjectReaderTests-462787125 None] Created volume successfully. Sep 18 21:52:07 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-675224f1-cb4c-4bd1-8884-ce33b2ee4256 tempest-ProjectReaderTests-462787125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:52:07 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-675224f1-cb4c-4bd1-8884-ce33b2ee4256 tempest-ProjectReaderTests-462787125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:52:07 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-675224f1-cb4c-4bd1-8884-ce33b2ee4256 tempest-ProjectReaderTests-462787125 None] Creating offline snapshot e7481931-1a51-4682-85fe-61b171bfeec8 of volume 66bb15dd-78c5-4460-adff-9f9318e88bf4 {{(pid=86136) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 21:52:07 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f75c4e9-1e1f-404e-8f21-7e6c1f817eed]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:52:07 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-675224f1-cb4c-4bd1-8884-ce33b2ee4256 tempest-ProjectReaderTests-462787125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-66bb15dd-78c5-4460-adff-9f9318e88bf4 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:07 devstack sudo[104958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-66bb15dd-78c5-4460-adff-9f9318e88bf4 Sep 18 21:52:07 devstack sudo[104958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:08 devstack sudo[104958]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-675224f1-cb4c-4bd1-8884-ce33b2ee4256 tempest-ProjectReaderTests-462787125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-66bb15dd-78c5-4460-adff-9f9318e88bf4" returned: 0 in 0.451s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-675224f1-cb4c-4bd1-8884-ce33b2ee4256 tempest-ProjectReaderTests-462787125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-66bb15dd-78c5-4460-adff-9f9318e88bf4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-66bb15dd-78c5-4460-adff-9f9318e88bf4.e7481931-1a51-4682-85fe-61b171bfeec8 1G {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:08 devstack sudo[104963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-66bb15dd-78c5-4460-adff-9f9318e88bf4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-66bb15dd-78c5-4460-adff-9f9318e88bf4.e7481931-1a51-4682-85fe-61b171bfeec8 1G Sep 18 21:52:08 devstack sudo[104963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:08 devstack sudo[104963]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-675224f1-cb4c-4bd1-8884-ce33b2ee4256 tempest-ProjectReaderTests-462787125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-66bb15dd-78c5-4460-adff-9f9318e88bf4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-66bb15dd-78c5-4460-adff-9f9318e88bf4.e7481931-1a51-4682-85fe-61b171bfeec8 1G" returned: 0 in 0.561s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-675224f1-cb4c-4bd1-8884-ce33b2ee4256 tempest-ProjectReaderTests-462787125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66bb15dd-78c5-4460-adff-9f9318e88bf4 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-66bb15dd-78c5-4460-adff-9f9318e88bf4.e7481931-1a51-4682-85fe-61b171bfeec8 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:08 devstack sudo[104970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66bb15dd-78c5-4460-adff-9f9318e88bf4 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-66bb15dd-78c5-4460-adff-9f9318e88bf4.e7481931-1a51-4682-85fe-61b171bfeec8 Sep 18 21:52:08 devstack sudo[104970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:09 devstack sudo[104970]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-675224f1-cb4c-4bd1-8884-ce33b2ee4256 tempest-ProjectReaderTests-462787125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66bb15dd-78c5-4460-adff-9f9318e88bf4 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-66bb15dd-78c5-4460-adff-9f9318e88bf4.e7481931-1a51-4682-85fe-61b171bfeec8" returned: 0 in 0.339s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:09 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-675224f1-cb4c-4bd1-8884-ce33b2ee4256 tempest-ProjectReaderTests-462787125 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-66bb15dd-78c5-4460-adff-9f9318e88bf4.e7481931-1a51-4682-85fe-61b171bfeec8 is being set with open permissions: ugo+rw Sep 18 21:52:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-675224f1-cb4c-4bd1-8884-ce33b2ee4256 tempest-ProjectReaderTests-462787125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-66bb15dd-78c5-4460-adff-9f9318e88bf4.e7481931-1a51-4682-85fe-61b171bfeec8 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:09 devstack sudo[104976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-66bb15dd-78c5-4460-adff-9f9318e88bf4.e7481931-1a51-4682-85fe-61b171bfeec8 Sep 18 21:52:09 devstack sudo[104976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:09 devstack sudo[104976]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-675224f1-cb4c-4bd1-8884-ce33b2ee4256 tempest-ProjectReaderTests-462787125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-66bb15dd-78c5-4460-adff-9f9318e88bf4.e7481931-1a51-4682-85fe-61b171bfeec8" returned: 0 in 0.338s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-675224f1-cb4c-4bd1-8884-ce33b2ee4256 tempest-ProjectReaderTests-462787125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-66bb15dd-78c5-4460-adff-9f9318e88bf4.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:09 devstack sudo[104981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-66bb15dd-78c5-4460-adff-9f9318e88bf4.info Sep 18 21:52:09 devstack sudo[104981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:09 devstack sudo[104981]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-675224f1-cb4c-4bd1-8884-ce33b2ee4256 tempest-ProjectReaderTests-462787125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-66bb15dd-78c5-4460-adff-9f9318e88bf4.info" returned: 0 in 0.321s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:09 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-675224f1-cb4c-4bd1-8884-ce33b2ee4256 tempest-ProjectReaderTests-462787125 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-66bb15dd-78c5-4460-adff-9f9318e88bf4.info is being set with open permissions: ugo+rw Sep 18 21:52:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-675224f1-cb4c-4bd1-8884-ce33b2ee4256 tempest-ProjectReaderTests-462787125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-66bb15dd-78c5-4460-adff-9f9318e88bf4.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:09 devstack sudo[104984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-66bb15dd-78c5-4460-adff-9f9318e88bf4.info Sep 18 21:52:09 devstack sudo[104984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:10 devstack sudo[104984]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:10 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-675224f1-cb4c-4bd1-8884-ce33b2ee4256 tempest-ProjectReaderTests-462787125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-66bb15dd-78c5-4460-adff-9f9318e88bf4.info" returned: 0 in 0.367s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:10 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-675224f1-cb4c-4bd1-8884-ce33b2ee4256 tempest-ProjectReaderTests-462787125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.524s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:52:10 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-675224f1-cb4c-4bd1-8884-ce33b2ee4256 tempest-ProjectReaderTests-462787125 None] Create snapshot completed successfully Sep 18 21:52:11 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-b0bdacca-056d-41c0-9a87-e3acb9145d70 tempest-ProjectReaderTests-462787125 None] Acquiring lock "cinder-e7481931-1a51-4682-85fe-61b171bfeec8-delete_snapshot" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:52:11 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-b0bdacca-056d-41c0-9a87-e3acb9145d70 tempest-ProjectReaderTests-462787125 None] Lock "cinder-e7481931-1a51-4682-85fe-61b171bfeec8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:52:11 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-b0bdacca-056d-41c0-9a87-e3acb9145d70 tempest-ProjectReaderTests-462787125 None] Acquiring lock "cinder-quobyte-66bb15dd-78c5-4460-adff-9f9318e88bf4" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:52:11 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-b0bdacca-056d-41c0-9a87-e3acb9145d70 tempest-ProjectReaderTests-462787125 None] Lock "cinder-quobyte-66bb15dd-78c5-4460-adff-9f9318e88bf4" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:52:11 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-b0bdacca-056d-41c0-9a87-e3acb9145d70 tempest-ProjectReaderTests-462787125 None] Acquiring lock "cinder-quobyte-e7481931-1a51-4682-85fe-61b171bfeec8" by "_delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:52:11 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-b0bdacca-056d-41c0-9a87-e3acb9145d70 tempest-ProjectReaderTests-462787125 None] Lock "cinder-quobyte-e7481931-1a51-4682-85fe-61b171bfeec8" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:52:11 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-b0bdacca-056d-41c0-9a87-e3acb9145d70 tempest-ProjectReaderTests-462787125 None] Deleting offline snapshot e7481931-1a51-4682-85fe-61b171bfeec8 of volume 66bb15dd-78c5-4460-adff-9f9318e88bf4 {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 21:52:11 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-b0bdacca-056d-41c0-9a87-e3acb9145d70 tempest-ProjectReaderTests-462787125 None] snapshot_file for this snap is: volume-66bb15dd-78c5-4460-adff-9f9318e88bf4.e7481931-1a51-4682-85fe-61b171bfeec8 {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 21:52:11 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[afec78eb-ce95-47b0-adf1-2e9b50678e17]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:52:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-b0bdacca-056d-41c0-9a87-e3acb9145d70 tempest-ProjectReaderTests-462787125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-66bb15dd-78c5-4460-adff-9f9318e88bf4.e7481931-1a51-4682-85fe-61b171bfeec8 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:11 devstack sudo[104988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-66bb15dd-78c5-4460-adff-9f9318e88bf4.e7481931-1a51-4682-85fe-61b171bfeec8 Sep 18 21:52:11 devstack sudo[104988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:11 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-23d6fa3e-c638-4108-bbf3-d50e7ff37f7d tempest-SnapshotDependencyTests-682659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:52:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-23d6fa3e-c638-4108-bbf3-d50e7ff37f7d tempest-SnapshotDependencyTests-682659 None] Flow 'volume_create_manager' (c70e01b0-e34f-485a-8df7-4cc8f2d664ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:52:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-23d6fa3e-c638-4108-bbf3-d50e7ff37f7d tempest-SnapshotDependencyTests-682659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e243a237-cf33-4b0b-b13b-e52e8ca03186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:52:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-23d6fa3e-c638-4108-bbf3-d50e7ff37f7d tempest-SnapshotDependencyTests-682659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e243a237-cf33-4b0b-b13b-e52e8ca03186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:52:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-943442411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77e83728-15cb-4965-9f26-2f34de2a52b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fa7079c8efe469bbe476b3b54144f07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:52:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:52:11Z,use_quota=True,user_id='799f7bc1bafa45c7a6c76efb4515d944',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:52:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-23d6fa3e-c638-4108-bbf3-d50e7ff37f7d tempest-SnapshotDependencyTests-682659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59b35c27-7efe-4a99-9015-c6bc106c0870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:52:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-23d6fa3e-c638-4108-bbf3-d50e7ff37f7d tempest-SnapshotDependencyTests-682659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59b35c27-7efe-4a99-9015-c6bc106c0870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:52:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-23d6fa3e-c638-4108-bbf3-d50e7ff37f7d tempest-SnapshotDependencyTests-682659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef314749-bfb8-4821-a60d-d756c0933c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:52:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-23d6fa3e-c638-4108-bbf3-d50e7ff37f7d tempest-SnapshotDependencyTests-682659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef314749-bfb8-4821-a60d-d756c0933c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77e83728-15cb-4965-9f26-2f34de2a52b2', 'volume_name': 'volume-77e83728-15cb-4965-9f26-2f34de2a52b2', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:52:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-23d6fa3e-c638-4108-bbf3-d50e7ff37f7d tempest-SnapshotDependencyTests-682659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de8f4f2b-6ea9-4198-b601-795e4a46bcbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:52:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-23d6fa3e-c638-4108-bbf3-d50e7ff37f7d tempest-SnapshotDependencyTests-682659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de8f4f2b-6ea9-4198-b601-795e4a46bcbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:52:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-23d6fa3e-c638-4108-bbf3-d50e7ff37f7d tempest-SnapshotDependencyTests-682659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c7cafdc-1705-4eb9-a519-a539cd2fbe21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:52:11 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-23d6fa3e-c638-4108-bbf3-d50e7ff37f7d tempest-SnapshotDependencyTests-682659 None] Volume 77e83728-15cb-4965-9f26-2f34de2a52b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77e83728-15cb-4965-9f26-2f34de2a52b2', 'volume_size': 1} Sep 18 21:52:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-23d6fa3e-c638-4108-bbf3-d50e7ff37f7d tempest-SnapshotDependencyTests-682659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:52:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-23d6fa3e-c638-4108-bbf3-d50e7ff37f7d tempest-SnapshotDependencyTests-682659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:52:11 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-23d6fa3e-c638-4108-bbf3-d50e7ff37f7d tempest-SnapshotDependencyTests-682659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:52:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-943442411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77e83728-15cb-4965-9f26-2f34de2a52b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fa7079c8efe469bbe476b3b54144f07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:52:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:52:11Z,use_quota=True,user_id='799f7bc1bafa45c7a6c76efb4515d944',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:52:11 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-23d6fa3e-c638-4108-bbf3-d50e7ff37f7d tempest-SnapshotDependencyTests-682659 None] Creating volume 77e83728-15cb-4965-9f26-2f34de2a52b2 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:52:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-23d6fa3e-c638-4108-bbf3-d50e7ff37f7d tempest-SnapshotDependencyTests-682659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:52:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-23d6fa3e-c638-4108-bbf3-d50e7ff37f7d tempest-SnapshotDependencyTests-682659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:52:11 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-23d6fa3e-c638-4108-bbf3-d50e7ff37f7d tempest-SnapshotDependencyTests-682659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:52:11 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-23d6fa3e-c638-4108-bbf3-d50e7ff37f7d tempest-SnapshotDependencyTests-682659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:52:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-23d6fa3e-c638-4108-bbf3-d50e7ff37f7d tempest-SnapshotDependencyTests-682659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:52:11 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-23d6fa3e-c638-4108-bbf3-d50e7ff37f7d tempest-SnapshotDependencyTests-682659 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:52:11 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-23d6fa3e-c638-4108-bbf3-d50e7ff37f7d tempest-SnapshotDependencyTests-682659 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:52:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-23d6fa3e-c638-4108-bbf3-d50e7ff37f7d tempest-SnapshotDependencyTests-682659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-77e83728-15cb-4965-9f26-2f34de2a52b2 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:11 devstack sudo[104994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-77e83728-15cb-4965-9f26-2f34de2a52b2 1073741824 Sep 18 21:52:11 devstack sudo[104994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:11 devstack sudo[104988]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-b0bdacca-056d-41c0-9a87-e3acb9145d70 tempest-ProjectReaderTests-462787125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-66bb15dd-78c5-4460-adff-9f9318e88bf4.e7481931-1a51-4682-85fe-61b171bfeec8" returned: 0 in 0.474s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:11 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-b0bdacca-056d-41c0-9a87-e3acb9145d70 tempest-ProjectReaderTests-462787125 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-66bb15dd-78c5-4460-adff-9f9318e88bf4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86136) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 21:52:11 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1d607e-c05c-40ed-9a56-84909c172e77]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:52:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-b0bdacca-056d-41c0-9a87-e3acb9145d70 tempest-ProjectReaderTests-462787125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-66bb15dd-78c5-4460-adff-9f9318e88bf4 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:11 devstack sudo[104996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-66bb15dd-78c5-4460-adff-9f9318e88bf4 Sep 18 21:52:11 devstack sudo[104996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:12 devstack sudo[104994]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-23d6fa3e-c638-4108-bbf3-d50e7ff37f7d tempest-SnapshotDependencyTests-682659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-77e83728-15cb-4965-9f26-2f34de2a52b2 1073741824" returned: 0 in 0.489s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:12 devstack sudo[104996]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-b0bdacca-056d-41c0-9a87-e3acb9145d70 tempest-ProjectReaderTests-462787125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-66bb15dd-78c5-4460-adff-9f9318e88bf4" returned: 0 in 0.403s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-b0bdacca-056d-41c0-9a87-e3acb9145d70 tempest-ProjectReaderTests-462787125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-66bb15dd-78c5-4460-adff-9f9318e88bf4.e7481931-1a51-4682-85fe-61b171bfeec8 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-23d6fa3e-c638-4108-bbf3-d50e7ff37f7d tempest-SnapshotDependencyTests-682659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-77e83728-15cb-4965-9f26-2f34de2a52b2 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:12 devstack sudo[105005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-66bb15dd-78c5-4460-adff-9f9318e88bf4.e7481931-1a51-4682-85fe-61b171bfeec8 Sep 18 21:52:12 devstack sudo[105005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:12 devstack sudo[105007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-77e83728-15cb-4965-9f26-2f34de2a52b2 Sep 18 21:52:12 devstack sudo[105007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:12 devstack sudo[105007]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-23d6fa3e-c638-4108-bbf3-d50e7ff37f7d tempest-SnapshotDependencyTests-682659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-77e83728-15cb-4965-9f26-2f34de2a52b2" returned: 0 in 0.278s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:12 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-23d6fa3e-c638-4108-bbf3-d50e7ff37f7d tempest-SnapshotDependencyTests-682659 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:52:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-23d6fa3e-c638-4108-bbf3-d50e7ff37f7d tempest-SnapshotDependencyTests-682659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:52:12 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-23d6fa3e-c638-4108-bbf3-d50e7ff37f7d tempest-SnapshotDependencyTests-682659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c7cafdc-1705-4eb9-a519-a539cd2fbe21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77e83728-15cb-4965-9f26-2f34de2a52b2', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:52:12 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-23d6fa3e-c638-4108-bbf3-d50e7ff37f7d tempest-SnapshotDependencyTests-682659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6b13251-9b49-4002-897e-0250d42bf96c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:52:12 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-23d6fa3e-c638-4108-bbf3-d50e7ff37f7d tempest-SnapshotDependencyTests-682659 None] Volume volume-77e83728-15cb-4965-9f26-2f34de2a52b2 (77e83728-15cb-4965-9f26-2f34de2a52b2): created successfully Sep 18 21:52:12 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-23d6fa3e-c638-4108-bbf3-d50e7ff37f7d tempest-SnapshotDependencyTests-682659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6b13251-9b49-4002-897e-0250d42bf96c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:52:12 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-23d6fa3e-c638-4108-bbf3-d50e7ff37f7d tempest-SnapshotDependencyTests-682659 None] Flow 'volume_create_manager' (c70e01b0-e34f-485a-8df7-4cc8f2d664ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:52:12 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-23d6fa3e-c638-4108-bbf3-d50e7ff37f7d tempest-SnapshotDependencyTests-682659 None] Created volume successfully. Sep 18 21:52:12 devstack sudo[105005]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-b0bdacca-056d-41c0-9a87-e3acb9145d70 tempest-ProjectReaderTests-462787125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-66bb15dd-78c5-4460-adff-9f9318e88bf4.e7481931-1a51-4682-85fe-61b171bfeec8" returned: 0 in 0.421s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-b0bdacca-056d-41c0-9a87-e3acb9145d70 tempest-ProjectReaderTests-462787125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-66bb15dd-78c5-4460-adff-9f9318e88bf4.e7481931-1a51-4682-85fe-61b171bfeec8 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:12 devstack sudo[105013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-66bb15dd-78c5-4460-adff-9f9318e88bf4.e7481931-1a51-4682-85fe-61b171bfeec8 Sep 18 21:52:12 devstack sudo[105013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:12 devstack sudo[105013]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-b0bdacca-056d-41c0-9a87-e3acb9145d70 tempest-ProjectReaderTests-462787125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-66bb15dd-78c5-4460-adff-9f9318e88bf4.e7481931-1a51-4682-85fe-61b171bfeec8" returned: 0 in 0.249s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:12 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-b0bdacca-056d-41c0-9a87-e3acb9145d70 tempest-ProjectReaderTests-462787125 None] Lock "cinder-quobyte-e7481931-1a51-4682-85fe-61b171bfeec8" released by "_delete_snapshot" :: held 1.697s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:52:12 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-b0bdacca-056d-41c0-9a87-e3acb9145d70 tempest-ProjectReaderTests-462787125 None] Lock "cinder-quobyte-66bb15dd-78c5-4460-adff-9f9318e88bf4" released by "delete_snapshot" :: held 1.730s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:52:12 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-b0bdacca-056d-41c0-9a87-e3acb9145d70 tempest-ProjectReaderTests-462787125 None] Created reservations ['62c53740-f660-40c5-b2f6-aadc72e651bb', 'd3f17742-7f46-4192-b259-3856c602406f', 'c6239eb7-606f-4c61-b6e7-a4915d62ce27', '7f78045e-913f-455c-a4b3-e0a41a1b500e'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:52:12 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-b0bdacca-056d-41c0-9a87-e3acb9145d70 tempest-ProjectReaderTests-462787125 None] Delete snapshot completed successfully. Sep 18 21:52:12 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-b0bdacca-056d-41c0-9a87-e3acb9145d70 tempest-ProjectReaderTests-462787125 None] Lock "cinder-e7481931-1a51-4682-85fe-61b171bfeec8-delete_snapshot" released by "delete_snapshot" :: held 1.882s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:52:13 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-9aeb5018-376a-4874-9d58-843015ddb070 tempest-ProjectReaderTests-462787125 None] Acquiring lock "cinder-66bb15dd-78c5-4460-adff-9f9318e88bf4-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:52:13 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-9aeb5018-376a-4874-9d58-843015ddb070 tempest-ProjectReaderTests-462787125 None] Lock "cinder-66bb15dd-78c5-4460-adff-9f9318e88bf4-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:52:13 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-9aeb5018-376a-4874-9d58-843015ddb070 tempest-ProjectReaderTests-462787125 None] Acquiring lock "cinder-quobyte-66bb15dd-78c5-4460-adff-9f9318e88bf4" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:52:13 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-9aeb5018-376a-4874-9d58-843015ddb070 tempest-ProjectReaderTests-462787125 None] Lock "cinder-quobyte-66bb15dd-78c5-4460-adff-9f9318e88bf4" acquired by "delete_volume" :: waited 0.016s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:52:13 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[a26792ed-5c6f-44e2-a98b-936cc2f1ab9d]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:52:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9aeb5018-376a-4874-9d58-843015ddb070 tempest-ProjectReaderTests-462787125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-66bb15dd-78c5-4460-adff-9f9318e88bf4 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:13 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-411dd9bf-b527-44c4-be9a-af7f54bb1a45 tempest-ProjectMemberTests-864505458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:52:13 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-411dd9bf-b527-44c4-be9a-af7f54bb1a45 tempest-ProjectMemberTests-864505458 None] Flow 'volume_create_manager' (ad38af78-4874-43a7-a578-af7e68cb4b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:52:13 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-411dd9bf-b527-44c4-be9a-af7f54bb1a45 tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76c00b07-b4ac-4379-a35b-738cc7eb8f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:52:13 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-411dd9bf-b527-44c4-be9a-af7f54bb1a45 tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76c00b07-b4ac-4379-a35b-738cc7eb8f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:52:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-233745617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6ebf347-2176-4abe-b509-2f3d74e65c1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44aed77f70a242029bc978ba9aa69a78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:52:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:52:13Z,use_quota=True,user_id='fbe2b10fb8584161a20a4564db383b3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:52:13 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-411dd9bf-b527-44c4-be9a-af7f54bb1a45 tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f70fa43-b102-48a3-96b9-3ff988186ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:52:13 devstack sudo[105016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-66bb15dd-78c5-4460-adff-9f9318e88bf4 Sep 18 21:52:13 devstack sudo[105016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:13 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-411dd9bf-b527-44c4-be9a-af7f54bb1a45 tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f70fa43-b102-48a3-96b9-3ff988186ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:52:13 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-411dd9bf-b527-44c4-be9a-af7f54bb1a45 tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b30bb47-b3db-4f0f-8dbf-f6a58f94b362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:52:13 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-411dd9bf-b527-44c4-be9a-af7f54bb1a45 tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b30bb47-b3db-4f0f-8dbf-f6a58f94b362) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6ebf347-2176-4abe-b509-2f3d74e65c1c', 'volume_name': 'volume-f6ebf347-2176-4abe-b509-2f3d74e65c1c', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:52:13 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-411dd9bf-b527-44c4-be9a-af7f54bb1a45 tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ceb4c1f2-b6c7-4b9b-a353-53a22d8584f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:52:13 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-411dd9bf-b527-44c4-be9a-af7f54bb1a45 tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ceb4c1f2-b6c7-4b9b-a353-53a22d8584f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:52:13 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-411dd9bf-b527-44c4-be9a-af7f54bb1a45 tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40feb1ab-b0a4-4fc1-8319-5c8b0363708f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:52:13 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-411dd9bf-b527-44c4-be9a-af7f54bb1a45 tempest-ProjectMemberTests-864505458 None] Volume f6ebf347-2176-4abe-b509-2f3d74e65c1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6ebf347-2176-4abe-b509-2f3d74e65c1c', 'volume_size': 1} Sep 18 21:52:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-411dd9bf-b527-44c4-be9a-af7f54bb1a45 tempest-ProjectMemberTests-864505458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:52:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-411dd9bf-b527-44c4-be9a-af7f54bb1a45 tempest-ProjectMemberTests-864505458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:52:13 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-411dd9bf-b527-44c4-be9a-af7f54bb1a45 tempest-ProjectMemberTests-864505458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:52:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-233745617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6ebf347-2176-4abe-b509-2f3d74e65c1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44aed77f70a242029bc978ba9aa69a78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:52:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:52:13Z,use_quota=True,user_id='fbe2b10fb8584161a20a4564db383b3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:52:13 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-411dd9bf-b527-44c4-be9a-af7f54bb1a45 tempest-ProjectMemberTests-864505458 None] Creating volume f6ebf347-2176-4abe-b509-2f3d74e65c1c {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:52:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-411dd9bf-b527-44c4-be9a-af7f54bb1a45 tempest-ProjectMemberTests-864505458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:52:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-411dd9bf-b527-44c4-be9a-af7f54bb1a45 tempest-ProjectMemberTests-864505458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:52:13 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-411dd9bf-b527-44c4-be9a-af7f54bb1a45 tempest-ProjectMemberTests-864505458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:52:13 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-411dd9bf-b527-44c4-be9a-af7f54bb1a45 tempest-ProjectMemberTests-864505458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:52:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-411dd9bf-b527-44c4-be9a-af7f54bb1a45 tempest-ProjectMemberTests-864505458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:52:13 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-411dd9bf-b527-44c4-be9a-af7f54bb1a45 tempest-ProjectMemberTests-864505458 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:52:13 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-411dd9bf-b527-44c4-be9a-af7f54bb1a45 tempest-ProjectMemberTests-864505458 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:52:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-411dd9bf-b527-44c4-be9a-af7f54bb1a45 tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f6ebf347-2176-4abe-b509-2f3d74e65c1c 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:13 devstack sudo[105018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f6ebf347-2176-4abe-b509-2f3d74e65c1c 1073741824 Sep 18 21:52:13 devstack sudo[105018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:13 devstack sudo[105016]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9aeb5018-376a-4874-9d58-843015ddb070 tempest-ProjectReaderTests-462787125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-66bb15dd-78c5-4460-adff-9f9318e88bf4" returned: 0 in 0.440s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9aeb5018-376a-4874-9d58-843015ddb070 tempest-ProjectReaderTests-462787125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-66bb15dd-78c5-4460-adff-9f9318e88bf4 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:13 devstack sudo[105026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-66bb15dd-78c5-4460-adff-9f9318e88bf4 Sep 18 21:52:13 devstack sudo[105026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-658833e1-dcab-4cc1-b99d-fc68a9773ebf tempest-SnapshotDependencyTests-682659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:52:14 devstack sudo[105018]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-411dd9bf-b527-44c4-be9a-af7f54bb1a45 tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f6ebf347-2176-4abe-b509-2f3d74e65c1c 1073741824" returned: 0 in 0.530s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-411dd9bf-b527-44c4-be9a-af7f54bb1a45 tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f6ebf347-2176-4abe-b509-2f3d74e65c1c {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:14 devstack sudo[105026]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9aeb5018-376a-4874-9d58-843015ddb070 tempest-ProjectReaderTests-462787125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-66bb15dd-78c5-4460-adff-9f9318e88bf4" returned: 0 in 0.282s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:14 devstack sudo[105031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f6ebf347-2176-4abe-b509-2f3d74e65c1c Sep 18 21:52:14 devstack sudo[105031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:14 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-9aeb5018-376a-4874-9d58-843015ddb070 tempest-ProjectReaderTests-462787125 None] Lock "cinder-quobyte-66bb15dd-78c5-4460-adff-9f9318e88bf4" released by "delete_volume" :: held 0.794s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:52:14 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-9aeb5018-376a-4874-9d58-843015ddb070 tempest-ProjectReaderTests-462787125 None] Created reservations ['b5b9c8f6-4a7f-4112-bfc1-467690c33a48', '079d73a4-0661-45fc-9fd2-4cf11a06b48d', '46508d06-0284-407d-bef4-7393684e000d', '75b2aa28-1a6b-4520-bfa0-cd011116931e'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:52:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-9aeb5018-376a-4874-9d58-843015ddb070 tempest-ProjectReaderTests-462787125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:52:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-9aeb5018-376a-4874-9d58-843015ddb070 tempest-ProjectReaderTests-462787125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:52:14 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-9aeb5018-376a-4874-9d58-843015ddb070 tempest-ProjectReaderTests-462787125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:52:14 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-9aeb5018-376a-4874-9d58-843015ddb070 tempest-ProjectReaderTests-462787125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:52:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-9aeb5018-376a-4874-9d58-843015ddb070 tempest-ProjectReaderTests-462787125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:52:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9aeb5018-376a-4874-9d58-843015ddb070 tempest-ProjectReaderTests-462787125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:14 devstack sudo[105033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:52:14 devstack sudo[105033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:14 devstack sudo[105031]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-411dd9bf-b527-44c4-be9a-af7f54bb1a45 tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f6ebf347-2176-4abe-b509-2f3d74e65c1c" returned: 0 in 0.265s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:14 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-411dd9bf-b527-44c4-be9a-af7f54bb1a45 tempest-ProjectMemberTests-864505458 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:52:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-411dd9bf-b527-44c4-be9a-af7f54bb1a45 tempest-ProjectMemberTests-864505458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:52:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-658833e1-dcab-4cc1-b99d-fc68a9773ebf tempest-SnapshotDependencyTests-682659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.405s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:52:14 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-411dd9bf-b527-44c4-be9a-af7f54bb1a45 tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40feb1ab-b0a4-4fc1-8319-5c8b0363708f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6ebf347-2176-4abe-b509-2f3d74e65c1c', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:52:14 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-411dd9bf-b527-44c4-be9a-af7f54bb1a45 tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fe37210-320c-4474-b0d3-a6a0744f3394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:52:14 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-658833e1-dcab-4cc1-b99d-fc68a9773ebf tempest-SnapshotDependencyTests-682659 None] Creating offline snapshot 3abb6c28-9c83-4f07-8d73-a467e3c40120 of volume 77e83728-15cb-4965-9f26-2f34de2a52b2 {{(pid=86136) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 21:52:14 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-411dd9bf-b527-44c4-be9a-af7f54bb1a45 tempest-ProjectMemberTests-864505458 None] Volume volume-f6ebf347-2176-4abe-b509-2f3d74e65c1c (f6ebf347-2176-4abe-b509-2f3d74e65c1c): created successfully Sep 18 21:52:14 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-411dd9bf-b527-44c4-be9a-af7f54bb1a45 tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fe37210-320c-4474-b0d3-a6a0744f3394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:52:14 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-411dd9bf-b527-44c4-be9a-af7f54bb1a45 tempest-ProjectMemberTests-864505458 None] Flow 'volume_create_manager' (ad38af78-4874-43a7-a578-af7e68cb4b4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:52:14 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7438e4c-ed3d-41e6-a8f7-dbeb409576e2]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:52:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-658833e1-dcab-4cc1-b99d-fc68a9773ebf tempest-SnapshotDependencyTests-682659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-77e83728-15cb-4965-9f26-2f34de2a52b2 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:14 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-411dd9bf-b527-44c4-be9a-af7f54bb1a45 tempest-ProjectMemberTests-864505458 None] Created volume successfully. Sep 18 21:52:14 devstack sudo[105033]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9aeb5018-376a-4874-9d58-843015ddb070 tempest-ProjectReaderTests-462787125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.278s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:14 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-9aeb5018-376a-4874-9d58-843015ddb070 tempest-ProjectReaderTests-462787125 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:52:14 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-9aeb5018-376a-4874-9d58-843015ddb070 tempest-ProjectReaderTests-462787125 None] Deleted volume successfully. Sep 18 21:52:14 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-9aeb5018-376a-4874-9d58-843015ddb070 tempest-ProjectReaderTests-462787125 None] Lock "cinder-66bb15dd-78c5-4460-adff-9f9318e88bf4-delete_volume" released by "delete_volume" :: held 1.267s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:52:14 devstack sudo[105036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-77e83728-15cb-4965-9f26-2f34de2a52b2 Sep 18 21:52:14 devstack sudo[105036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:14 devstack sudo[105036]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-658833e1-dcab-4cc1-b99d-fc68a9773ebf tempest-SnapshotDependencyTests-682659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-77e83728-15cb-4965-9f26-2f34de2a52b2" returned: 0 in 0.392s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-658833e1-dcab-4cc1-b99d-fc68a9773ebf tempest-SnapshotDependencyTests-682659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-77e83728-15cb-4965-9f26-2f34de2a52b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-77e83728-15cb-4965-9f26-2f34de2a52b2.3abb6c28-9c83-4f07-8d73-a467e3c40120 1G {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:14 devstack sudo[105042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-77e83728-15cb-4965-9f26-2f34de2a52b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-77e83728-15cb-4965-9f26-2f34de2a52b2.3abb6c28-9c83-4f07-8d73-a467e3c40120 1G Sep 18 21:52:14 devstack sudo[105042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:14 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdcdf413-5ca8-43e5-8f7b-4da66f6e6ed9 tempest-ProjectReaderTests-462787125 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:52:14 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-fdcdf413-5ca8-43e5-8f7b-4da66f6e6ed9 tempest-ProjectReaderTests-462787125 None] Flow 'volume_create_manager' (d96dbd1e-4583-4cef-8e05-5c008b3da49d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:52:14 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-fdcdf413-5ca8-43e5-8f7b-4da66f6e6ed9 tempest-ProjectReaderTests-462787125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24d0f85f-10c2-4115-b0c4-0dfc5b011c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:52:14 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-fdcdf413-5ca8-43e5-8f7b-4da66f6e6ed9 tempest-ProjectReaderTests-462787125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24d0f85f-10c2-4115-b0c4-0dfc5b011c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:52:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1993237941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86176fa4-f8a1-4bea-ab38-5fab57ada6e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dcc87503f13406caa33014a7a149d33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:52:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:52:15Z,use_quota=True,user_id='fd17cfd02234487cb53e780b5c3781e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:52:14 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-fdcdf413-5ca8-43e5-8f7b-4da66f6e6ed9 tempest-ProjectReaderTests-462787125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6f599b3-de90-4775-b7d9-a57d20088736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:52:14 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-fdcdf413-5ca8-43e5-8f7b-4da66f6e6ed9 tempest-ProjectReaderTests-462787125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6f599b3-de90-4775-b7d9-a57d20088736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:52:14 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-fdcdf413-5ca8-43e5-8f7b-4da66f6e6ed9 tempest-ProjectReaderTests-462787125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (655fc0a2-2482-472c-aafc-cc2b367c4468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:52:14 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-fdcdf413-5ca8-43e5-8f7b-4da66f6e6ed9 tempest-ProjectReaderTests-462787125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (655fc0a2-2482-472c-aafc-cc2b367c4468) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86176fa4-f8a1-4bea-ab38-5fab57ada6e0', 'volume_name': 'volume-86176fa4-f8a1-4bea-ab38-5fab57ada6e0', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:52:14 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-fdcdf413-5ca8-43e5-8f7b-4da66f6e6ed9 tempest-ProjectReaderTests-462787125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00cfcd0f-022f-4292-b9c1-2ff5c33048e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:52:14 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-fdcdf413-5ca8-43e5-8f7b-4da66f6e6ed9 tempest-ProjectReaderTests-462787125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00cfcd0f-022f-4292-b9c1-2ff5c33048e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:52:14 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-fdcdf413-5ca8-43e5-8f7b-4da66f6e6ed9 tempest-ProjectReaderTests-462787125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b409374-f03b-4df5-a4c0-2eb6352829ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:52:14 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-fdcdf413-5ca8-43e5-8f7b-4da66f6e6ed9 tempest-ProjectReaderTests-462787125 None] Volume 86176fa4-f8a1-4bea-ab38-5fab57ada6e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86176fa4-f8a1-4bea-ab38-5fab57ada6e0', 'volume_size': 1} Sep 18 21:52:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-fdcdf413-5ca8-43e5-8f7b-4da66f6e6ed9 tempest-ProjectReaderTests-462787125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:52:15 devstack sudo[105042]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-658833e1-dcab-4cc1-b99d-fc68a9773ebf tempest-SnapshotDependencyTests-682659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-77e83728-15cb-4965-9f26-2f34de2a52b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-77e83728-15cb-4965-9f26-2f34de2a52b2.3abb6c28-9c83-4f07-8d73-a467e3c40120 1G" returned: 0 in 0.401s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-658833e1-dcab-4cc1-b99d-fc68a9773ebf tempest-SnapshotDependencyTests-682659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77e83728-15cb-4965-9f26-2f34de2a52b2 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-77e83728-15cb-4965-9f26-2f34de2a52b2.3abb6c28-9c83-4f07-8d73-a467e3c40120 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:15 devstack sudo[105048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77e83728-15cb-4965-9f26-2f34de2a52b2 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-77e83728-15cb-4965-9f26-2f34de2a52b2.3abb6c28-9c83-4f07-8d73-a467e3c40120 Sep 18 21:52:15 devstack sudo[105048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:15 devstack sudo[105048]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-658833e1-dcab-4cc1-b99d-fc68a9773ebf tempest-SnapshotDependencyTests-682659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77e83728-15cb-4965-9f26-2f34de2a52b2 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-77e83728-15cb-4965-9f26-2f34de2a52b2.3abb6c28-9c83-4f07-8d73-a467e3c40120" returned: 0 in 0.284s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:15 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-658833e1-dcab-4cc1-b99d-fc68a9773ebf tempest-SnapshotDependencyTests-682659 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-77e83728-15cb-4965-9f26-2f34de2a52b2.3abb6c28-9c83-4f07-8d73-a467e3c40120 is being set with open permissions: ugo+rw Sep 18 21:52:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-658833e1-dcab-4cc1-b99d-fc68a9773ebf tempest-SnapshotDependencyTests-682659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-77e83728-15cb-4965-9f26-2f34de2a52b2.3abb6c28-9c83-4f07-8d73-a467e3c40120 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:15 devstack sudo[105053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-77e83728-15cb-4965-9f26-2f34de2a52b2.3abb6c28-9c83-4f07-8d73-a467e3c40120 Sep 18 21:52:15 devstack sudo[105053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:15 devstack sudo[105053]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-658833e1-dcab-4cc1-b99d-fc68a9773ebf tempest-SnapshotDependencyTests-682659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-77e83728-15cb-4965-9f26-2f34de2a52b2.3abb6c28-9c83-4f07-8d73-a467e3c40120" returned: 0 in 0.260s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-d4bf1166-e00e-408e-a0f7-0904d0459a3c tempest-ProjectMemberTests-864505458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:52:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-658833e1-dcab-4cc1-b99d-fc68a9773ebf tempest-SnapshotDependencyTests-682659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-77e83728-15cb-4965-9f26-2f34de2a52b2.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:15 devstack sudo[105056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-77e83728-15cb-4965-9f26-2f34de2a52b2.info Sep 18 21:52:15 devstack sudo[105056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:16 devstack sudo[105056]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-658833e1-dcab-4cc1-b99d-fc68a9773ebf tempest-SnapshotDependencyTests-682659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-77e83728-15cb-4965-9f26-2f34de2a52b2.info" returned: 0 in 0.248s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:16 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-658833e1-dcab-4cc1-b99d-fc68a9773ebf tempest-SnapshotDependencyTests-682659 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-77e83728-15cb-4965-9f26-2f34de2a52b2.info is being set with open permissions: ugo+rw Sep 18 21:52:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-658833e1-dcab-4cc1-b99d-fc68a9773ebf tempest-SnapshotDependencyTests-682659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-77e83728-15cb-4965-9f26-2f34de2a52b2.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:16 devstack sudo[105060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-77e83728-15cb-4965-9f26-2f34de2a52b2.info Sep 18 21:52:16 devstack sudo[105060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:16 devstack sudo[105060]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-658833e1-dcab-4cc1-b99d-fc68a9773ebf tempest-SnapshotDependencyTests-682659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-77e83728-15cb-4965-9f26-2f34de2a52b2.info" returned: 0 in 0.242s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-658833e1-dcab-4cc1-b99d-fc68a9773ebf tempest-SnapshotDependencyTests-682659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.959s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:52:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-fdcdf413-5ca8-43e5-8f7b-4da66f6e6ed9 tempest-ProjectReaderTests-462787125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.319s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:52:16 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-fdcdf413-5ca8-43e5-8f7b-4da66f6e6ed9 tempest-ProjectReaderTests-462787125 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:52:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1993237941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86176fa4-f8a1-4bea-ab38-5fab57ada6e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dcc87503f13406caa33014a7a149d33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:52:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:52:15Z,use_quota=True,user_id='fd17cfd02234487cb53e780b5c3781e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:52:16 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-fdcdf413-5ca8-43e5-8f7b-4da66f6e6ed9 tempest-ProjectReaderTests-462787125 None] Creating volume 86176fa4-f8a1-4bea-ab38-5fab57ada6e0 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:52:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-fdcdf413-5ca8-43e5-8f7b-4da66f6e6ed9 tempest-ProjectReaderTests-462787125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:52:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-fdcdf413-5ca8-43e5-8f7b-4da66f6e6ed9 tempest-ProjectReaderTests-462787125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:52:16 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-fdcdf413-5ca8-43e5-8f7b-4da66f6e6ed9 tempest-ProjectReaderTests-462787125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:52:16 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-fdcdf413-5ca8-43e5-8f7b-4da66f6e6ed9 tempest-ProjectReaderTests-462787125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:52:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-fdcdf413-5ca8-43e5-8f7b-4da66f6e6ed9 tempest-ProjectReaderTests-462787125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:52:16 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-fdcdf413-5ca8-43e5-8f7b-4da66f6e6ed9 tempest-ProjectReaderTests-462787125 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:52:16 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-fdcdf413-5ca8-43e5-8f7b-4da66f6e6ed9 tempest-ProjectReaderTests-462787125 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:52:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-fdcdf413-5ca8-43e5-8f7b-4da66f6e6ed9 tempest-ProjectReaderTests-462787125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-86176fa4-f8a1-4bea-ab38-5fab57ada6e0 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:16 devstack sudo[105063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-86176fa4-f8a1-4bea-ab38-5fab57ada6e0 1073741824 Sep 18 21:52:16 devstack sudo[105063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:16 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-658833e1-dcab-4cc1-b99d-fc68a9773ebf tempest-SnapshotDependencyTests-682659 None] Create snapshot completed successfully Sep 18 21:52:16 devstack sudo[105063]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-fdcdf413-5ca8-43e5-8f7b-4da66f6e6ed9 tempest-ProjectReaderTests-462787125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-86176fa4-f8a1-4bea-ab38-5fab57ada6e0 1073741824" returned: 0 in 0.413s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-fdcdf413-5ca8-43e5-8f7b-4da66f6e6ed9 tempest-ProjectReaderTests-462787125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-86176fa4-f8a1-4bea-ab38-5fab57ada6e0 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:16 devstack sudo[105069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-86176fa4-f8a1-4bea-ab38-5fab57ada6e0 Sep 18 21:52:16 devstack sudo[105069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:16 devstack sudo[105069]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-fdcdf413-5ca8-43e5-8f7b-4da66f6e6ed9 tempest-ProjectReaderTests-462787125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-86176fa4-f8a1-4bea-ab38-5fab57ada6e0" returned: 0 in 0.255s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:16 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-fdcdf413-5ca8-43e5-8f7b-4da66f6e6ed9 tempest-ProjectReaderTests-462787125 None] <== create_volume: return (707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:52:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-fdcdf413-5ca8-43e5-8f7b-4da66f6e6ed9 tempest-ProjectReaderTests-462787125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:52:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-d4bf1166-e00e-408e-a0f7-0904d0459a3c tempest-ProjectMemberTests-864505458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.247s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:52:17 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-d4bf1166-e00e-408e-a0f7-0904d0459a3c tempest-ProjectMemberTests-864505458 None] Creating offline snapshot 779d0370-238a-47cf-a32b-d0ca7f8c28b5 of volume f6ebf347-2176-4abe-b509-2f3d74e65c1c {{(pid=86136) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 21:52:17 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-fdcdf413-5ca8-43e5-8f7b-4da66f6e6ed9 tempest-ProjectReaderTests-462787125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b409374-f03b-4df5-a4c0-2eb6352829ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86176fa4-f8a1-4bea-ab38-5fab57ada6e0', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:52:17 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-fdcdf413-5ca8-43e5-8f7b-4da66f6e6ed9 tempest-ProjectReaderTests-462787125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed49e977-b308-461e-8646-6f27d1c7b9cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:52:17 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[984523e6-b250-443d-96c8-998ae36859e2]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:52:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d4bf1166-e00e-408e-a0f7-0904d0459a3c tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f6ebf347-2176-4abe-b509-2f3d74e65c1c {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:17 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-fdcdf413-5ca8-43e5-8f7b-4da66f6e6ed9 tempest-ProjectReaderTests-462787125 None] Volume volume-86176fa4-f8a1-4bea-ab38-5fab57ada6e0 (86176fa4-f8a1-4bea-ab38-5fab57ada6e0): created successfully Sep 18 21:52:17 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-fdcdf413-5ca8-43e5-8f7b-4da66f6e6ed9 tempest-ProjectReaderTests-462787125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed49e977-b308-461e-8646-6f27d1c7b9cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:52:17 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-fdcdf413-5ca8-43e5-8f7b-4da66f6e6ed9 tempest-ProjectReaderTests-462787125 None] Flow 'volume_create_manager' (d96dbd1e-4583-4cef-8e05-5c008b3da49d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:52:17 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-fdcdf413-5ca8-43e5-8f7b-4da66f6e6ed9 tempest-ProjectReaderTests-462787125 None] Created volume successfully. Sep 18 21:52:17 devstack sudo[105072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f6ebf347-2176-4abe-b509-2f3d74e65c1c Sep 18 21:52:17 devstack sudo[105072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:17 devstack sudo[105072]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d4bf1166-e00e-408e-a0f7-0904d0459a3c tempest-ProjectMemberTests-864505458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f6ebf347-2176-4abe-b509-2f3d74e65c1c" returned: 0 in 0.382s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d4bf1166-e00e-408e-a0f7-0904d0459a3c tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f6ebf347-2176-4abe-b509-2f3d74e65c1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f6ebf347-2176-4abe-b509-2f3d74e65c1c.779d0370-238a-47cf-a32b-d0ca7f8c28b5 1G {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:17 devstack sudo[105077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f6ebf347-2176-4abe-b509-2f3d74e65c1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f6ebf347-2176-4abe-b509-2f3d74e65c1c.779d0370-238a-47cf-a32b-d0ca7f8c28b5 1G Sep 18 21:52:17 devstack sudo[105077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:17 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ca11887-ff39-4269-a90f-be025f824a9f tempest-SnapshotDependencyTests-682659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:52:17 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9ca11887-ff39-4269-a90f-be025f824a9f tempest-SnapshotDependencyTests-682659 None] Flow 'volume_create_manager' (dee2dfaa-fc4b-4b48-9076-cf219de45a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:52:17 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9ca11887-ff39-4269-a90f-be025f824a9f tempest-SnapshotDependencyTests-682659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9d1c8d3-2f4c-4623-ad95-d3eebee9bf4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:52:17 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9ca11887-ff39-4269-a90f-be025f824a9f tempest-SnapshotDependencyTests-682659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9d1c8d3-2f4c-4623-ad95-d3eebee9bf4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:52:17Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6737e632-218e-48b7-aa84-cc4b6a74cfc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fa7079c8efe469bbe476b3b54144f07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:52:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3abb6c28-9c83-4f07-8d73-a467e3c40120,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:52:18Z,use_quota=True,user_id='799f7bc1bafa45c7a6c76efb4515d944',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:52:17 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9ca11887-ff39-4269-a90f-be025f824a9f tempest-SnapshotDependencyTests-682659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed8ac62d-b7cc-4d86-b0aa-cdf51fcbb61f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:52:17 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9ca11887-ff39-4269-a90f-be025f824a9f tempest-SnapshotDependencyTests-682659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed8ac62d-b7cc-4d86-b0aa-cdf51fcbb61f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:52:17 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9ca11887-ff39-4269-a90f-be025f824a9f tempest-SnapshotDependencyTests-682659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b280a0ae-a2c2-4377-8a03-d0af10056ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:52:17 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9ca11887-ff39-4269-a90f-be025f824a9f tempest-SnapshotDependencyTests-682659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b280a0ae-a2c2-4377-8a03-d0af10056ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6737e632-218e-48b7-aa84-cc4b6a74cfc2', 'volume_name': 'volume-6737e632-218e-48b7-aa84-cc4b6a74cfc2', 'volume_size': 1, 'snapshot_id': '3abb6c28-9c83-4f07-8d73-a467e3c40120'}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:52:17 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9ca11887-ff39-4269-a90f-be025f824a9f tempest-SnapshotDependencyTests-682659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (983f2225-8464-4169-95fe-46dea736f89f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:52:17 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9ca11887-ff39-4269-a90f-be025f824a9f tempest-SnapshotDependencyTests-682659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (983f2225-8464-4169-95fe-46dea736f89f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:52:17 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9ca11887-ff39-4269-a90f-be025f824a9f tempest-SnapshotDependencyTests-682659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82464259-567f-4ad6-9d87-88700a2fd1b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:52:17 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-9ca11887-ff39-4269-a90f-be025f824a9f tempest-SnapshotDependencyTests-682659 None] Volume 6737e632-218e-48b7-aa84-cc4b6a74cfc2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6737e632-218e-48b7-aa84-cc4b6a74cfc2', 'volume_size': 1, 'snapshot_id': '3abb6c28-9c83-4f07-8d73-a467e3c40120'} Sep 18 21:52:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-9ca11887-ff39-4269-a90f-be025f824a9f tempest-SnapshotDependencyTests-682659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:52:17 devstack sudo[105077]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d4bf1166-e00e-408e-a0f7-0904d0459a3c tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f6ebf347-2176-4abe-b509-2f3d74e65c1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f6ebf347-2176-4abe-b509-2f3d74e65c1c.779d0370-238a-47cf-a32b-d0ca7f8c28b5 1G" returned: 0 in 0.443s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d4bf1166-e00e-408e-a0f7-0904d0459a3c tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6ebf347-2176-4abe-b509-2f3d74e65c1c -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f6ebf347-2176-4abe-b509-2f3d74e65c1c.779d0370-238a-47cf-a32b-d0ca7f8c28b5 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:17 devstack sudo[105082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6ebf347-2176-4abe-b509-2f3d74e65c1c -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f6ebf347-2176-4abe-b509-2f3d74e65c1c.779d0370-238a-47cf-a32b-d0ca7f8c28b5 Sep 18 21:52:17 devstack sudo[105082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-971e2dab-d81a-4fd9-a1ad-4bed0ed285ce tempest-ProjectReaderTests-462787125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:52:18 devstack sudo[105082]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d4bf1166-e00e-408e-a0f7-0904d0459a3c tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6ebf347-2176-4abe-b509-2f3d74e65c1c -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f6ebf347-2176-4abe-b509-2f3d74e65c1c.779d0370-238a-47cf-a32b-d0ca7f8c28b5" returned: 0 in 0.318s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:18 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-d4bf1166-e00e-408e-a0f7-0904d0459a3c tempest-ProjectMemberTests-864505458 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f6ebf347-2176-4abe-b509-2f3d74e65c1c.779d0370-238a-47cf-a32b-d0ca7f8c28b5 is being set with open permissions: ugo+rw Sep 18 21:52:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d4bf1166-e00e-408e-a0f7-0904d0459a3c tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f6ebf347-2176-4abe-b509-2f3d74e65c1c.779d0370-238a-47cf-a32b-d0ca7f8c28b5 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:18 devstack sudo[105087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f6ebf347-2176-4abe-b509-2f3d74e65c1c.779d0370-238a-47cf-a32b-d0ca7f8c28b5 Sep 18 21:52:18 devstack sudo[105087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:18 devstack sudo[105087]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d4bf1166-e00e-408e-a0f7-0904d0459a3c tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f6ebf347-2176-4abe-b509-2f3d74e65c1c.779d0370-238a-47cf-a32b-d0ca7f8c28b5" returned: 0 in 0.241s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d4bf1166-e00e-408e-a0f7-0904d0459a3c tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f6ebf347-2176-4abe-b509-2f3d74e65c1c.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:18 devstack sudo[105090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f6ebf347-2176-4abe-b509-2f3d74e65c1c.info Sep 18 21:52:18 devstack sudo[105090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:18 devstack sudo[105090]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d4bf1166-e00e-408e-a0f7-0904d0459a3c tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f6ebf347-2176-4abe-b509-2f3d74e65c1c.info" returned: 0 in 0.271s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:18 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-d4bf1166-e00e-408e-a0f7-0904d0459a3c tempest-ProjectMemberTests-864505458 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f6ebf347-2176-4abe-b509-2f3d74e65c1c.info is being set with open permissions: ugo+rw Sep 18 21:52:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d4bf1166-e00e-408e-a0f7-0904d0459a3c tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f6ebf347-2176-4abe-b509-2f3d74e65c1c.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:18 devstack sudo[105093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f6ebf347-2176-4abe-b509-2f3d74e65c1c.info Sep 18 21:52:18 devstack sudo[105093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:18 devstack sudo[105093]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d4bf1166-e00e-408e-a0f7-0904d0459a3c tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f6ebf347-2176-4abe-b509-2f3d74e65c1c.info" returned: 0 in 0.240s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-d4bf1166-e00e-408e-a0f7-0904d0459a3c tempest-ProjectMemberTests-864505458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.994s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:52:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-9ca11887-ff39-4269-a90f-be025f824a9f tempest-SnapshotDependencyTests-682659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.233s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:52:18 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-9ca11887-ff39-4269-a90f-be025f824a9f tempest-SnapshotDependencyTests-682659 None] Acquiring lock "cinder-quobyte-3abb6c28-9c83-4f07-8d73-a467e3c40120-6737e632-218e-48b7-aa84-cc4b6a74cfc2" by "_create_volume_from_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:52:19 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-9ca11887-ff39-4269-a90f-be025f824a9f tempest-SnapshotDependencyTests-682659 None] Lock "cinder-quobyte-3abb6c28-9c83-4f07-8d73-a467e3c40120-6737e632-218e-48b7-aa84-cc4b6a74cfc2" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:52:19 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-9ca11887-ff39-4269-a90f-be025f824a9f tempest-SnapshotDependencyTests-682659 None] Creating volume 6737e632-218e-48b7-aa84-cc4b6a74cfc2 from snapshot 3abb6c28-9c83-4f07-8d73-a467e3c40120 {{(pid=86136) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 18 21:52:19 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-9ca11887-ff39-4269-a90f-be025f824a9f tempest-SnapshotDependencyTests-682659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:52:19 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-9ca11887-ff39-4269-a90f-be025f824a9f tempest-SnapshotDependencyTests-682659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:52:19 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-9ca11887-ff39-4269-a90f-be025f824a9f tempest-SnapshotDependencyTests-682659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:52:19 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-9ca11887-ff39-4269-a90f-be025f824a9f tempest-SnapshotDependencyTests-682659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:52:19 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-9ca11887-ff39-4269-a90f-be025f824a9f tempest-SnapshotDependencyTests-682659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:52:19 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-9ca11887-ff39-4269-a90f-be025f824a9f tempest-SnapshotDependencyTests-682659 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:52:19 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-9ca11887-ff39-4269-a90f-be025f824a9f tempest-SnapshotDependencyTests-682659 None] Acquiring lock "cinder-quobyte-6737e632-218e-48b7-aa84-cc4b6a74cfc2" by "_copy_volume_from_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:52:19 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-d4bf1166-e00e-408e-a0f7-0904d0459a3c tempest-ProjectMemberTests-864505458 None] Create snapshot completed successfully Sep 18 21:52:19 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-9ca11887-ff39-4269-a90f-be025f824a9f tempest-SnapshotDependencyTests-682659 None] Lock "cinder-quobyte-6737e632-218e-48b7-aa84-cc4b6a74cfc2" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:52:19 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-9ca11887-ff39-4269-a90f-be025f824a9f tempest-SnapshotDependencyTests-682659 None] snapshot: 3abb6c28-9c83-4f07-8d73-a467e3c40120, volume: 6737e632-218e-48b7-aa84-cc4b6a74cfc2, {{(pid=86136) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 18 21:52:19 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-9ca11887-ff39-4269-a90f-be025f824a9f tempest-SnapshotDependencyTests-682659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:52:19 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-9ca11887-ff39-4269-a90f-be025f824a9f tempest-SnapshotDependencyTests-682659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:52:19 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-9ca11887-ff39-4269-a90f-be025f824a9f tempest-SnapshotDependencyTests-682659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:52:19 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-9ca11887-ff39-4269-a90f-be025f824a9f tempest-SnapshotDependencyTests-682659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:52:19 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-9ca11887-ff39-4269-a90f-be025f824a9f tempest-SnapshotDependencyTests-682659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:52:19 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[112f3364-f311-41b0-8933-5d7cda8e9354]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:52:19 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9ca11887-ff39-4269-a90f-be025f824a9f tempest-SnapshotDependencyTests-682659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-77e83728-15cb-4965-9f26-2f34de2a52b2.3abb6c28-9c83-4f07-8d73-a467e3c40120 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:19 devstack sudo[105096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-77e83728-15cb-4965-9f26-2f34de2a52b2.3abb6c28-9c83-4f07-8d73-a467e3c40120 Sep 18 21:52:19 devstack sudo[105096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:19 devstack sudo[105096]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:19 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9ca11887-ff39-4269-a90f-be025f824a9f tempest-SnapshotDependencyTests-682659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-77e83728-15cb-4965-9f26-2f34de2a52b2.3abb6c28-9c83-4f07-8d73-a467e3c40120" returned: 0 in 0.361s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:19 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-9ca11887-ff39-4269-a90f-be025f824a9f tempest-SnapshotDependencyTests-682659 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-77e83728-15cb-4965-9f26-2f34de2a52b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86136) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 21:52:19 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1904aa-c3d2-4052-abb5-c328de198da2]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:52:19 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9ca11887-ff39-4269-a90f-be025f824a9f tempest-SnapshotDependencyTests-682659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-77e83728-15cb-4965-9f26-2f34de2a52b2 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:19 devstack sudo[105101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-77e83728-15cb-4965-9f26-2f34de2a52b2 Sep 18 21:52:19 devstack sudo[105101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:19 devstack sudo[105101]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:19 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9ca11887-ff39-4269-a90f-be025f824a9f tempest-SnapshotDependencyTests-682659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-77e83728-15cb-4965-9f26-2f34de2a52b2" returned: 0 in 0.365s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:19 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-9ca11887-ff39-4269-a90f-be025f824a9f tempest-SnapshotDependencyTests-682659 None] will copy from snapshot at /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-77e83728-15cb-4965-9f26-2f34de2a52b2 {{(pid=86136) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 18 21:52:19 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-9ca11887-ff39-4269-a90f-be025f824a9f tempest-SnapshotDependencyTests-682659 None] Creating direct copy from snapshot {{(pid=86136) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 18 21:52:19 devstack cinder-volume[86136]: DEBUG cinder.utils [None req-9ca11887-ff39-4269-a90f-be025f824a9f tempest-SnapshotDependencyTests-682659 None] Path /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-6737e632-218e-48b7-aa84-cc4b6a74cfc2 not found in is_blk_device check {{(pid=86136) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 18 21:52:19 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9ca11887-ff39-4269-a90f-be025f824a9f tempest-SnapshotDependencyTests-682659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-77e83728-15cb-4965-9f26-2f34de2a52b2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-6737e632-218e-48b7-aa84-cc4b6a74cfc2 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:19 devstack sudo[105106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-77e83728-15cb-4965-9f26-2f34de2a52b2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-6737e632-218e-48b7-aa84-cc4b6a74cfc2 Sep 18 21:52:19 devstack sudo[105106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:19 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-ba53ed6d-325c-486c-8516-90d6564faf9f tempest-ProjectMemberTests-864505458 None] Acquiring lock "cinder-779d0370-238a-47cf-a32b-d0ca7f8c28b5-delete_snapshot" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:52:19 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-ba53ed6d-325c-486c-8516-90d6564faf9f tempest-ProjectMemberTests-864505458 None] Lock "cinder-779d0370-238a-47cf-a32b-d0ca7f8c28b5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:52:19 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-ba53ed6d-325c-486c-8516-90d6564faf9f tempest-ProjectMemberTests-864505458 None] Acquiring lock "cinder-quobyte-f6ebf347-2176-4abe-b509-2f3d74e65c1c" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:52:19 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-ba53ed6d-325c-486c-8516-90d6564faf9f tempest-ProjectMemberTests-864505458 None] Lock "cinder-quobyte-f6ebf347-2176-4abe-b509-2f3d74e65c1c" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:52:19 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-ba53ed6d-325c-486c-8516-90d6564faf9f tempest-ProjectMemberTests-864505458 None] Acquiring lock "cinder-quobyte-779d0370-238a-47cf-a32b-d0ca7f8c28b5" by "_delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:52:19 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-ba53ed6d-325c-486c-8516-90d6564faf9f tempest-ProjectMemberTests-864505458 None] Lock "cinder-quobyte-779d0370-238a-47cf-a32b-d0ca7f8c28b5" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:52:19 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-ba53ed6d-325c-486c-8516-90d6564faf9f tempest-ProjectMemberTests-864505458 None] Deleting offline snapshot 779d0370-238a-47cf-a32b-d0ca7f8c28b5 of volume f6ebf347-2176-4abe-b509-2f3d74e65c1c {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 21:52:19 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-ba53ed6d-325c-486c-8516-90d6564faf9f tempest-ProjectMemberTests-864505458 None] snapshot_file for this snap is: volume-f6ebf347-2176-4abe-b509-2f3d74e65c1c.779d0370-238a-47cf-a32b-d0ca7f8c28b5 {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 21:52:19 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[0424a29a-e81b-4629-8465-01b8c5d26f84]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:52:19 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ba53ed6d-325c-486c-8516-90d6564faf9f tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f6ebf347-2176-4abe-b509-2f3d74e65c1c.779d0370-238a-47cf-a32b-d0ca7f8c28b5 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:20 devstack sudo[105108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f6ebf347-2176-4abe-b509-2f3d74e65c1c.779d0370-238a-47cf-a32b-d0ca7f8c28b5 Sep 18 21:52:20 devstack sudo[105108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:20 devstack sudo[105108]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:20 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ba53ed6d-325c-486c-8516-90d6564faf9f tempest-ProjectMemberTests-864505458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f6ebf347-2176-4abe-b509-2f3d74e65c1c.779d0370-238a-47cf-a32b-d0ca7f8c28b5" returned: 0 in 0.531s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:20 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-ba53ed6d-325c-486c-8516-90d6564faf9f tempest-ProjectMemberTests-864505458 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6ebf347-2176-4abe-b509-2f3d74e65c1c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86136) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 21:52:20 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c8f8af-9888-4b24-acfe-488bf620d123]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:52:20 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ba53ed6d-325c-486c-8516-90d6564faf9f tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f6ebf347-2176-4abe-b509-2f3d74e65c1c {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:20 devstack sudo[105124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f6ebf347-2176-4abe-b509-2f3d74e65c1c Sep 18 21:52:20 devstack sudo[105124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:21 devstack sudo[105124]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ba53ed6d-325c-486c-8516-90d6564faf9f tempest-ProjectMemberTests-864505458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f6ebf347-2176-4abe-b509-2f3d74e65c1c" returned: 0 in 0.511s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ba53ed6d-325c-486c-8516-90d6564faf9f tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f6ebf347-2176-4abe-b509-2f3d74e65c1c.779d0370-238a-47cf-a32b-d0ca7f8c28b5 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:21 devstack sudo[105131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f6ebf347-2176-4abe-b509-2f3d74e65c1c.779d0370-238a-47cf-a32b-d0ca7f8c28b5 Sep 18 21:52:21 devstack sudo[105131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:21 devstack sudo[105131]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ba53ed6d-325c-486c-8516-90d6564faf9f tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f6ebf347-2176-4abe-b509-2f3d74e65c1c.779d0370-238a-47cf-a32b-d0ca7f8c28b5" returned: 0 in 0.630s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ba53ed6d-325c-486c-8516-90d6564faf9f tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f6ebf347-2176-4abe-b509-2f3d74e65c1c.779d0370-238a-47cf-a32b-d0ca7f8c28b5 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:21 devstack sudo[105137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f6ebf347-2176-4abe-b509-2f3d74e65c1c.779d0370-238a-47cf-a32b-d0ca7f8c28b5 Sep 18 21:52:21 devstack sudo[105137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:22 devstack sudo[105137]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-ba53ed6d-325c-486c-8516-90d6564faf9f tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f6ebf347-2176-4abe-b509-2f3d74e65c1c.779d0370-238a-47cf-a32b-d0ca7f8c28b5" returned: 0 in 0.345s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:22 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-ba53ed6d-325c-486c-8516-90d6564faf9f tempest-ProjectMemberTests-864505458 None] Lock "cinder-quobyte-779d0370-238a-47cf-a32b-d0ca7f8c28b5" released by "_delete_snapshot" :: held 2.210s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:52:22 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-ba53ed6d-325c-486c-8516-90d6564faf9f tempest-ProjectMemberTests-864505458 None] Lock "cinder-quobyte-f6ebf347-2176-4abe-b509-2f3d74e65c1c" released by "delete_snapshot" :: held 2.241s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:52:22 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-ba53ed6d-325c-486c-8516-90d6564faf9f tempest-ProjectMemberTests-864505458 None] Created reservations ['faaa41c4-4b17-49ba-8c3f-137c58f68c67', '4f09df22-dff7-4616-9230-3ae4c4cbe356', '5d4e0399-5824-4e11-9233-7a26e11e081f', '4e4f101d-3071-4ef2-bcea-e0ab5366056b'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:52:22 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-ba53ed6d-325c-486c-8516-90d6564faf9f tempest-ProjectMemberTests-864505458 None] Delete snapshot completed successfully. Sep 18 21:52:22 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-ba53ed6d-325c-486c-8516-90d6564faf9f tempest-ProjectMemberTests-864505458 None] Lock "cinder-779d0370-238a-47cf-a32b-d0ca7f8c28b5-delete_snapshot" released by "delete_snapshot" :: held 2.498s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:52:23 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-c4bcfa62-2182-4854-92f8-da1b4cd5110c tempest-ProjectMemberTests-864505458 None] Acquiring lock "cinder-f6ebf347-2176-4abe-b509-2f3d74e65c1c-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:52:23 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-c4bcfa62-2182-4854-92f8-da1b4cd5110c tempest-ProjectMemberTests-864505458 None] Lock "cinder-f6ebf347-2176-4abe-b509-2f3d74e65c1c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:52:23 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-c4bcfa62-2182-4854-92f8-da1b4cd5110c tempest-ProjectMemberTests-864505458 None] Acquiring lock "cinder-quobyte-f6ebf347-2176-4abe-b509-2f3d74e65c1c" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:52:23 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-c4bcfa62-2182-4854-92f8-da1b4cd5110c tempest-ProjectMemberTests-864505458 None] Lock "cinder-quobyte-f6ebf347-2176-4abe-b509-2f3d74e65c1c" acquired by "delete_volume" :: waited 0.032s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:52:23 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[163bcd7f-c5a8-409a-a2ff-6d694f8e33d7]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:52:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c4bcfa62-2182-4854-92f8-da1b4cd5110c tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f6ebf347-2176-4abe-b509-2f3d74e65c1c {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:23 devstack sudo[105140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f6ebf347-2176-4abe-b509-2f3d74e65c1c Sep 18 21:52:23 devstack sudo[105140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:23 devstack sudo[105140]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c4bcfa62-2182-4854-92f8-da1b4cd5110c tempest-ProjectMemberTests-864505458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f6ebf347-2176-4abe-b509-2f3d74e65c1c" returned: 0 in 0.519s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c4bcfa62-2182-4854-92f8-da1b4cd5110c tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f6ebf347-2176-4abe-b509-2f3d74e65c1c {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:24 devstack sudo[105146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f6ebf347-2176-4abe-b509-2f3d74e65c1c Sep 18 21:52:24 devstack sudo[105146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:24 devstack sudo[105146]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c4bcfa62-2182-4854-92f8-da1b4cd5110c tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f6ebf347-2176-4abe-b509-2f3d74e65c1c" returned: 0 in 0.494s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:24 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-c4bcfa62-2182-4854-92f8-da1b4cd5110c tempest-ProjectMemberTests-864505458 None] Lock "cinder-quobyte-f6ebf347-2176-4abe-b509-2f3d74e65c1c" released by "delete_volume" :: held 1.134s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:52:24 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-c4bcfa62-2182-4854-92f8-da1b4cd5110c tempest-ProjectMemberTests-864505458 None] Created reservations ['90aa0b5d-adae-419e-837b-46823ea8918b', '659341bd-412d-4dba-b133-5d66d70845ee', 'c1d85aea-0d31-4315-8817-95aa4273acc1', '52fcc830-629f-4dbb-ab14-2b041c332a85'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:52:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c4bcfa62-2182-4854-92f8-da1b4cd5110c tempest-ProjectMemberTests-864505458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:52:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c4bcfa62-2182-4854-92f8-da1b4cd5110c tempest-ProjectMemberTests-864505458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:52:24 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-c4bcfa62-2182-4854-92f8-da1b4cd5110c tempest-ProjectMemberTests-864505458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:52:24 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-c4bcfa62-2182-4854-92f8-da1b4cd5110c tempest-ProjectMemberTests-864505458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:52:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c4bcfa62-2182-4854-92f8-da1b4cd5110c tempest-ProjectMemberTests-864505458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:52:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c4bcfa62-2182-4854-92f8-da1b4cd5110c tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:24 devstack sudo[105150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:52:24 devstack sudo[105150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:24 devstack sudo[105150]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c4bcfa62-2182-4854-92f8-da1b4cd5110c tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.321s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:25 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-c4bcfa62-2182-4854-92f8-da1b4cd5110c tempest-ProjectMemberTests-864505458 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:52:25 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-c4bcfa62-2182-4854-92f8-da1b4cd5110c tempest-ProjectMemberTests-864505458 None] Deleted volume successfully. Sep 18 21:52:25 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-c4bcfa62-2182-4854-92f8-da1b4cd5110c tempest-ProjectMemberTests-864505458 None] Lock "cinder-f6ebf347-2176-4abe-b509-2f3d74e65c1c-delete_volume" released by "delete_volume" :: held 1.813s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:52:26 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-c687a55d-5df2-4e06-b241-2e0b5315fcde tempest-ProjectMemberTests-864505458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:52:26 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c687a55d-5df2-4e06-b241-2e0b5315fcde tempest-ProjectMemberTests-864505458 None] Flow 'volume_create_manager' (9fabb77a-2b31-4801-81db-0bc5ff5c06cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:52:26 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c687a55d-5df2-4e06-b241-2e0b5315fcde tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e707a9ca-d91e-43ca-a306-a51ba739b6ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:52:26 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c687a55d-5df2-4e06-b241-2e0b5315fcde tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e707a9ca-d91e-43ca-a306-a51ba739b6ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:52:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-842455157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fc89e77-e392-40df-8086-61e5e967e194,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44aed77f70a242029bc978ba9aa69a78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:52:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:52:26Z,use_quota=True,user_id='fbe2b10fb8584161a20a4564db383b3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:52:26 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c687a55d-5df2-4e06-b241-2e0b5315fcde tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d97eba7d-f5e2-40a1-9196-41decd481cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:52:26 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c687a55d-5df2-4e06-b241-2e0b5315fcde tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d97eba7d-f5e2-40a1-9196-41decd481cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:52:26 devstack sudo[105106]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:26 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c687a55d-5df2-4e06-b241-2e0b5315fcde tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd82f82a-888b-46e0-a094-152049f51152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:52:26 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c687a55d-5df2-4e06-b241-2e0b5315fcde tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd82f82a-888b-46e0-a094-152049f51152) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fc89e77-e392-40df-8086-61e5e967e194', 'volume_name': 'volume-7fc89e77-e392-40df-8086-61e5e967e194', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:52:26 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c687a55d-5df2-4e06-b241-2e0b5315fcde tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbe781f0-c58a-494a-ba68-8b893913c598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:52:26 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c687a55d-5df2-4e06-b241-2e0b5315fcde tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbe781f0-c58a-494a-ba68-8b893913c598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:52:26 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c687a55d-5df2-4e06-b241-2e0b5315fcde tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e485cfa7-6b83-4651-aa11-511a6ad2d640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:52:26 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-c687a55d-5df2-4e06-b241-2e0b5315fcde tempest-ProjectMemberTests-864505458 None] Volume 7fc89e77-e392-40df-8086-61e5e967e194: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fc89e77-e392-40df-8086-61e5e967e194', 'volume_size': 1} Sep 18 21:52:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c687a55d-5df2-4e06-b241-2e0b5315fcde tempest-ProjectMemberTests-864505458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:52:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9ca11887-ff39-4269-a90f-be025f824a9f tempest-SnapshotDependencyTests-682659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-77e83728-15cb-4965-9f26-2f34de2a52b2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-6737e632-218e-48b7-aa84-cc4b6a74cfc2" returned: 0 in 6.782s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:26 devstack cinder-volume[86136]: DEBUG cinder.image.image_utils [None req-9ca11887-ff39-4269-a90f-be025f824a9f tempest-SnapshotDependencyTests-682659 None] Image conversion details: src /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-77e83728-15cb-4965-9f26-2f34de2a52b2, size 1024.00 MB, duration 6.78 sec, destination /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-6737e632-218e-48b7-aa84-cc4b6a74cfc2 {{(pid=86136) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 18 21:52:26 devstack cinder-volume[86136]: INFO cinder.image.image_utils [None req-9ca11887-ff39-4269-a90f-be025f824a9f tempest-SnapshotDependencyTests-682659 None] Converted 1024.00 MB image at 150.97 MB/s Sep 18 21:52:26 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-9ca11887-ff39-4269-a90f-be025f824a9f tempest-SnapshotDependencyTests-682659 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-6737e632-218e-48b7-aa84-cc4b6a74cfc2 is being set with open permissions: ugo+rw Sep 18 21:52:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9ca11887-ff39-4269-a90f-be025f824a9f tempest-SnapshotDependencyTests-682659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-6737e632-218e-48b7-aa84-cc4b6a74cfc2 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:26 devstack sudo[105153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-6737e632-218e-48b7-aa84-cc4b6a74cfc2 Sep 18 21:52:26 devstack sudo[105153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:26 devstack sudo[105153]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9ca11887-ff39-4269-a90f-be025f824a9f tempest-SnapshotDependencyTests-682659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-6737e632-218e-48b7-aa84-cc4b6a74cfc2" returned: 0 in 0.251s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:26 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-9ca11887-ff39-4269-a90f-be025f824a9f tempest-SnapshotDependencyTests-682659 None] Lock "cinder-quobyte-6737e632-218e-48b7-aa84-cc4b6a74cfc2" released by "_copy_volume_from_snapshot" :: held 7.839s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:52:26 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-9ca11887-ff39-4269-a90f-be025f824a9f tempest-SnapshotDependencyTests-682659 None] Lock "cinder-quobyte-3abb6c28-9c83-4f07-8d73-a467e3c40120-6737e632-218e-48b7-aa84-cc4b6a74cfc2" released by "_create_volume_from_snapshot" :: held 7.901s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:52:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-9ca11887-ff39-4269-a90f-be025f824a9f tempest-SnapshotDependencyTests-682659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.926s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:52:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-971e2dab-d81a-4fd9-a1ad-4bed0ed285ce tempest-ProjectReaderTests-462787125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.776s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:52:26 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-971e2dab-d81a-4fd9-a1ad-4bed0ed285ce tempest-ProjectReaderTests-462787125 None] Creating offline snapshot 3413b364-549d-4b6c-87f9-c8adea2a5064 of volume 86176fa4-f8a1-4bea-ab38-5fab57ada6e0 {{(pid=86136) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 21:52:26 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9ca11887-ff39-4269-a90f-be025f824a9f tempest-SnapshotDependencyTests-682659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82464259-567f-4ad6-9d87-88700a2fd1b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6737e632-218e-48b7-aa84-cc4b6a74cfc2', 'volume_size': 1, 'snapshot_id': '3abb6c28-9c83-4f07-8d73-a467e3c40120'}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:52:26 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9ca11887-ff39-4269-a90f-be025f824a9f tempest-SnapshotDependencyTests-682659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b16b9dd2-73d0-48d4-bc90-7f31700d70e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:52:26 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ff915c-a846-4ccd-a09d-db23dd4afd7e]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:52:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-971e2dab-d81a-4fd9-a1ad-4bed0ed285ce tempest-ProjectReaderTests-462787125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-86176fa4-f8a1-4bea-ab38-5fab57ada6e0 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:26 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-9ca11887-ff39-4269-a90f-be025f824a9f tempest-SnapshotDependencyTests-682659 None] Volume volume-6737e632-218e-48b7-aa84-cc4b6a74cfc2 (6737e632-218e-48b7-aa84-cc4b6a74cfc2): created successfully Sep 18 21:52:26 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9ca11887-ff39-4269-a90f-be025f824a9f tempest-SnapshotDependencyTests-682659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b16b9dd2-73d0-48d4-bc90-7f31700d70e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:52:26 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9ca11887-ff39-4269-a90f-be025f824a9f tempest-SnapshotDependencyTests-682659 None] Flow 'volume_create_manager' (dee2dfaa-fc4b-4b48-9076-cf219de45a75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:52:27 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-9ca11887-ff39-4269-a90f-be025f824a9f tempest-SnapshotDependencyTests-682659 None] Created volume successfully. Sep 18 21:52:27 devstack sudo[105156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-86176fa4-f8a1-4bea-ab38-5fab57ada6e0 Sep 18 21:52:27 devstack sudo[105156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:27 devstack sudo[105156]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:27 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-971e2dab-d81a-4fd9-a1ad-4bed0ed285ce tempest-ProjectReaderTests-462787125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-86176fa4-f8a1-4bea-ab38-5fab57ada6e0" returned: 0 in 0.372s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:27 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-971e2dab-d81a-4fd9-a1ad-4bed0ed285ce tempest-ProjectReaderTests-462787125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-86176fa4-f8a1-4bea-ab38-5fab57ada6e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-86176fa4-f8a1-4bea-ab38-5fab57ada6e0.3413b364-549d-4b6c-87f9-c8adea2a5064 1G {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:27 devstack sudo[105164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-86176fa4-f8a1-4bea-ab38-5fab57ada6e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-86176fa4-f8a1-4bea-ab38-5fab57ada6e0.3413b364-549d-4b6c-87f9-c8adea2a5064 1G Sep 18 21:52:27 devstack sudo[105164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:27 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-8fddb871-4200-42e7-87f3-ea4cc3ee19db tempest-SnapshotDependencyTests-682659 None] Acquiring lock "cinder-3abb6c28-9c83-4f07-8d73-a467e3c40120-delete_snapshot" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:52:27 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-8fddb871-4200-42e7-87f3-ea4cc3ee19db tempest-SnapshotDependencyTests-682659 None] Lock "cinder-3abb6c28-9c83-4f07-8d73-a467e3c40120-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:52:27 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-8fddb871-4200-42e7-87f3-ea4cc3ee19db tempest-SnapshotDependencyTests-682659 None] Acquiring lock "cinder-quobyte-77e83728-15cb-4965-9f26-2f34de2a52b2" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:52:27 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-8fddb871-4200-42e7-87f3-ea4cc3ee19db tempest-SnapshotDependencyTests-682659 None] Lock "cinder-quobyte-77e83728-15cb-4965-9f26-2f34de2a52b2" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:52:27 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-8fddb871-4200-42e7-87f3-ea4cc3ee19db tempest-SnapshotDependencyTests-682659 None] Acquiring lock "cinder-quobyte-3abb6c28-9c83-4f07-8d73-a467e3c40120" by "_delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:52:27 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-8fddb871-4200-42e7-87f3-ea4cc3ee19db tempest-SnapshotDependencyTests-682659 None] Lock "cinder-quobyte-3abb6c28-9c83-4f07-8d73-a467e3c40120" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:52:27 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-8fddb871-4200-42e7-87f3-ea4cc3ee19db tempest-SnapshotDependencyTests-682659 None] Deleting offline snapshot 3abb6c28-9c83-4f07-8d73-a467e3c40120 of volume 77e83728-15cb-4965-9f26-2f34de2a52b2 {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 21:52:27 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-8fddb871-4200-42e7-87f3-ea4cc3ee19db tempest-SnapshotDependencyTests-682659 None] snapshot_file for this snap is: volume-77e83728-15cb-4965-9f26-2f34de2a52b2.3abb6c28-9c83-4f07-8d73-a467e3c40120 {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 21:52:27 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d87d40a-3ce1-42e7-837b-201121c432b9]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:52:27 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-8fddb871-4200-42e7-87f3-ea4cc3ee19db tempest-SnapshotDependencyTests-682659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-77e83728-15cb-4965-9f26-2f34de2a52b2.3abb6c28-9c83-4f07-8d73-a467e3c40120 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:27 devstack sudo[105171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-77e83728-15cb-4965-9f26-2f34de2a52b2.3abb6c28-9c83-4f07-8d73-a467e3c40120 Sep 18 21:52:27 devstack sudo[105171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:27 devstack sudo[105164]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:27 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-971e2dab-d81a-4fd9-a1ad-4bed0ed285ce tempest-ProjectReaderTests-462787125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-86176fa4-f8a1-4bea-ab38-5fab57ada6e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-86176fa4-f8a1-4bea-ab38-5fab57ada6e0.3413b364-549d-4b6c-87f9-c8adea2a5064 1G" returned: 0 in 0.419s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:27 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-971e2dab-d81a-4fd9-a1ad-4bed0ed285ce tempest-ProjectReaderTests-462787125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86176fa4-f8a1-4bea-ab38-5fab57ada6e0 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-86176fa4-f8a1-4bea-ab38-5fab57ada6e0.3413b364-549d-4b6c-87f9-c8adea2a5064 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:27 devstack sudo[105175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86176fa4-f8a1-4bea-ab38-5fab57ada6e0 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-86176fa4-f8a1-4bea-ab38-5fab57ada6e0.3413b364-549d-4b6c-87f9-c8adea2a5064 Sep 18 21:52:27 devstack sudo[105175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:27 devstack sudo[105171]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:27 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-8fddb871-4200-42e7-87f3-ea4cc3ee19db tempest-SnapshotDependencyTests-682659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-77e83728-15cb-4965-9f26-2f34de2a52b2.3abb6c28-9c83-4f07-8d73-a467e3c40120" returned: 0 in 0.373s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:27 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-8fddb871-4200-42e7-87f3-ea4cc3ee19db tempest-SnapshotDependencyTests-682659 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-77e83728-15cb-4965-9f26-2f34de2a52b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86136) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 21:52:27 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9e30b9e-a5ef-44e0-aa57-9a0856e2bb79]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:52:27 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-8fddb871-4200-42e7-87f3-ea4cc3ee19db tempest-SnapshotDependencyTests-682659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-77e83728-15cb-4965-9f26-2f34de2a52b2 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:28 devstack sudo[105175]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-971e2dab-d81a-4fd9-a1ad-4bed0ed285ce tempest-ProjectReaderTests-462787125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86176fa4-f8a1-4bea-ab38-5fab57ada6e0 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-86176fa4-f8a1-4bea-ab38-5fab57ada6e0.3413b364-549d-4b6c-87f9-c8adea2a5064" returned: 0 in 0.306s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:28 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-971e2dab-d81a-4fd9-a1ad-4bed0ed285ce tempest-ProjectReaderTests-462787125 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-86176fa4-f8a1-4bea-ab38-5fab57ada6e0.3413b364-549d-4b6c-87f9-c8adea2a5064 is being set with open permissions: ugo+rw Sep 18 21:52:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-971e2dab-d81a-4fd9-a1ad-4bed0ed285ce tempest-ProjectReaderTests-462787125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-86176fa4-f8a1-4bea-ab38-5fab57ada6e0.3413b364-549d-4b6c-87f9-c8adea2a5064 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:28 devstack sudo[105218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-86176fa4-f8a1-4bea-ab38-5fab57ada6e0.3413b364-549d-4b6c-87f9-c8adea2a5064 Sep 18 21:52:28 devstack sudo[105218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:28 devstack sudo[105217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-77e83728-15cb-4965-9f26-2f34de2a52b2 Sep 18 21:52:28 devstack sudo[105217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:28 devstack sudo[105218]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-971e2dab-d81a-4fd9-a1ad-4bed0ed285ce tempest-ProjectReaderTests-462787125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-86176fa4-f8a1-4bea-ab38-5fab57ada6e0.3413b364-549d-4b6c-87f9-c8adea2a5064" returned: 0 in 0.278s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-971e2dab-d81a-4fd9-a1ad-4bed0ed285ce tempest-ProjectReaderTests-462787125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-86176fa4-f8a1-4bea-ab38-5fab57ada6e0.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:28 devstack sudo[105226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-86176fa4-f8a1-4bea-ab38-5fab57ada6e0.info Sep 18 21:52:28 devstack sudo[105226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:28 devstack sudo[105217]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-8fddb871-4200-42e7-87f3-ea4cc3ee19db tempest-SnapshotDependencyTests-682659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-77e83728-15cb-4965-9f26-2f34de2a52b2" returned: 0 in 0.549s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-8fddb871-4200-42e7-87f3-ea4cc3ee19db tempest-SnapshotDependencyTests-682659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-77e83728-15cb-4965-9f26-2f34de2a52b2.3abb6c28-9c83-4f07-8d73-a467e3c40120 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:28 devstack sudo[105229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-77e83728-15cb-4965-9f26-2f34de2a52b2.3abb6c28-9c83-4f07-8d73-a467e3c40120 Sep 18 21:52:28 devstack sudo[105229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:28 devstack sudo[105226]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-971e2dab-d81a-4fd9-a1ad-4bed0ed285ce tempest-ProjectReaderTests-462787125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-86176fa4-f8a1-4bea-ab38-5fab57ada6e0.info" returned: 0 in 0.260s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:28 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-971e2dab-d81a-4fd9-a1ad-4bed0ed285ce tempest-ProjectReaderTests-462787125 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-86176fa4-f8a1-4bea-ab38-5fab57ada6e0.info is being set with open permissions: ugo+rw Sep 18 21:52:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-971e2dab-d81a-4fd9-a1ad-4bed0ed285ce tempest-ProjectReaderTests-462787125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-86176fa4-f8a1-4bea-ab38-5fab57ada6e0.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:28 devstack sudo[105232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-86176fa4-f8a1-4bea-ab38-5fab57ada6e0.info Sep 18 21:52:28 devstack sudo[105232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:28 devstack sudo[105229]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-8fddb871-4200-42e7-87f3-ea4cc3ee19db tempest-SnapshotDependencyTests-682659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-77e83728-15cb-4965-9f26-2f34de2a52b2.3abb6c28-9c83-4f07-8d73-a467e3c40120" returned: 0 in 0.347s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-8fddb871-4200-42e7-87f3-ea4cc3ee19db tempest-SnapshotDependencyTests-682659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-77e83728-15cb-4965-9f26-2f34de2a52b2.3abb6c28-9c83-4f07-8d73-a467e3c40120 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:28 devstack sudo[105232]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-971e2dab-d81a-4fd9-a1ad-4bed0ed285ce tempest-ProjectReaderTests-462787125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-86176fa4-f8a1-4bea-ab38-5fab57ada6e0.info" returned: 0 in 0.263s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:28 devstack sudo[105238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-77e83728-15cb-4965-9f26-2f34de2a52b2.3abb6c28-9c83-4f07-8d73-a467e3c40120 Sep 18 21:52:28 devstack sudo[105238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-971e2dab-d81a-4fd9-a1ad-4bed0ed285ce tempest-ProjectReaderTests-462787125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.994s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:52:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c687a55d-5df2-4e06-b241-2e0b5315fcde tempest-ProjectMemberTests-864505458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.303s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:52:28 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-c687a55d-5df2-4e06-b241-2e0b5315fcde tempest-ProjectMemberTests-864505458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:52:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-842455157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fc89e77-e392-40df-8086-61e5e967e194,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44aed77f70a242029bc978ba9aa69a78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:52:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:52:26Z,use_quota=True,user_id='fbe2b10fb8584161a20a4564db383b3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:52:28 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-c687a55d-5df2-4e06-b241-2e0b5315fcde tempest-ProjectMemberTests-864505458 None] Creating volume 7fc89e77-e392-40df-8086-61e5e967e194 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:52:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c687a55d-5df2-4e06-b241-2e0b5315fcde tempest-ProjectMemberTests-864505458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:52:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c687a55d-5df2-4e06-b241-2e0b5315fcde tempest-ProjectMemberTests-864505458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:52:28 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-c687a55d-5df2-4e06-b241-2e0b5315fcde tempest-ProjectMemberTests-864505458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:52:28 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-c687a55d-5df2-4e06-b241-2e0b5315fcde tempest-ProjectMemberTests-864505458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:52:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c687a55d-5df2-4e06-b241-2e0b5315fcde tempest-ProjectMemberTests-864505458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:52:28 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-c687a55d-5df2-4e06-b241-2e0b5315fcde tempest-ProjectMemberTests-864505458 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:52:28 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-c687a55d-5df2-4e06-b241-2e0b5315fcde tempest-ProjectMemberTests-864505458 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:52:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c687a55d-5df2-4e06-b241-2e0b5315fcde tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7fc89e77-e392-40df-8086-61e5e967e194 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:28 devstack sudo[105240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7fc89e77-e392-40df-8086-61e5e967e194 1073741824 Sep 18 21:52:28 devstack sudo[105240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:28 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-971e2dab-d81a-4fd9-a1ad-4bed0ed285ce tempest-ProjectReaderTests-462787125 None] Create snapshot completed successfully Sep 18 21:52:29 devstack sudo[105238]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-8fddb871-4200-42e7-87f3-ea4cc3ee19db tempest-SnapshotDependencyTests-682659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-77e83728-15cb-4965-9f26-2f34de2a52b2.3abb6c28-9c83-4f07-8d73-a467e3c40120" returned: 0 in 0.249s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:29 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-8fddb871-4200-42e7-87f3-ea4cc3ee19db tempest-SnapshotDependencyTests-682659 None] Lock "cinder-quobyte-3abb6c28-9c83-4f07-8d73-a467e3c40120" released by "_delete_snapshot" :: held 1.645s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:52:29 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-8fddb871-4200-42e7-87f3-ea4cc3ee19db tempest-SnapshotDependencyTests-682659 None] Lock "cinder-quobyte-77e83728-15cb-4965-9f26-2f34de2a52b2" released by "delete_snapshot" :: held 1.667s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:52:29 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-8fddb871-4200-42e7-87f3-ea4cc3ee19db tempest-SnapshotDependencyTests-682659 None] Created reservations ['e1cc8984-fdb7-4642-867a-be67beafedfa', 'd88b9b55-ad25-419f-9cfd-155286e4d6d9', '161914d6-20e7-4293-9dd3-ca871d2bc075', 'd25b51aa-c797-483c-b41e-565449e2ea72'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:52:29 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-8fddb871-4200-42e7-87f3-ea4cc3ee19db tempest-SnapshotDependencyTests-682659 None] Delete snapshot completed successfully. Sep 18 21:52:29 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-8fddb871-4200-42e7-87f3-ea4cc3ee19db tempest-SnapshotDependencyTests-682659 None] Lock "cinder-3abb6c28-9c83-4f07-8d73-a467e3c40120-delete_snapshot" released by "delete_snapshot" :: held 1.805s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:52:29 devstack sudo[105240]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c687a55d-5df2-4e06-b241-2e0b5315fcde tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7fc89e77-e392-40df-8086-61e5e967e194 1073741824" returned: 0 in 0.463s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c687a55d-5df2-4e06-b241-2e0b5315fcde tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7fc89e77-e392-40df-8086-61e5e967e194 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:29 devstack sudo[105247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7fc89e77-e392-40df-8086-61e5e967e194 Sep 18 21:52:29 devstack sudo[105247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:29 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-66d82424-e5e7-4468-a2d5-8b8f7868e922 tempest-SnapshotDependencyTests-682659 None] Acquiring lock "cinder-77e83728-15cb-4965-9f26-2f34de2a52b2-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:52:29 devstack sudo[105247]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:29 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-66d82424-e5e7-4468-a2d5-8b8f7868e922 tempest-SnapshotDependencyTests-682659 None] Lock "cinder-77e83728-15cb-4965-9f26-2f34de2a52b2-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:52:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c687a55d-5df2-4e06-b241-2e0b5315fcde tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7fc89e77-e392-40df-8086-61e5e967e194" returned: 0 in 0.269s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:29 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-c687a55d-5df2-4e06-b241-2e0b5315fcde tempest-ProjectMemberTests-864505458 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:52:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c687a55d-5df2-4e06-b241-2e0b5315fcde tempest-ProjectMemberTests-864505458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:52:29 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c687a55d-5df2-4e06-b241-2e0b5315fcde tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e485cfa7-6b83-4651-aa11-511a6ad2d640) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fc89e77-e392-40df-8086-61e5e967e194', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:52:29 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c687a55d-5df2-4e06-b241-2e0b5315fcde tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf1e92f7-fa48-4eb4-a49a-fec55478d483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:52:29 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-c687a55d-5df2-4e06-b241-2e0b5315fcde tempest-ProjectMemberTests-864505458 None] Volume volume-7fc89e77-e392-40df-8086-61e5e967e194 (7fc89e77-e392-40df-8086-61e5e967e194): created successfully Sep 18 21:52:29 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c687a55d-5df2-4e06-b241-2e0b5315fcde tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf1e92f7-fa48-4eb4-a49a-fec55478d483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:52:29 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-c687a55d-5df2-4e06-b241-2e0b5315fcde tempest-ProjectMemberTests-864505458 None] Flow 'volume_create_manager' (9fabb77a-2b31-4801-81db-0bc5ff5c06cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:52:29 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-4623c9bc-0413-4b1d-8def-9c6ed2c296b5 tempest-ProjectReaderTests-462787125 None] Acquiring lock "cinder-3413b364-549d-4b6c-87f9-c8adea2a5064-delete_snapshot" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:52:29 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-66d82424-e5e7-4468-a2d5-8b8f7868e922 tempest-SnapshotDependencyTests-682659 None] Acquiring lock "cinder-quobyte-77e83728-15cb-4965-9f26-2f34de2a52b2" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:52:29 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-c687a55d-5df2-4e06-b241-2e0b5315fcde tempest-ProjectMemberTests-864505458 None] Created volume successfully. Sep 18 21:52:29 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-4623c9bc-0413-4b1d-8def-9c6ed2c296b5 tempest-ProjectReaderTests-462787125 None] Lock "cinder-3413b364-549d-4b6c-87f9-c8adea2a5064-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:52:29 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-4623c9bc-0413-4b1d-8def-9c6ed2c296b5 tempest-ProjectReaderTests-462787125 None] Acquiring lock "cinder-quobyte-86176fa4-f8a1-4bea-ab38-5fab57ada6e0" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:52:29 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-66d82424-e5e7-4468-a2d5-8b8f7868e922 tempest-SnapshotDependencyTests-682659 None] Lock "cinder-quobyte-77e83728-15cb-4965-9f26-2f34de2a52b2" acquired by "delete_volume" :: waited 0.035s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:52:29 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-4623c9bc-0413-4b1d-8def-9c6ed2c296b5 tempest-ProjectReaderTests-462787125 None] Lock "cinder-quobyte-86176fa4-f8a1-4bea-ab38-5fab57ada6e0" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:52:29 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-4623c9bc-0413-4b1d-8def-9c6ed2c296b5 tempest-ProjectReaderTests-462787125 None] Acquiring lock "cinder-quobyte-3413b364-549d-4b6c-87f9-c8adea2a5064" by "_delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:52:29 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ba4132-eacb-412b-9b8c-e74c1f6fd88b]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:52:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-66d82424-e5e7-4468-a2d5-8b8f7868e922 tempest-SnapshotDependencyTests-682659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-77e83728-15cb-4965-9f26-2f34de2a52b2 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:29 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-4623c9bc-0413-4b1d-8def-9c6ed2c296b5 tempest-ProjectReaderTests-462787125 None] Lock "cinder-quobyte-3413b364-549d-4b6c-87f9-c8adea2a5064" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:52:29 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-4623c9bc-0413-4b1d-8def-9c6ed2c296b5 tempest-ProjectReaderTests-462787125 None] Deleting offline snapshot 3413b364-549d-4b6c-87f9-c8adea2a5064 of volume 86176fa4-f8a1-4bea-ab38-5fab57ada6e0 {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 21:52:29 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-4623c9bc-0413-4b1d-8def-9c6ed2c296b5 tempest-ProjectReaderTests-462787125 None] snapshot_file for this snap is: volume-86176fa4-f8a1-4bea-ab38-5fab57ada6e0.3413b364-549d-4b6c-87f9-c8adea2a5064 {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 21:52:29 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd7d7d93-bc2e-4a06-95a5-a492c26692f6]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:52:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-4623c9bc-0413-4b1d-8def-9c6ed2c296b5 tempest-ProjectReaderTests-462787125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-86176fa4-f8a1-4bea-ab38-5fab57ada6e0.3413b364-549d-4b6c-87f9-c8adea2a5064 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:29 devstack sudo[105250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-77e83728-15cb-4965-9f26-2f34de2a52b2 Sep 18 21:52:29 devstack sudo[105250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:30 devstack sudo[105251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-86176fa4-f8a1-4bea-ab38-5fab57ada6e0.3413b364-549d-4b6c-87f9-c8adea2a5064 Sep 18 21:52:30 devstack sudo[105251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:30 devstack sudo[105250]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:30 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-66d82424-e5e7-4468-a2d5-8b8f7868e922 tempest-SnapshotDependencyTests-682659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-77e83728-15cb-4965-9f26-2f34de2a52b2" returned: 0 in 0.368s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:30 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-66d82424-e5e7-4468-a2d5-8b8f7868e922 tempest-SnapshotDependencyTests-682659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-77e83728-15cb-4965-9f26-2f34de2a52b2 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:30 devstack sudo[105260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-77e83728-15cb-4965-9f26-2f34de2a52b2 Sep 18 21:52:30 devstack sudo[105260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:30 devstack sudo[105251]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:30 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-4623c9bc-0413-4b1d-8def-9c6ed2c296b5 tempest-ProjectReaderTests-462787125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-86176fa4-f8a1-4bea-ab38-5fab57ada6e0.3413b364-549d-4b6c-87f9-c8adea2a5064" returned: 0 in 0.392s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:30 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-4623c9bc-0413-4b1d-8def-9c6ed2c296b5 tempest-ProjectReaderTests-462787125 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-86176fa4-f8a1-4bea-ab38-5fab57ada6e0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86136) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 21:52:30 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cc73fdf-f56b-43e7-bd48-0911c75a61d6]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:52:30 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-4623c9bc-0413-4b1d-8def-9c6ed2c296b5 tempest-ProjectReaderTests-462787125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-86176fa4-f8a1-4bea-ab38-5fab57ada6e0 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:30 devstack sudo[105263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-86176fa4-f8a1-4bea-ab38-5fab57ada6e0 Sep 18 21:52:30 devstack sudo[105263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:30 devstack sudo[105260]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:30 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-66d82424-e5e7-4468-a2d5-8b8f7868e922 tempest-SnapshotDependencyTests-682659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-77e83728-15cb-4965-9f26-2f34de2a52b2" returned: 0 in 0.261s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:30 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-66d82424-e5e7-4468-a2d5-8b8f7868e922 tempest-SnapshotDependencyTests-682659 None] Lock "cinder-quobyte-77e83728-15cb-4965-9f26-2f34de2a52b2" released by "delete_volume" :: held 0.701s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:52:30 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-66d82424-e5e7-4468-a2d5-8b8f7868e922 tempest-SnapshotDependencyTests-682659 None] Created reservations ['8bae5101-449d-4078-b8ba-9a6f4f02e504', 'c2a97651-160e-4ede-8b12-fbeff28ddfbc', '489e7b96-f8c7-4055-8108-edac82344bd7', 'ffc3db1a-dbf5-4455-9d09-a9ce2e5afcb3'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:52:30 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-66d82424-e5e7-4468-a2d5-8b8f7868e922 tempest-SnapshotDependencyTests-682659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:52:30 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-66d82424-e5e7-4468-a2d5-8b8f7868e922 tempest-SnapshotDependencyTests-682659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:52:30 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-66d82424-e5e7-4468-a2d5-8b8f7868e922 tempest-SnapshotDependencyTests-682659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:52:30 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-66d82424-e5e7-4468-a2d5-8b8f7868e922 tempest-SnapshotDependencyTests-682659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:52:30 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-66d82424-e5e7-4468-a2d5-8b8f7868e922 tempest-SnapshotDependencyTests-682659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:52:30 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-66d82424-e5e7-4468-a2d5-8b8f7868e922 tempest-SnapshotDependencyTests-682659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:30 devstack sudo[105268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:52:30 devstack sudo[105268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:30 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-d1edf3e4-498a-4a42-8c76-a79cdfe8f64b tempest-ProjectMemberTests-864505458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:52:30 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-d1edf3e4-498a-4a42-8c76-a79cdfe8f64b tempest-ProjectMemberTests-864505458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:52:30 devstack sudo[105263]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:30 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-4623c9bc-0413-4b1d-8def-9c6ed2c296b5 tempest-ProjectReaderTests-462787125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-86176fa4-f8a1-4bea-ab38-5fab57ada6e0" returned: 0 in 0.480s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:30 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-4623c9bc-0413-4b1d-8def-9c6ed2c296b5 tempest-ProjectReaderTests-462787125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-86176fa4-f8a1-4bea-ab38-5fab57ada6e0.3413b364-549d-4b6c-87f9-c8adea2a5064 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:30 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-d1edf3e4-498a-4a42-8c76-a79cdfe8f64b tempest-ProjectMemberTests-864505458 None] Creating offline snapshot fbcfb88a-b726-44c7-b8d0-6eef7f0d8d4a of volume 7fc89e77-e392-40df-8086-61e5e967e194 {{(pid=86136) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 21:52:30 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-fb9e41a2-5d1b-4f44-8fb4-96496efeb460 tempest-SnapshotDependencyTests-682659 None] Acquiring lock "cinder-6737e632-218e-48b7-aa84-cc4b6a74cfc2-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:52:30 devstack sudo[105271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-86176fa4-f8a1-4bea-ab38-5fab57ada6e0.3413b364-549d-4b6c-87f9-c8adea2a5064 Sep 18 21:52:30 devstack sudo[105271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:30 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e01bab-b568-4609-bb2c-501a4a0f70f4]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:52:30 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d1edf3e4-498a-4a42-8c76-a79cdfe8f64b tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7fc89e77-e392-40df-8086-61e5e967e194 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:30 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-fb9e41a2-5d1b-4f44-8fb4-96496efeb460 tempest-SnapshotDependencyTests-682659 None] Lock "cinder-6737e632-218e-48b7-aa84-cc4b6a74cfc2-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:52:30 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-fb9e41a2-5d1b-4f44-8fb4-96496efeb460 tempest-SnapshotDependencyTests-682659 None] Acquiring lock "cinder-quobyte-6737e632-218e-48b7-aa84-cc4b6a74cfc2" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:52:30 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-fb9e41a2-5d1b-4f44-8fb4-96496efeb460 tempest-SnapshotDependencyTests-682659 None] Lock "cinder-quobyte-6737e632-218e-48b7-aa84-cc4b6a74cfc2" acquired by "delete_volume" :: waited 0.026s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:52:31 devstack sudo[105268]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-66d82424-e5e7-4468-a2d5-8b8f7868e922 tempest-SnapshotDependencyTests-682659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.346s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:31 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-66d82424-e5e7-4468-a2d5-8b8f7868e922 tempest-SnapshotDependencyTests-682659 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:52:31 devstack sudo[105274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7fc89e77-e392-40df-8086-61e5e967e194 Sep 18 21:52:31 devstack sudo[105274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:31 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-66d82424-e5e7-4468-a2d5-8b8f7868e922 tempest-SnapshotDependencyTests-682659 None] Deleted volume successfully. Sep 18 21:52:31 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e4ee13-8900-4871-801f-42a25c2d029e]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:52:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-fb9e41a2-5d1b-4f44-8fb4-96496efeb460 tempest-SnapshotDependencyTests-682659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-6737e632-218e-48b7-aa84-cc4b6a74cfc2 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:31 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-66d82424-e5e7-4468-a2d5-8b8f7868e922 tempest-SnapshotDependencyTests-682659 None] Lock "cinder-77e83728-15cb-4965-9f26-2f34de2a52b2-delete_volume" released by "delete_volume" :: held 1.381s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:52:31 devstack sudo[105277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-6737e632-218e-48b7-aa84-cc4b6a74cfc2 Sep 18 21:52:31 devstack sudo[105277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:31 devstack sudo[105271]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-4623c9bc-0413-4b1d-8def-9c6ed2c296b5 tempest-ProjectReaderTests-462787125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-86176fa4-f8a1-4bea-ab38-5fab57ada6e0.3413b364-549d-4b6c-87f9-c8adea2a5064" returned: 0 in 0.408s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-4623c9bc-0413-4b1d-8def-9c6ed2c296b5 tempest-ProjectReaderTests-462787125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-86176fa4-f8a1-4bea-ab38-5fab57ada6e0.3413b364-549d-4b6c-87f9-c8adea2a5064 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:31 devstack sudo[105283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-86176fa4-f8a1-4bea-ab38-5fab57ada6e0.3413b364-549d-4b6c-87f9-c8adea2a5064 Sep 18 21:52:31 devstack sudo[105283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:31 devstack sudo[105274]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d1edf3e4-498a-4a42-8c76-a79cdfe8f64b tempest-ProjectMemberTests-864505458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7fc89e77-e392-40df-8086-61e5e967e194" returned: 0 in 0.443s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d1edf3e4-498a-4a42-8c76-a79cdfe8f64b tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7fc89e77-e392-40df-8086-61e5e967e194,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7fc89e77-e392-40df-8086-61e5e967e194.fbcfb88a-b726-44c7-b8d0-6eef7f0d8d4a 1G {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:31 devstack sudo[105288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7fc89e77-e392-40df-8086-61e5e967e194,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7fc89e77-e392-40df-8086-61e5e967e194.fbcfb88a-b726-44c7-b8d0-6eef7f0d8d4a 1G Sep 18 21:52:31 devstack sudo[105288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:31 devstack sudo[105277]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-fb9e41a2-5d1b-4f44-8fb4-96496efeb460 tempest-SnapshotDependencyTests-682659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-6737e632-218e-48b7-aa84-cc4b6a74cfc2" returned: 0 in 0.415s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-fb9e41a2-5d1b-4f44-8fb4-96496efeb460 tempest-SnapshotDependencyTests-682659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-6737e632-218e-48b7-aa84-cc4b6a74cfc2 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:31 devstack sudo[105294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-6737e632-218e-48b7-aa84-cc4b6a74cfc2 Sep 18 21:52:31 devstack sudo[105294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:31 devstack sudo[105283]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-4623c9bc-0413-4b1d-8def-9c6ed2c296b5 tempest-ProjectReaderTests-462787125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-86176fa4-f8a1-4bea-ab38-5fab57ada6e0.3413b364-549d-4b6c-87f9-c8adea2a5064" returned: 0 in 0.271s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:31 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-4623c9bc-0413-4b1d-8def-9c6ed2c296b5 tempest-ProjectReaderTests-462787125 None] Lock "cinder-quobyte-3413b364-549d-4b6c-87f9-c8adea2a5064" released by "_delete_snapshot" :: held 1.660s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:52:31 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-4623c9bc-0413-4b1d-8def-9c6ed2c296b5 tempest-ProjectReaderTests-462787125 None] Lock "cinder-quobyte-86176fa4-f8a1-4bea-ab38-5fab57ada6e0" released by "delete_snapshot" :: held 1.696s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:52:31 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-4623c9bc-0413-4b1d-8def-9c6ed2c296b5 tempest-ProjectReaderTests-462787125 None] Created reservations ['0903821d-3ebd-4f84-8213-05d85f70f8a3', '774bd1f7-e2b1-41ba-a974-cfff54724879', '310dc3c6-b9bc-4742-a91b-a9042bef7d2f', 'f0052192-0edd-4bed-933d-cf3fd14da492'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:52:31 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-4623c9bc-0413-4b1d-8def-9c6ed2c296b5 tempest-ProjectReaderTests-462787125 None] Delete snapshot completed successfully. Sep 18 21:52:31 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-4623c9bc-0413-4b1d-8def-9c6ed2c296b5 tempest-ProjectReaderTests-462787125 None] Lock "cinder-3413b364-549d-4b6c-87f9-c8adea2a5064-delete_snapshot" released by "delete_snapshot" :: held 1.895s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:52:31 devstack sudo[105288]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d1edf3e4-498a-4a42-8c76-a79cdfe8f64b tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7fc89e77-e392-40df-8086-61e5e967e194,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7fc89e77-e392-40df-8086-61e5e967e194.fbcfb88a-b726-44c7-b8d0-6eef7f0d8d4a 1G" returned: 0 in 0.459s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d1edf3e4-498a-4a42-8c76-a79cdfe8f64b tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fc89e77-e392-40df-8086-61e5e967e194 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7fc89e77-e392-40df-8086-61e5e967e194.fbcfb88a-b726-44c7-b8d0-6eef7f0d8d4a {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:31 devstack sudo[105294]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-fb9e41a2-5d1b-4f44-8fb4-96496efeb460 tempest-SnapshotDependencyTests-682659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-6737e632-218e-48b7-aa84-cc4b6a74cfc2" returned: 0 in 0.331s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:31 devstack sudo[105300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fc89e77-e392-40df-8086-61e5e967e194 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7fc89e77-e392-40df-8086-61e5e967e194.fbcfb88a-b726-44c7-b8d0-6eef7f0d8d4a Sep 18 21:52:31 devstack sudo[105300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:31 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-fb9e41a2-5d1b-4f44-8fb4-96496efeb460 tempest-SnapshotDependencyTests-682659 None] Lock "cinder-quobyte-6737e632-218e-48b7-aa84-cc4b6a74cfc2" released by "delete_volume" :: held 0.819s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:52:31 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-fb9e41a2-5d1b-4f44-8fb4-96496efeb460 tempest-SnapshotDependencyTests-682659 None] Created reservations ['9f0b67a8-5712-4e68-be3b-99ed8f45f8f1', 'f3918d04-0d43-4fed-900e-a35c92e47be8', '1d5f5b22-3fe2-43f3-8e6c-2d02d708390a', 'c1e5f690-f2b6-41c2-9ff9-9524c054110a'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:52:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-fb9e41a2-5d1b-4f44-8fb4-96496efeb460 tempest-SnapshotDependencyTests-682659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:52:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-fb9e41a2-5d1b-4f44-8fb4-96496efeb460 tempest-SnapshotDependencyTests-682659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:52:31 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-fb9e41a2-5d1b-4f44-8fb4-96496efeb460 tempest-SnapshotDependencyTests-682659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:52:31 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-fb9e41a2-5d1b-4f44-8fb4-96496efeb460 tempest-SnapshotDependencyTests-682659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:52:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-fb9e41a2-5d1b-4f44-8fb4-96496efeb460 tempest-SnapshotDependencyTests-682659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:52:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-fb9e41a2-5d1b-4f44-8fb4-96496efeb460 tempest-SnapshotDependencyTests-682659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:31 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-6996695b-65dc-4f60-a24c-d18292618002 tempest-ProjectReaderTests-462787125 None] Acquiring lock "cinder-86176fa4-f8a1-4bea-ab38-5fab57ada6e0-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:52:32 devstack sudo[105302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:52:32 devstack sudo[105302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:32 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-6996695b-65dc-4f60-a24c-d18292618002 tempest-ProjectReaderTests-462787125 None] Lock "cinder-86176fa4-f8a1-4bea-ab38-5fab57ada6e0-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:52:32 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-6996695b-65dc-4f60-a24c-d18292618002 tempest-ProjectReaderTests-462787125 None] Acquiring lock "cinder-quobyte-86176fa4-f8a1-4bea-ab38-5fab57ada6e0" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:52:32 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-6996695b-65dc-4f60-a24c-d18292618002 tempest-ProjectReaderTests-462787125 None] Lock "cinder-quobyte-86176fa4-f8a1-4bea-ab38-5fab57ada6e0" acquired by "delete_volume" :: waited 0.026s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:52:32 devstack sudo[105300]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d1edf3e4-498a-4a42-8c76-a79cdfe8f64b tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fc89e77-e392-40df-8086-61e5e967e194 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7fc89e77-e392-40df-8086-61e5e967e194.fbcfb88a-b726-44c7-b8d0-6eef7f0d8d4a" returned: 0 in 0.368s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:32 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-d1edf3e4-498a-4a42-8c76-a79cdfe8f64b tempest-ProjectMemberTests-864505458 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7fc89e77-e392-40df-8086-61e5e967e194.fbcfb88a-b726-44c7-b8d0-6eef7f0d8d4a is being set with open permissions: ugo+rw Sep 18 21:52:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d1edf3e4-498a-4a42-8c76-a79cdfe8f64b tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7fc89e77-e392-40df-8086-61e5e967e194.fbcfb88a-b726-44c7-b8d0-6eef7f0d8d4a {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:32 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f71c4b5-85df-4e49-a998-27c43f23a762]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:52:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6996695b-65dc-4f60-a24c-d18292618002 tempest-ProjectReaderTests-462787125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-86176fa4-f8a1-4bea-ab38-5fab57ada6e0 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:32 devstack sudo[105307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7fc89e77-e392-40df-8086-61e5e967e194.fbcfb88a-b726-44c7-b8d0-6eef7f0d8d4a Sep 18 21:52:32 devstack sudo[105307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:32 devstack sudo[105302]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-fb9e41a2-5d1b-4f44-8fb4-96496efeb460 tempest-SnapshotDependencyTests-682659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.333s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:32 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-fb9e41a2-5d1b-4f44-8fb4-96496efeb460 tempest-SnapshotDependencyTests-682659 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:52:32 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-fb9e41a2-5d1b-4f44-8fb4-96496efeb460 tempest-SnapshotDependencyTests-682659 None] Deleted volume successfully. Sep 18 21:52:32 devstack sudo[105308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-86176fa4-f8a1-4bea-ab38-5fab57ada6e0 Sep 18 21:52:32 devstack sudo[105308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:32 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-fb9e41a2-5d1b-4f44-8fb4-96496efeb460 tempest-SnapshotDependencyTests-682659 None] Lock "cinder-6737e632-218e-48b7-aa84-cc4b6a74cfc2-delete_volume" released by "delete_volume" :: held 1.428s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:52:32 devstack sudo[105307]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d1edf3e4-498a-4a42-8c76-a79cdfe8f64b tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7fc89e77-e392-40df-8086-61e5e967e194.fbcfb88a-b726-44c7-b8d0-6eef7f0d8d4a" returned: 0 in 0.295s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d1edf3e4-498a-4a42-8c76-a79cdfe8f64b tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7fc89e77-e392-40df-8086-61e5e967e194.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:32 devstack sudo[105313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7fc89e77-e392-40df-8086-61e5e967e194.info Sep 18 21:52:32 devstack sudo[105313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:32 devstack sudo[105308]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6996695b-65dc-4f60-a24c-d18292618002 tempest-ProjectReaderTests-462787125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-86176fa4-f8a1-4bea-ab38-5fab57ada6e0" returned: 0 in 0.452s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6996695b-65dc-4f60-a24c-d18292618002 tempest-ProjectReaderTests-462787125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-86176fa4-f8a1-4bea-ab38-5fab57ada6e0 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:32 devstack sudo[105318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-86176fa4-f8a1-4bea-ab38-5fab57ada6e0 Sep 18 21:52:32 devstack sudo[105318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:32 devstack sudo[105313]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d1edf3e4-498a-4a42-8c76-a79cdfe8f64b tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7fc89e77-e392-40df-8086-61e5e967e194.info" returned: 0 in 0.308s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:32 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-d1edf3e4-498a-4a42-8c76-a79cdfe8f64b tempest-ProjectMemberTests-864505458 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7fc89e77-e392-40df-8086-61e5e967e194.info is being set with open permissions: ugo+rw Sep 18 21:52:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d1edf3e4-498a-4a42-8c76-a79cdfe8f64b tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7fc89e77-e392-40df-8086-61e5e967e194.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:32 devstack sudo[105321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7fc89e77-e392-40df-8086-61e5e967e194.info Sep 18 21:52:32 devstack sudo[105321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:32 devstack sudo[105318]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6996695b-65dc-4f60-a24c-d18292618002 tempest-ProjectReaderTests-462787125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-86176fa4-f8a1-4bea-ab38-5fab57ada6e0" returned: 0 in 0.267s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:32 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-6996695b-65dc-4f60-a24c-d18292618002 tempest-ProjectReaderTests-462787125 None] Lock "cinder-quobyte-86176fa4-f8a1-4bea-ab38-5fab57ada6e0" released by "delete_volume" :: held 0.815s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:52:33 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-6996695b-65dc-4f60-a24c-d18292618002 tempest-ProjectReaderTests-462787125 None] Created reservations ['0819e992-2f79-4f11-ad0a-3d8a8848b831', '23fdfde5-3936-443c-a103-3a300053809d', '1f2aa710-257b-4706-a220-8b4e014c0606', 'e6ea83ce-01c8-4c0a-b235-34fd14d20542'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:52:33 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6996695b-65dc-4f60-a24c-d18292618002 tempest-ProjectReaderTests-462787125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:52:33 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6996695b-65dc-4f60-a24c-d18292618002 tempest-ProjectReaderTests-462787125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:52:33 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-6996695b-65dc-4f60-a24c-d18292618002 tempest-ProjectReaderTests-462787125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:52:33 devstack sudo[105321]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:33 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-6996695b-65dc-4f60-a24c-d18292618002 tempest-ProjectReaderTests-462787125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:52:33 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-6996695b-65dc-4f60-a24c-d18292618002 tempest-ProjectReaderTests-462787125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:52:33 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6996695b-65dc-4f60-a24c-d18292618002 tempest-ProjectReaderTests-462787125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:33 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d1edf3e4-498a-4a42-8c76-a79cdfe8f64b tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7fc89e77-e392-40df-8086-61e5e967e194.info" returned: 0 in 0.336s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:33 devstack sudo[105325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:52:33 devstack sudo[105325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:33 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-d1edf3e4-498a-4a42-8c76-a79cdfe8f64b tempest-ProjectMemberTests-864505458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.358s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:52:33 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-d1edf3e4-498a-4a42-8c76-a79cdfe8f64b tempest-ProjectMemberTests-864505458 None] Create snapshot completed successfully Sep 18 21:52:33 devstack sudo[105325]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:33 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-6996695b-65dc-4f60-a24c-d18292618002 tempest-ProjectReaderTests-462787125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.256s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:33 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-6996695b-65dc-4f60-a24c-d18292618002 tempest-ProjectReaderTests-462787125 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:52:33 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-6996695b-65dc-4f60-a24c-d18292618002 tempest-ProjectReaderTests-462787125 None] Deleted volume successfully. Sep 18 21:52:33 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-6996695b-65dc-4f60-a24c-d18292618002 tempest-ProjectReaderTests-462787125 None] Lock "cinder-86176fa4-f8a1-4bea-ab38-5fab57ada6e0-delete_volume" released by "delete_volume" :: held 1.391s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:52:33 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6ff850f-a2b8-49c6-994e-7ed2090b2f78 tempest-ProjectReaderTests-462787125 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:52:33 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b6ff850f-a2b8-49c6-994e-7ed2090b2f78 tempest-ProjectReaderTests-462787125 None] Flow 'volume_create_manager' (42aee1e7-546f-4f7e-972e-1390e587d08f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:52:33 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b6ff850f-a2b8-49c6-994e-7ed2090b2f78 tempest-ProjectReaderTests-462787125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87ed1d79-b912-43fb-9d82-635b49153627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:52:33 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b6ff850f-a2b8-49c6-994e-7ed2090b2f78 tempest-ProjectReaderTests-462787125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87ed1d79-b912-43fb-9d82-635b49153627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:52:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1445693989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=611f63a5-3757-404d-87b0-48a353851450,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dcc87503f13406caa33014a7a149d33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:52:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:52:34Z,use_quota=True,user_id='fd17cfd02234487cb53e780b5c3781e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:52:33 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b6ff850f-a2b8-49c6-994e-7ed2090b2f78 tempest-ProjectReaderTests-462787125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6083e11-c8fd-431e-9233-b79ea0c8f80a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:52:33 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b6ff850f-a2b8-49c6-994e-7ed2090b2f78 tempest-ProjectReaderTests-462787125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6083e11-c8fd-431e-9233-b79ea0c8f80a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:52:33 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b6ff850f-a2b8-49c6-994e-7ed2090b2f78 tempest-ProjectReaderTests-462787125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4514537-47f7-4520-8942-6d45ab86e85c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:52:33 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b6ff850f-a2b8-49c6-994e-7ed2090b2f78 tempest-ProjectReaderTests-462787125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4514537-47f7-4520-8942-6d45ab86e85c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '611f63a5-3757-404d-87b0-48a353851450', 'volume_name': 'volume-611f63a5-3757-404d-87b0-48a353851450', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:52:33 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b6ff850f-a2b8-49c6-994e-7ed2090b2f78 tempest-ProjectReaderTests-462787125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d945131-8039-4a1b-bb51-ea6939e210b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:52:33 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b6ff850f-a2b8-49c6-994e-7ed2090b2f78 tempest-ProjectReaderTests-462787125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d945131-8039-4a1b-bb51-ea6939e210b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:52:33 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b6ff850f-a2b8-49c6-994e-7ed2090b2f78 tempest-ProjectReaderTests-462787125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80ad3bb9-7d20-42e7-950a-2fe77823948a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:52:33 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-b6ff850f-a2b8-49c6-994e-7ed2090b2f78 tempest-ProjectReaderTests-462787125 None] Volume 611f63a5-3757-404d-87b0-48a353851450: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-611f63a5-3757-404d-87b0-48a353851450', 'volume_size': 1} Sep 18 21:52:33 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-b6ff850f-a2b8-49c6-994e-7ed2090b2f78 tempest-ProjectReaderTests-462787125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:52:33 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-b6ff850f-a2b8-49c6-994e-7ed2090b2f78 tempest-ProjectReaderTests-462787125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:52:33 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-b6ff850f-a2b8-49c6-994e-7ed2090b2f78 tempest-ProjectReaderTests-462787125 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:52:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1445693989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=611f63a5-3757-404d-87b0-48a353851450,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dcc87503f13406caa33014a7a149d33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:52:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:52:34Z,use_quota=True,user_id='fd17cfd02234487cb53e780b5c3781e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:52:33 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-b6ff850f-a2b8-49c6-994e-7ed2090b2f78 tempest-ProjectReaderTests-462787125 None] Creating volume 611f63a5-3757-404d-87b0-48a353851450 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:52:33 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-b6ff850f-a2b8-49c6-994e-7ed2090b2f78 tempest-ProjectReaderTests-462787125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:52:33 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-b6ff850f-a2b8-49c6-994e-7ed2090b2f78 tempest-ProjectReaderTests-462787125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:52:33 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-b6ff850f-a2b8-49c6-994e-7ed2090b2f78 tempest-ProjectReaderTests-462787125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:52:33 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-b6ff850f-a2b8-49c6-994e-7ed2090b2f78 tempest-ProjectReaderTests-462787125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:52:33 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-b6ff850f-a2b8-49c6-994e-7ed2090b2f78 tempest-ProjectReaderTests-462787125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:52:33 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-b6ff850f-a2b8-49c6-994e-7ed2090b2f78 tempest-ProjectReaderTests-462787125 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:52:33 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-b6ff850f-a2b8-49c6-994e-7ed2090b2f78 tempest-ProjectReaderTests-462787125 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:52:33 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-b6ff850f-a2b8-49c6-994e-7ed2090b2f78 tempest-ProjectReaderTests-462787125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-611f63a5-3757-404d-87b0-48a353851450 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:33 devstack sudo[105329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-611f63a5-3757-404d-87b0-48a353851450 1073741824 Sep 18 21:52:33 devstack sudo[105329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:33 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-1bdf1376-87d0-4363-a8db-658464d732a8 tempest-ProjectMemberTests-864505458 None] Acquiring lock "cinder-fbcfb88a-b726-44c7-b8d0-6eef7f0d8d4a-delete_snapshot" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:52:33 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-1bdf1376-87d0-4363-a8db-658464d732a8 tempest-ProjectMemberTests-864505458 None] Lock "cinder-fbcfb88a-b726-44c7-b8d0-6eef7f0d8d4a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:52:33 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-1bdf1376-87d0-4363-a8db-658464d732a8 tempest-ProjectMemberTests-864505458 None] Acquiring lock "cinder-quobyte-7fc89e77-e392-40df-8086-61e5e967e194" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:52:33 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-1bdf1376-87d0-4363-a8db-658464d732a8 tempest-ProjectMemberTests-864505458 None] Lock "cinder-quobyte-7fc89e77-e392-40df-8086-61e5e967e194" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:52:33 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-1bdf1376-87d0-4363-a8db-658464d732a8 tempest-ProjectMemberTests-864505458 None] Acquiring lock "cinder-quobyte-fbcfb88a-b726-44c7-b8d0-6eef7f0d8d4a" by "_delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:52:33 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-1bdf1376-87d0-4363-a8db-658464d732a8 tempest-ProjectMemberTests-864505458 None] Lock "cinder-quobyte-fbcfb88a-b726-44c7-b8d0-6eef7f0d8d4a" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:52:34 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-1bdf1376-87d0-4363-a8db-658464d732a8 tempest-ProjectMemberTests-864505458 None] Deleting offline snapshot fbcfb88a-b726-44c7-b8d0-6eef7f0d8d4a of volume 7fc89e77-e392-40df-8086-61e5e967e194 {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 21:52:34 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-1bdf1376-87d0-4363-a8db-658464d732a8 tempest-ProjectMemberTests-864505458 None] snapshot_file for this snap is: volume-7fc89e77-e392-40df-8086-61e5e967e194.fbcfb88a-b726-44c7-b8d0-6eef7f0d8d4a {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 21:52:34 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[e08b5450-3ce5-42f4-aeab-0ebdd34c34d7]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:52:34 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1bdf1376-87d0-4363-a8db-658464d732a8 tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7fc89e77-e392-40df-8086-61e5e967e194.fbcfb88a-b726-44c7-b8d0-6eef7f0d8d4a {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:34 devstack sudo[105334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7fc89e77-e392-40df-8086-61e5e967e194.fbcfb88a-b726-44c7-b8d0-6eef7f0d8d4a Sep 18 21:52:34 devstack sudo[105334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:34 devstack sudo[105329]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:34 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-b6ff850f-a2b8-49c6-994e-7ed2090b2f78 tempest-ProjectReaderTests-462787125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-611f63a5-3757-404d-87b0-48a353851450 1073741824" returned: 0 in 0.475s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:34 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-b6ff850f-a2b8-49c6-994e-7ed2090b2f78 tempest-ProjectReaderTests-462787125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-611f63a5-3757-404d-87b0-48a353851450 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:34 devstack sudo[105337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-611f63a5-3757-404d-87b0-48a353851450 Sep 18 21:52:34 devstack sudo[105337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:34 devstack sudo[105334]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:34 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1bdf1376-87d0-4363-a8db-658464d732a8 tempest-ProjectMemberTests-864505458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7fc89e77-e392-40df-8086-61e5e967e194.fbcfb88a-b726-44c7-b8d0-6eef7f0d8d4a" returned: 0 in 0.399s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:34 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-1bdf1376-87d0-4363-a8db-658464d732a8 tempest-ProjectMemberTests-864505458 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7fc89e77-e392-40df-8086-61e5e967e194(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86136) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 21:52:34 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c25117-d029-4323-90ea-7f92f574d4b5]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:52:34 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1bdf1376-87d0-4363-a8db-658464d732a8 tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7fc89e77-e392-40df-8086-61e5e967e194 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:34 devstack sudo[105337]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:34 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-b6ff850f-a2b8-49c6-994e-7ed2090b2f78 tempest-ProjectReaderTests-462787125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-611f63a5-3757-404d-87b0-48a353851450" returned: 0 in 0.303s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:34 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-b6ff850f-a2b8-49c6-994e-7ed2090b2f78 tempest-ProjectReaderTests-462787125 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:52:34 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-b6ff850f-a2b8-49c6-994e-7ed2090b2f78 tempest-ProjectReaderTests-462787125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:52:34 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b6ff850f-a2b8-49c6-994e-7ed2090b2f78 tempest-ProjectReaderTests-462787125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80ad3bb9-7d20-42e7-950a-2fe77823948a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-611f63a5-3757-404d-87b0-48a353851450', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:52:34 devstack sudo[105345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7fc89e77-e392-40df-8086-61e5e967e194 Sep 18 21:52:34 devstack sudo[105345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:34 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b6ff850f-a2b8-49c6-994e-7ed2090b2f78 tempest-ProjectReaderTests-462787125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9758e05-85ea-425d-91b8-dd1c88f08f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:52:34 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-b6ff850f-a2b8-49c6-994e-7ed2090b2f78 tempest-ProjectReaderTests-462787125 None] Volume volume-611f63a5-3757-404d-87b0-48a353851450 (611f63a5-3757-404d-87b0-48a353851450): created successfully Sep 18 21:52:34 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b6ff850f-a2b8-49c6-994e-7ed2090b2f78 tempest-ProjectReaderTests-462787125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9758e05-85ea-425d-91b8-dd1c88f08f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:52:34 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b6ff850f-a2b8-49c6-994e-7ed2090b2f78 tempest-ProjectReaderTests-462787125 None] Flow 'volume_create_manager' (42aee1e7-546f-4f7e-972e-1390e587d08f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:52:34 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-b6ff850f-a2b8-49c6-994e-7ed2090b2f78 tempest-ProjectReaderTests-462787125 None] Created volume successfully. Sep 18 21:52:34 devstack sudo[105345]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:34 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1bdf1376-87d0-4363-a8db-658464d732a8 tempest-ProjectMemberTests-864505458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7fc89e77-e392-40df-8086-61e5e967e194" returned: 0 in 0.421s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:34 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1bdf1376-87d0-4363-a8db-658464d732a8 tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7fc89e77-e392-40df-8086-61e5e967e194.fbcfb88a-b726-44c7-b8d0-6eef7f0d8d4a {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:34 devstack sudo[105351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7fc89e77-e392-40df-8086-61e5e967e194.fbcfb88a-b726-44c7-b8d0-6eef7f0d8d4a Sep 18 21:52:34 devstack sudo[105351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:35 devstack sudo[105351]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:35 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1bdf1376-87d0-4363-a8db-658464d732a8 tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7fc89e77-e392-40df-8086-61e5e967e194.fbcfb88a-b726-44c7-b8d0-6eef7f0d8d4a" returned: 0 in 0.328s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:35 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1bdf1376-87d0-4363-a8db-658464d732a8 tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7fc89e77-e392-40df-8086-61e5e967e194.fbcfb88a-b726-44c7-b8d0-6eef7f0d8d4a {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:35 devstack sudo[105357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7fc89e77-e392-40df-8086-61e5e967e194.fbcfb88a-b726-44c7-b8d0-6eef7f0d8d4a Sep 18 21:52:35 devstack sudo[105357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:35 devstack sudo[105357]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:35 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1bdf1376-87d0-4363-a8db-658464d732a8 tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7fc89e77-e392-40df-8086-61e5e967e194.fbcfb88a-b726-44c7-b8d0-6eef7f0d8d4a" returned: 0 in 0.240s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:35 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-1bdf1376-87d0-4363-a8db-658464d732a8 tempest-ProjectMemberTests-864505458 None] Lock "cinder-quobyte-fbcfb88a-b726-44c7-b8d0-6eef7f0d8d4a" released by "_delete_snapshot" :: held 1.508s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:52:35 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-1bdf1376-87d0-4363-a8db-658464d732a8 tempest-ProjectMemberTests-864505458 None] Lock "cinder-quobyte-7fc89e77-e392-40df-8086-61e5e967e194" released by "delete_snapshot" :: held 1.536s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:52:35 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-1bdf1376-87d0-4363-a8db-658464d732a8 tempest-ProjectMemberTests-864505458 None] Created reservations ['89d599a7-9555-4ea1-a60f-84c0299b7ce8', 'ef93730e-0fd7-48cc-84ba-23bb52642bce', 'de8b2cc8-1a52-43b9-9149-d9049d543f2f', '2cbc8197-1b7e-43b8-82ac-b9cc1f4e5077'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:52:35 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-1bdf1376-87d0-4363-a8db-658464d732a8 tempest-ProjectMemberTests-864505458 None] Delete snapshot completed successfully. Sep 18 21:52:35 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-1bdf1376-87d0-4363-a8db-658464d732a8 tempest-ProjectMemberTests-864505458 None] Lock "cinder-fbcfb88a-b726-44c7-b8d0-6eef7f0d8d4a-delete_snapshot" released by "delete_snapshot" :: held 1.691s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:52:35 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-48b2b2e3-aca0-40a6-afaf-e321303464c1 tempest-ProjectReaderTests-462787125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:52:35 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-48b2b2e3-aca0-40a6-afaf-e321303464c1 tempest-ProjectReaderTests-462787125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:52:35 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-48b2b2e3-aca0-40a6-afaf-e321303464c1 tempest-ProjectReaderTests-462787125 None] Creating offline snapshot 7cb881e5-5ff7-4cef-91f0-b7d717690426 of volume 611f63a5-3757-404d-87b0-48a353851450 {{(pid=86136) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 21:52:35 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c8865f-cc93-4957-9025-ae40b2ce25ec]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:52:35 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-48b2b2e3-aca0-40a6-afaf-e321303464c1 tempest-ProjectReaderTests-462787125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-611f63a5-3757-404d-87b0-48a353851450 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:36 devstack sudo[105360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-611f63a5-3757-404d-87b0-48a353851450 Sep 18 21:52:36 devstack sudo[105360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:36 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-5f1d21fb-218c-4167-9d0a-acbb4d48ecd0 tempest-ProjectMemberTests-864505458 None] Acquiring lock "cinder-7fc89e77-e392-40df-8086-61e5e967e194-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:52:36 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-5f1d21fb-218c-4167-9d0a-acbb4d48ecd0 tempest-ProjectMemberTests-864505458 None] Lock "cinder-7fc89e77-e392-40df-8086-61e5e967e194-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:52:36 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-5f1d21fb-218c-4167-9d0a-acbb4d48ecd0 tempest-ProjectMemberTests-864505458 None] Acquiring lock "cinder-quobyte-7fc89e77-e392-40df-8086-61e5e967e194" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:52:36 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-5f1d21fb-218c-4167-9d0a-acbb4d48ecd0 tempest-ProjectMemberTests-864505458 None] Lock "cinder-quobyte-7fc89e77-e392-40df-8086-61e5e967e194" acquired by "delete_volume" :: waited 0.020s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:52:36 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c4f1e8b-8cae-44ae-b58d-ec78df1488d8]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:52:36 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5f1d21fb-218c-4167-9d0a-acbb4d48ecd0 tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7fc89e77-e392-40df-8086-61e5e967e194 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:36 devstack sudo[105360]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:36 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-48b2b2e3-aca0-40a6-afaf-e321303464c1 tempest-ProjectReaderTests-462787125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-611f63a5-3757-404d-87b0-48a353851450" returned: 0 in 0.421s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:36 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-48b2b2e3-aca0-40a6-afaf-e321303464c1 tempest-ProjectReaderTests-462787125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-611f63a5-3757-404d-87b0-48a353851450,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-611f63a5-3757-404d-87b0-48a353851450.7cb881e5-5ff7-4cef-91f0-b7d717690426 1G {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:36 devstack sudo[105363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7fc89e77-e392-40df-8086-61e5e967e194 Sep 18 21:52:36 devstack sudo[105363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:36 devstack sudo[105366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-611f63a5-3757-404d-87b0-48a353851450,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-611f63a5-3757-404d-87b0-48a353851450.7cb881e5-5ff7-4cef-91f0-b7d717690426 1G Sep 18 21:52:36 devstack sudo[105366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:36 devstack sudo[105363]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:36 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5f1d21fb-218c-4167-9d0a-acbb4d48ecd0 tempest-ProjectMemberTests-864505458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7fc89e77-e392-40df-8086-61e5e967e194" returned: 0 in 0.464s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:36 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5f1d21fb-218c-4167-9d0a-acbb4d48ecd0 tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7fc89e77-e392-40df-8086-61e5e967e194 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:36 devstack sudo[105377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7fc89e77-e392-40df-8086-61e5e967e194 Sep 18 21:52:36 devstack sudo[105377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:36 devstack sudo[105366]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:36 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-48b2b2e3-aca0-40a6-afaf-e321303464c1 tempest-ProjectReaderTests-462787125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-611f63a5-3757-404d-87b0-48a353851450,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-611f63a5-3757-404d-87b0-48a353851450.7cb881e5-5ff7-4cef-91f0-b7d717690426 1G" returned: 0 in 0.573s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:36 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-48b2b2e3-aca0-40a6-afaf-e321303464c1 tempest-ProjectReaderTests-462787125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-611f63a5-3757-404d-87b0-48a353851450 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-611f63a5-3757-404d-87b0-48a353851450.7cb881e5-5ff7-4cef-91f0-b7d717690426 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:37 devstack sudo[105379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-611f63a5-3757-404d-87b0-48a353851450 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-611f63a5-3757-404d-87b0-48a353851450.7cb881e5-5ff7-4cef-91f0-b7d717690426 Sep 18 21:52:37 devstack sudo[105379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:37 devstack sudo[105377]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:37 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5f1d21fb-218c-4167-9d0a-acbb4d48ecd0 tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7fc89e77-e392-40df-8086-61e5e967e194" returned: 0 in 0.295s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:37 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-5f1d21fb-218c-4167-9d0a-acbb4d48ecd0 tempest-ProjectMemberTests-864505458 None] Lock "cinder-quobyte-7fc89e77-e392-40df-8086-61e5e967e194" released by "delete_volume" :: held 0.830s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:52:37 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-5f1d21fb-218c-4167-9d0a-acbb4d48ecd0 tempest-ProjectMemberTests-864505458 None] Created reservations ['61eccd33-358b-4031-a517-582c368bcd7e', '104fa23f-0625-47df-859c-b727c72adb5e', 'db388b20-bcf4-4cd8-ab33-809e5b9e615f', 'e2884f8c-6aeb-44f4-babd-5e768b7d58dc'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:52:37 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-5f1d21fb-218c-4167-9d0a-acbb4d48ecd0 tempest-ProjectMemberTests-864505458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:52:37 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-5f1d21fb-218c-4167-9d0a-acbb4d48ecd0 tempest-ProjectMemberTests-864505458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:52:37 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-5f1d21fb-218c-4167-9d0a-acbb4d48ecd0 tempest-ProjectMemberTests-864505458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:52:37 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-5f1d21fb-218c-4167-9d0a-acbb4d48ecd0 tempest-ProjectMemberTests-864505458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:52:37 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-5f1d21fb-218c-4167-9d0a-acbb4d48ecd0 tempest-ProjectMemberTests-864505458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:52:37 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5f1d21fb-218c-4167-9d0a-acbb4d48ecd0 tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:37 devstack sudo[105384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:52:37 devstack sudo[105384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:37 devstack sudo[105379]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:37 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-48b2b2e3-aca0-40a6-afaf-e321303464c1 tempest-ProjectReaderTests-462787125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-611f63a5-3757-404d-87b0-48a353851450 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-611f63a5-3757-404d-87b0-48a353851450.7cb881e5-5ff7-4cef-91f0-b7d717690426" returned: 0 in 0.352s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:37 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-48b2b2e3-aca0-40a6-afaf-e321303464c1 tempest-ProjectReaderTests-462787125 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-611f63a5-3757-404d-87b0-48a353851450.7cb881e5-5ff7-4cef-91f0-b7d717690426 is being set with open permissions: ugo+rw Sep 18 21:52:37 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-48b2b2e3-aca0-40a6-afaf-e321303464c1 tempest-ProjectReaderTests-462787125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-611f63a5-3757-404d-87b0-48a353851450.7cb881e5-5ff7-4cef-91f0-b7d717690426 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:37 devstack sudo[105387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-611f63a5-3757-404d-87b0-48a353851450.7cb881e5-5ff7-4cef-91f0-b7d717690426 Sep 18 21:52:37 devstack sudo[105387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:37 devstack sudo[105384]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:37 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5f1d21fb-218c-4167-9d0a-acbb4d48ecd0 tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.301s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:37 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-5f1d21fb-218c-4167-9d0a-acbb4d48ecd0 tempest-ProjectMemberTests-864505458 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:52:37 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-5f1d21fb-218c-4167-9d0a-acbb4d48ecd0 tempest-ProjectMemberTests-864505458 None] Deleted volume successfully. Sep 18 21:52:37 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-5f1d21fb-218c-4167-9d0a-acbb4d48ecd0 tempest-ProjectMemberTests-864505458 None] Lock "cinder-7fc89e77-e392-40df-8086-61e5e967e194-delete_volume" released by "delete_volume" :: held 1.377s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:52:37 devstack sudo[105387]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:37 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-48b2b2e3-aca0-40a6-afaf-e321303464c1 tempest-ProjectReaderTests-462787125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-611f63a5-3757-404d-87b0-48a353851450.7cb881e5-5ff7-4cef-91f0-b7d717690426" returned: 0 in 0.300s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:37 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-48b2b2e3-aca0-40a6-afaf-e321303464c1 tempest-ProjectReaderTests-462787125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-611f63a5-3757-404d-87b0-48a353851450.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:37 devstack sudo[105391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-611f63a5-3757-404d-87b0-48a353851450.info Sep 18 21:52:37 devstack sudo[105391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:37 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d2bb2e7-4c73-47c4-bc97-0ef2f2e7b8e8 tempest-ProjectMemberTests-864505458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:52:37 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9d2bb2e7-4c73-47c4-bc97-0ef2f2e7b8e8 tempest-ProjectMemberTests-864505458 None] Flow 'volume_create_manager' (a8ea4f7f-cb80-4c9c-a34d-54b8e6c29f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:52:38 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9d2bb2e7-4c73-47c4-bc97-0ef2f2e7b8e8 tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a254a7a-6a4d-4bb2-adac-c9e8dc7002c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:52:38 devstack sudo[105391]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:38 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-48b2b2e3-aca0-40a6-afaf-e321303464c1 tempest-ProjectReaderTests-462787125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-611f63a5-3757-404d-87b0-48a353851450.info" returned: 0 in 0.318s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:38 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-48b2b2e3-aca0-40a6-afaf-e321303464c1 tempest-ProjectReaderTests-462787125 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-611f63a5-3757-404d-87b0-48a353851450.info is being set with open permissions: ugo+rw Sep 18 21:52:38 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-48b2b2e3-aca0-40a6-afaf-e321303464c1 tempest-ProjectReaderTests-462787125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-611f63a5-3757-404d-87b0-48a353851450.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:38 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9d2bb2e7-4c73-47c4-bc97-0ef2f2e7b8e8 tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a254a7a-6a4d-4bb2-adac-c9e8dc7002c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:52:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-347044567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c73a09a2-ee2f-4e94-8698-a702b1f5566c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44aed77f70a242029bc978ba9aa69a78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:52:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:52:38Z,use_quota=True,user_id='fbe2b10fb8584161a20a4564db383b3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:52:38 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9d2bb2e7-4c73-47c4-bc97-0ef2f2e7b8e8 tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c67a98ba-0366-4a9d-9ee8-e9eb1ce80969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:52:38 devstack sudo[105394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-611f63a5-3757-404d-87b0-48a353851450.info Sep 18 21:52:38 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9d2bb2e7-4c73-47c4-bc97-0ef2f2e7b8e8 tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c67a98ba-0366-4a9d-9ee8-e9eb1ce80969) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:52:38 devstack sudo[105394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:38 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9d2bb2e7-4c73-47c4-bc97-0ef2f2e7b8e8 tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06c72dc4-1bc1-4857-b9ce-b088131f034e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:52:38 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9d2bb2e7-4c73-47c4-bc97-0ef2f2e7b8e8 tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06c72dc4-1bc1-4857-b9ce-b088131f034e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c73a09a2-ee2f-4e94-8698-a702b1f5566c', 'volume_name': 'volume-c73a09a2-ee2f-4e94-8698-a702b1f5566c', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:52:38 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9d2bb2e7-4c73-47c4-bc97-0ef2f2e7b8e8 tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62571680-308c-481f-85ca-539ff59429b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:52:38 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9d2bb2e7-4c73-47c4-bc97-0ef2f2e7b8e8 tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62571680-308c-481f-85ca-539ff59429b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:52:38 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9d2bb2e7-4c73-47c4-bc97-0ef2f2e7b8e8 tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (120e9d5e-5349-45f2-af1b-ebf864fd9530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:52:38 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-9d2bb2e7-4c73-47c4-bc97-0ef2f2e7b8e8 tempest-ProjectMemberTests-864505458 None] Volume c73a09a2-ee2f-4e94-8698-a702b1f5566c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c73a09a2-ee2f-4e94-8698-a702b1f5566c', 'volume_size': 1} Sep 18 21:52:38 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-9d2bb2e7-4c73-47c4-bc97-0ef2f2e7b8e8 tempest-ProjectMemberTests-864505458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:52:38 devstack sudo[105394]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:38 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-48b2b2e3-aca0-40a6-afaf-e321303464c1 tempest-ProjectReaderTests-462787125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-611f63a5-3757-404d-87b0-48a353851450.info" returned: 0 in 0.255s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:38 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-48b2b2e3-aca0-40a6-afaf-e321303464c1 tempest-ProjectReaderTests-462787125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.342s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:52:38 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-9d2bb2e7-4c73-47c4-bc97-0ef2f2e7b8e8 tempest-ProjectMemberTests-864505458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.226s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:52:38 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-9d2bb2e7-4c73-47c4-bc97-0ef2f2e7b8e8 tempest-ProjectMemberTests-864505458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:52:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-347044567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c73a09a2-ee2f-4e94-8698-a702b1f5566c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44aed77f70a242029bc978ba9aa69a78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:52:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:52:38Z,use_quota=True,user_id='fbe2b10fb8584161a20a4564db383b3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:52:38 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-9d2bb2e7-4c73-47c4-bc97-0ef2f2e7b8e8 tempest-ProjectMemberTests-864505458 None] Creating volume c73a09a2-ee2f-4e94-8698-a702b1f5566c {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:52:38 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-9d2bb2e7-4c73-47c4-bc97-0ef2f2e7b8e8 tempest-ProjectMemberTests-864505458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:52:38 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-9d2bb2e7-4c73-47c4-bc97-0ef2f2e7b8e8 tempest-ProjectMemberTests-864505458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:52:38 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-9d2bb2e7-4c73-47c4-bc97-0ef2f2e7b8e8 tempest-ProjectMemberTests-864505458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:52:38 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-9d2bb2e7-4c73-47c4-bc97-0ef2f2e7b8e8 tempest-ProjectMemberTests-864505458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:52:38 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-9d2bb2e7-4c73-47c4-bc97-0ef2f2e7b8e8 tempest-ProjectMemberTests-864505458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:52:38 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-9d2bb2e7-4c73-47c4-bc97-0ef2f2e7b8e8 tempest-ProjectMemberTests-864505458 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:52:38 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-9d2bb2e7-4c73-47c4-bc97-0ef2f2e7b8e8 tempest-ProjectMemberTests-864505458 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:52:38 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9d2bb2e7-4c73-47c4-bc97-0ef2f2e7b8e8 tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c73a09a2-ee2f-4e94-8698-a702b1f5566c 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:38 devstack sudo[105397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c73a09a2-ee2f-4e94-8698-a702b1f5566c 1073741824 Sep 18 21:52:38 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-48b2b2e3-aca0-40a6-afaf-e321303464c1 tempest-ProjectReaderTests-462787125 None] Create snapshot completed successfully Sep 18 21:52:38 devstack sudo[105397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:38 devstack sudo[105397]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:38 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9d2bb2e7-4c73-47c4-bc97-0ef2f2e7b8e8 tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c73a09a2-ee2f-4e94-8698-a702b1f5566c 1073741824" returned: 0 in 0.437s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:38 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9d2bb2e7-4c73-47c4-bc97-0ef2f2e7b8e8 tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c73a09a2-ee2f-4e94-8698-a702b1f5566c {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:38 devstack sudo[105404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c73a09a2-ee2f-4e94-8698-a702b1f5566c Sep 18 21:52:38 devstack sudo[105404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:39 devstack sudo[105404]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:39 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-9d2bb2e7-4c73-47c4-bc97-0ef2f2e7b8e8 tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c73a09a2-ee2f-4e94-8698-a702b1f5566c" returned: 0 in 0.261s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:39 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-9d2bb2e7-4c73-47c4-bc97-0ef2f2e7b8e8 tempest-ProjectMemberTests-864505458 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:52:39 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-9d2bb2e7-4c73-47c4-bc97-0ef2f2e7b8e8 tempest-ProjectMemberTests-864505458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:52:39 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9d2bb2e7-4c73-47c4-bc97-0ef2f2e7b8e8 tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (120e9d5e-5349-45f2-af1b-ebf864fd9530) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c73a09a2-ee2f-4e94-8698-a702b1f5566c', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:52:39 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9d2bb2e7-4c73-47c4-bc97-0ef2f2e7b8e8 tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9a06b4c-cd07-4f27-84da-c75f7db3b385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:52:39 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-9d2bb2e7-4c73-47c4-bc97-0ef2f2e7b8e8 tempest-ProjectMemberTests-864505458 None] Volume volume-c73a09a2-ee2f-4e94-8698-a702b1f5566c (c73a09a2-ee2f-4e94-8698-a702b1f5566c): created successfully Sep 18 21:52:39 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9d2bb2e7-4c73-47c4-bc97-0ef2f2e7b8e8 tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9a06b4c-cd07-4f27-84da-c75f7db3b385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:52:39 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-9d2bb2e7-4c73-47c4-bc97-0ef2f2e7b8e8 tempest-ProjectMemberTests-864505458 None] Flow 'volume_create_manager' (a8ea4f7f-cb80-4c9c-a34d-54b8e6c29f4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:52:39 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-c68e7196-a2b8-498f-95ca-3a3c7e56e350 tempest-ProjectReaderTests-462787125 None] Acquiring lock "cinder-7cb881e5-5ff7-4cef-91f0-b7d717690426-delete_snapshot" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:52:39 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-9d2bb2e7-4c73-47c4-bc97-0ef2f2e7b8e8 tempest-ProjectMemberTests-864505458 None] Created volume successfully. Sep 18 21:52:39 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-c68e7196-a2b8-498f-95ca-3a3c7e56e350 tempest-ProjectReaderTests-462787125 None] Lock "cinder-7cb881e5-5ff7-4cef-91f0-b7d717690426-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:52:39 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-c68e7196-a2b8-498f-95ca-3a3c7e56e350 tempest-ProjectReaderTests-462787125 None] Acquiring lock "cinder-quobyte-611f63a5-3757-404d-87b0-48a353851450" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:52:39 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-c68e7196-a2b8-498f-95ca-3a3c7e56e350 tempest-ProjectReaderTests-462787125 None] Lock "cinder-quobyte-611f63a5-3757-404d-87b0-48a353851450" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:52:39 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-c68e7196-a2b8-498f-95ca-3a3c7e56e350 tempest-ProjectReaderTests-462787125 None] Acquiring lock "cinder-quobyte-7cb881e5-5ff7-4cef-91f0-b7d717690426" by "_delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:52:39 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-c68e7196-a2b8-498f-95ca-3a3c7e56e350 tempest-ProjectReaderTests-462787125 None] Lock "cinder-quobyte-7cb881e5-5ff7-4cef-91f0-b7d717690426" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:52:39 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-c68e7196-a2b8-498f-95ca-3a3c7e56e350 tempest-ProjectReaderTests-462787125 None] Deleting offline snapshot 7cb881e5-5ff7-4cef-91f0-b7d717690426 of volume 611f63a5-3757-404d-87b0-48a353851450 {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 21:52:39 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-c68e7196-a2b8-498f-95ca-3a3c7e56e350 tempest-ProjectReaderTests-462787125 None] snapshot_file for this snap is: volume-611f63a5-3757-404d-87b0-48a353851450.7cb881e5-5ff7-4cef-91f0-b7d717690426 {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 21:52:39 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e1586d-b944-4ed8-923f-be7d4ce358f7]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:52:39 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c68e7196-a2b8-498f-95ca-3a3c7e56e350 tempest-ProjectReaderTests-462787125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-611f63a5-3757-404d-87b0-48a353851450.7cb881e5-5ff7-4cef-91f0-b7d717690426 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:39 devstack sudo[105407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-611f63a5-3757-404d-87b0-48a353851450.7cb881e5-5ff7-4cef-91f0-b7d717690426 Sep 18 21:52:39 devstack sudo[105407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:39 devstack sudo[105407]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:39 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c68e7196-a2b8-498f-95ca-3a3c7e56e350 tempest-ProjectReaderTests-462787125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-611f63a5-3757-404d-87b0-48a353851450.7cb881e5-5ff7-4cef-91f0-b7d717690426" returned: 0 in 0.397s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:39 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-c68e7196-a2b8-498f-95ca-3a3c7e56e350 tempest-ProjectReaderTests-462787125 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-611f63a5-3757-404d-87b0-48a353851450(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86136) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 21:52:39 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[97532905-bd8e-41c0-93f9-76f2a92c9f16]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:52:39 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c68e7196-a2b8-498f-95ca-3a3c7e56e350 tempest-ProjectReaderTests-462787125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-611f63a5-3757-404d-87b0-48a353851450 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:39 devstack sudo[105412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-611f63a5-3757-404d-87b0-48a353851450 Sep 18 21:52:39 devstack sudo[105412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:40 devstack sudo[105412]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:40 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c68e7196-a2b8-498f-95ca-3a3c7e56e350 tempest-ProjectReaderTests-462787125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-611f63a5-3757-404d-87b0-48a353851450" returned: 0 in 0.360s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:40 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c68e7196-a2b8-498f-95ca-3a3c7e56e350 tempest-ProjectReaderTests-462787125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-611f63a5-3757-404d-87b0-48a353851450.7cb881e5-5ff7-4cef-91f0-b7d717690426 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:40 devstack sudo[105417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-611f63a5-3757-404d-87b0-48a353851450.7cb881e5-5ff7-4cef-91f0-b7d717690426 Sep 18 21:52:40 devstack sudo[105417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:40 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c0bb16b4-6904-4cd3-8392-8f7ed3e0f8cd tempest-ProjectMemberTests-864505458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:52:40 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c0bb16b4-6904-4cd3-8392-8f7ed3e0f8cd tempest-ProjectMemberTests-864505458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:52:40 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-c0bb16b4-6904-4cd3-8392-8f7ed3e0f8cd tempest-ProjectMemberTests-864505458 None] Creating offline snapshot ab17f84f-88aa-427d-a28b-22668db38f04 of volume c73a09a2-ee2f-4e94-8698-a702b1f5566c {{(pid=86136) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 21:52:40 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[1595eeb7-cbfa-4fdb-a956-26f90069692a]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:52:40 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c0bb16b4-6904-4cd3-8392-8f7ed3e0f8cd tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c73a09a2-ee2f-4e94-8698-a702b1f5566c {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:40 devstack sudo[105419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c73a09a2-ee2f-4e94-8698-a702b1f5566c Sep 18 21:52:40 devstack sudo[105419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:40 devstack sudo[105417]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:40 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c68e7196-a2b8-498f-95ca-3a3c7e56e350 tempest-ProjectReaderTests-462787125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-611f63a5-3757-404d-87b0-48a353851450.7cb881e5-5ff7-4cef-91f0-b7d717690426" returned: 0 in 0.390s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:40 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c68e7196-a2b8-498f-95ca-3a3c7e56e350 tempest-ProjectReaderTests-462787125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-611f63a5-3757-404d-87b0-48a353851450.7cb881e5-5ff7-4cef-91f0-b7d717690426 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:40 devstack sudo[105424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-611f63a5-3757-404d-87b0-48a353851450.7cb881e5-5ff7-4cef-91f0-b7d717690426 Sep 18 21:52:40 devstack sudo[105424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:40 devstack sudo[105419]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:40 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c0bb16b4-6904-4cd3-8392-8f7ed3e0f8cd tempest-ProjectMemberTests-864505458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c73a09a2-ee2f-4e94-8698-a702b1f5566c" returned: 0 in 0.453s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:40 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c0bb16b4-6904-4cd3-8392-8f7ed3e0f8cd tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c73a09a2-ee2f-4e94-8698-a702b1f5566c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c73a09a2-ee2f-4e94-8698-a702b1f5566c.ab17f84f-88aa-427d-a28b-22668db38f04 1G {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:40 devstack sudo[105430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c73a09a2-ee2f-4e94-8698-a702b1f5566c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c73a09a2-ee2f-4e94-8698-a702b1f5566c.ab17f84f-88aa-427d-a28b-22668db38f04 1G Sep 18 21:52:40 devstack sudo[105430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:40 devstack sudo[105424]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:40 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c68e7196-a2b8-498f-95ca-3a3c7e56e350 tempest-ProjectReaderTests-462787125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-611f63a5-3757-404d-87b0-48a353851450.7cb881e5-5ff7-4cef-91f0-b7d717690426" returned: 0 in 0.333s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:40 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-c68e7196-a2b8-498f-95ca-3a3c7e56e350 tempest-ProjectReaderTests-462787125 None] Lock "cinder-quobyte-7cb881e5-5ff7-4cef-91f0-b7d717690426" released by "_delete_snapshot" :: held 1.600s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:52:40 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-c68e7196-a2b8-498f-95ca-3a3c7e56e350 tempest-ProjectReaderTests-462787125 None] Lock "cinder-quobyte-611f63a5-3757-404d-87b0-48a353851450" released by "delete_snapshot" :: held 1.627s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:52:40 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-c68e7196-a2b8-498f-95ca-3a3c7e56e350 tempest-ProjectReaderTests-462787125 None] Created reservations ['100df51e-a90a-4274-97e7-6603e7f88f8c', '195824a1-72af-4119-bb71-6db188b3eb33', 'aba01dab-866b-47a3-97ac-e57e42786d68', '1615ca57-be62-4c0f-9eb9-485cd00a1788'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:52:40 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-c68e7196-a2b8-498f-95ca-3a3c7e56e350 tempest-ProjectReaderTests-462787125 None] Delete snapshot completed successfully. Sep 18 21:52:40 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-c68e7196-a2b8-498f-95ca-3a3c7e56e350 tempest-ProjectReaderTests-462787125 None] Lock "cinder-7cb881e5-5ff7-4cef-91f0-b7d717690426-delete_snapshot" released by "delete_snapshot" :: held 1.806s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:52:41 devstack sudo[105430]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:41 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c0bb16b4-6904-4cd3-8392-8f7ed3e0f8cd tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c73a09a2-ee2f-4e94-8698-a702b1f5566c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c73a09a2-ee2f-4e94-8698-a702b1f5566c.ab17f84f-88aa-427d-a28b-22668db38f04 1G" returned: 0 in 0.489s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:41 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c0bb16b4-6904-4cd3-8392-8f7ed3e0f8cd tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c73a09a2-ee2f-4e94-8698-a702b1f5566c -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c73a09a2-ee2f-4e94-8698-a702b1f5566c.ab17f84f-88aa-427d-a28b-22668db38f04 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:41 devstack sudo[105436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c73a09a2-ee2f-4e94-8698-a702b1f5566c -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c73a09a2-ee2f-4e94-8698-a702b1f5566c.ab17f84f-88aa-427d-a28b-22668db38f04 Sep 18 21:52:41 devstack sudo[105436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:41 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-522161f4-066d-4a23-99ea-72b89c166a0c tempest-ProjectReaderTests-462787125 None] Acquiring lock "cinder-611f63a5-3757-404d-87b0-48a353851450-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:52:41 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-522161f4-066d-4a23-99ea-72b89c166a0c tempest-ProjectReaderTests-462787125 None] Lock "cinder-611f63a5-3757-404d-87b0-48a353851450-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:52:41 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-522161f4-066d-4a23-99ea-72b89c166a0c tempest-ProjectReaderTests-462787125 None] Acquiring lock "cinder-quobyte-611f63a5-3757-404d-87b0-48a353851450" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:52:41 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-522161f4-066d-4a23-99ea-72b89c166a0c tempest-ProjectReaderTests-462787125 None] Lock "cinder-quobyte-611f63a5-3757-404d-87b0-48a353851450" acquired by "delete_volume" :: waited 0.022s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:52:41 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[d06f4cb6-ce97-4212-89a3-aec2a9814be9]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:52:41 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-522161f4-066d-4a23-99ea-72b89c166a0c tempest-ProjectReaderTests-462787125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-611f63a5-3757-404d-87b0-48a353851450 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:41 devstack sudo[105436]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:41 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c0bb16b4-6904-4cd3-8392-8f7ed3e0f8cd tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c73a09a2-ee2f-4e94-8698-a702b1f5566c -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c73a09a2-ee2f-4e94-8698-a702b1f5566c.ab17f84f-88aa-427d-a28b-22668db38f04" returned: 0 in 0.383s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:41 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-c0bb16b4-6904-4cd3-8392-8f7ed3e0f8cd tempest-ProjectMemberTests-864505458 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c73a09a2-ee2f-4e94-8698-a702b1f5566c.ab17f84f-88aa-427d-a28b-22668db38f04 is being set with open permissions: ugo+rw Sep 18 21:52:41 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c0bb16b4-6904-4cd3-8392-8f7ed3e0f8cd tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c73a09a2-ee2f-4e94-8698-a702b1f5566c.ab17f84f-88aa-427d-a28b-22668db38f04 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:41 devstack sudo[105443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c73a09a2-ee2f-4e94-8698-a702b1f5566c.ab17f84f-88aa-427d-a28b-22668db38f04 Sep 18 21:52:41 devstack sudo[105443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:41 devstack sudo[105442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-611f63a5-3757-404d-87b0-48a353851450 Sep 18 21:52:41 devstack sudo[105442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:41 devstack sudo[105443]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:41 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c0bb16b4-6904-4cd3-8392-8f7ed3e0f8cd tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c73a09a2-ee2f-4e94-8698-a702b1f5566c.ab17f84f-88aa-427d-a28b-22668db38f04" returned: 0 in 0.276s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:41 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c0bb16b4-6904-4cd3-8392-8f7ed3e0f8cd tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c73a09a2-ee2f-4e94-8698-a702b1f5566c.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:41 devstack sudo[105449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c73a09a2-ee2f-4e94-8698-a702b1f5566c.info Sep 18 21:52:41 devstack sudo[105449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:41 devstack sudo[105442]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:41 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-522161f4-066d-4a23-99ea-72b89c166a0c tempest-ProjectReaderTests-462787125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-611f63a5-3757-404d-87b0-48a353851450" returned: 0 in 0.399s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:41 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-522161f4-066d-4a23-99ea-72b89c166a0c tempest-ProjectReaderTests-462787125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-611f63a5-3757-404d-87b0-48a353851450 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:41 devstack sudo[105452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-611f63a5-3757-404d-87b0-48a353851450 Sep 18 21:52:41 devstack sudo[105452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:42 devstack sudo[105449]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:42 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c0bb16b4-6904-4cd3-8392-8f7ed3e0f8cd tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c73a09a2-ee2f-4e94-8698-a702b1f5566c.info" returned: 0 in 0.269s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:42 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-c0bb16b4-6904-4cd3-8392-8f7ed3e0f8cd tempest-ProjectMemberTests-864505458 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c73a09a2-ee2f-4e94-8698-a702b1f5566c.info is being set with open permissions: ugo+rw Sep 18 21:52:42 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c0bb16b4-6904-4cd3-8392-8f7ed3e0f8cd tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c73a09a2-ee2f-4e94-8698-a702b1f5566c.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:42 devstack sudo[105455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c73a09a2-ee2f-4e94-8698-a702b1f5566c.info Sep 18 21:52:42 devstack sudo[105455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:42 devstack sudo[105452]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:42 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-522161f4-066d-4a23-99ea-72b89c166a0c tempest-ProjectReaderTests-462787125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-611f63a5-3757-404d-87b0-48a353851450" returned: 0 in 0.305s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:42 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-522161f4-066d-4a23-99ea-72b89c166a0c tempest-ProjectReaderTests-462787125 None] Lock "cinder-quobyte-611f63a5-3757-404d-87b0-48a353851450" released by "delete_volume" :: held 0.789s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:52:42 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-522161f4-066d-4a23-99ea-72b89c166a0c tempest-ProjectReaderTests-462787125 None] Created reservations ['c3e5a274-eb97-4c0b-b5ea-8a5623f4c7d0', '81b2f977-03d7-4882-be0b-df5d8e6ba9e3', 'bda97280-0dc8-4d26-bc0c-ca98fa5717bb', '9c8b9160-b18d-43e9-a8ee-acef3591ed5d'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:52:42 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-522161f4-066d-4a23-99ea-72b89c166a0c tempest-ProjectReaderTests-462787125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:52:42 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-522161f4-066d-4a23-99ea-72b89c166a0c tempest-ProjectReaderTests-462787125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:52:42 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-522161f4-066d-4a23-99ea-72b89c166a0c tempest-ProjectReaderTests-462787125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:52:42 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-522161f4-066d-4a23-99ea-72b89c166a0c tempest-ProjectReaderTests-462787125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:52:42 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-522161f4-066d-4a23-99ea-72b89c166a0c tempest-ProjectReaderTests-462787125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:52:42 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-522161f4-066d-4a23-99ea-72b89c166a0c tempest-ProjectReaderTests-462787125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:42 devstack sudo[105455]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:42 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c0bb16b4-6904-4cd3-8392-8f7ed3e0f8cd tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c73a09a2-ee2f-4e94-8698-a702b1f5566c.info" returned: 0 in 0.313s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:42 devstack sudo[105459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:52:42 devstack sudo[105459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:42 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c0bb16b4-6904-4cd3-8392-8f7ed3e0f8cd tempest-ProjectMemberTests-864505458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.303s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:52:42 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-c0bb16b4-6904-4cd3-8392-8f7ed3e0f8cd tempest-ProjectMemberTests-864505458 None] Create snapshot completed successfully Sep 18 21:52:42 devstack sudo[105459]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:42 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-522161f4-066d-4a23-99ea-72b89c166a0c tempest-ProjectReaderTests-462787125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.265s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:42 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-522161f4-066d-4a23-99ea-72b89c166a0c tempest-ProjectReaderTests-462787125 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:52:42 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-522161f4-066d-4a23-99ea-72b89c166a0c tempest-ProjectReaderTests-462787125 None] Deleted volume successfully. Sep 18 21:52:42 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-522161f4-066d-4a23-99ea-72b89c166a0c tempest-ProjectReaderTests-462787125 None] Lock "cinder-611f63a5-3757-404d-87b0-48a353851450-delete_volume" released by "delete_volume" :: held 1.386s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:52:43 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-fc9ac657-5682-4829-8fe5-a4287d6192b9 tempest-ProjectMemberTests-864505458 None] Acquiring lock "cinder-ab17f84f-88aa-427d-a28b-22668db38f04-delete_snapshot" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:52:43 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-fc9ac657-5682-4829-8fe5-a4287d6192b9 tempest-ProjectMemberTests-864505458 None] Lock "cinder-ab17f84f-88aa-427d-a28b-22668db38f04-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:52:43 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-fc9ac657-5682-4829-8fe5-a4287d6192b9 tempest-ProjectMemberTests-864505458 None] Acquiring lock "cinder-quobyte-c73a09a2-ee2f-4e94-8698-a702b1f5566c" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:52:43 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-fc9ac657-5682-4829-8fe5-a4287d6192b9 tempest-ProjectMemberTests-864505458 None] Lock "cinder-quobyte-c73a09a2-ee2f-4e94-8698-a702b1f5566c" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:52:43 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-fc9ac657-5682-4829-8fe5-a4287d6192b9 tempest-ProjectMemberTests-864505458 None] Acquiring lock "cinder-quobyte-ab17f84f-88aa-427d-a28b-22668db38f04" by "_delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:52:43 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-fc9ac657-5682-4829-8fe5-a4287d6192b9 tempest-ProjectMemberTests-864505458 None] Lock "cinder-quobyte-ab17f84f-88aa-427d-a28b-22668db38f04" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:52:43 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-fc9ac657-5682-4829-8fe5-a4287d6192b9 tempest-ProjectMemberTests-864505458 None] Deleting offline snapshot ab17f84f-88aa-427d-a28b-22668db38f04 of volume c73a09a2-ee2f-4e94-8698-a702b1f5566c {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 21:52:43 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-fc9ac657-5682-4829-8fe5-a4287d6192b9 tempest-ProjectMemberTests-864505458 None] snapshot_file for this snap is: volume-c73a09a2-ee2f-4e94-8698-a702b1f5566c.ab17f84f-88aa-427d-a28b-22668db38f04 {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 21:52:43 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[df959b63-ebfd-44f6-ba61-a9f37aa47bd5]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:52:43 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-fc9ac657-5682-4829-8fe5-a4287d6192b9 tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c73a09a2-ee2f-4e94-8698-a702b1f5566c.ab17f84f-88aa-427d-a28b-22668db38f04 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:43 devstack sudo[105462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c73a09a2-ee2f-4e94-8698-a702b1f5566c.ab17f84f-88aa-427d-a28b-22668db38f04 Sep 18 21:52:43 devstack sudo[105462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:43 devstack sudo[105462]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:43 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-fc9ac657-5682-4829-8fe5-a4287d6192b9 tempest-ProjectMemberTests-864505458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c73a09a2-ee2f-4e94-8698-a702b1f5566c.ab17f84f-88aa-427d-a28b-22668db38f04" returned: 0 in 0.397s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:43 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-fc9ac657-5682-4829-8fe5-a4287d6192b9 tempest-ProjectMemberTests-864505458 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c73a09a2-ee2f-4e94-8698-a702b1f5566c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86136) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 21:52:43 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a23037b-5f5d-4449-b01f-66b9b9708b3d]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:52:43 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-fc9ac657-5682-4829-8fe5-a4287d6192b9 tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c73a09a2-ee2f-4e94-8698-a702b1f5566c {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:44 devstack sudo[105467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c73a09a2-ee2f-4e94-8698-a702b1f5566c Sep 18 21:52:44 devstack sudo[105467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:44 devstack sudo[105467]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:44 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-fc9ac657-5682-4829-8fe5-a4287d6192b9 tempest-ProjectMemberTests-864505458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c73a09a2-ee2f-4e94-8698-a702b1f5566c" returned: 0 in 0.399s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:44 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-fc9ac657-5682-4829-8fe5-a4287d6192b9 tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c73a09a2-ee2f-4e94-8698-a702b1f5566c.ab17f84f-88aa-427d-a28b-22668db38f04 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:44 devstack sudo[105472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c73a09a2-ee2f-4e94-8698-a702b1f5566c.ab17f84f-88aa-427d-a28b-22668db38f04 Sep 18 21:52:44 devstack sudo[105472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:44 devstack sudo[105472]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:44 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-fc9ac657-5682-4829-8fe5-a4287d6192b9 tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c73a09a2-ee2f-4e94-8698-a702b1f5566c.ab17f84f-88aa-427d-a28b-22668db38f04" returned: 0 in 0.372s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:44 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-fc9ac657-5682-4829-8fe5-a4287d6192b9 tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c73a09a2-ee2f-4e94-8698-a702b1f5566c.ab17f84f-88aa-427d-a28b-22668db38f04 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:44 devstack sudo[105478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c73a09a2-ee2f-4e94-8698-a702b1f5566c.ab17f84f-88aa-427d-a28b-22668db38f04 Sep 18 21:52:44 devstack sudo[105478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:44 devstack sudo[105478]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:44 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-fc9ac657-5682-4829-8fe5-a4287d6192b9 tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c73a09a2-ee2f-4e94-8698-a702b1f5566c.ab17f84f-88aa-427d-a28b-22668db38f04" returned: 0 in 0.259s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:44 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-fc9ac657-5682-4829-8fe5-a4287d6192b9 tempest-ProjectMemberTests-864505458 None] Lock "cinder-quobyte-ab17f84f-88aa-427d-a28b-22668db38f04" released by "_delete_snapshot" :: held 1.547s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:52:44 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-fc9ac657-5682-4829-8fe5-a4287d6192b9 tempest-ProjectMemberTests-864505458 None] Lock "cinder-quobyte-c73a09a2-ee2f-4e94-8698-a702b1f5566c" released by "delete_snapshot" :: held 1.576s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:52:44 devstack cinder-volume[86136]: DEBUG dbcounter [-] [86136] Writing DB stats cinder:SELECT=152,cinder:UPDATE=212,cinder:DELETE=20,cinder:INSERT=54 {{(pid=86136) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 21:52:45 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-fc9ac657-5682-4829-8fe5-a4287d6192b9 tempest-ProjectMemberTests-864505458 None] Created reservations ['c4c8fe0b-dd0a-468f-9a9b-e0175ed292de', 'd1f2fad7-0196-41ee-bb5b-9c9df2e69d25', '35ce5ae6-8f5b-41dd-b7d9-f26bd1b326c3', '35c93ed2-d5c0-46eb-a761-fa818860f203'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:52:45 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-fc9ac657-5682-4829-8fe5-a4287d6192b9 tempest-ProjectMemberTests-864505458 None] Delete snapshot completed successfully. Sep 18 21:52:45 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-fc9ac657-5682-4829-8fe5-a4287d6192b9 tempest-ProjectMemberTests-864505458 None] Lock "cinder-ab17f84f-88aa-427d-a28b-22668db38f04-delete_snapshot" released by "delete_snapshot" :: held 1.735s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:52:45 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-64177285-36cd-4258-9d51-4fda13f4620f tempest-ProjectMemberTests-864505458 None] Acquiring lock "cinder-c73a09a2-ee2f-4e94-8698-a702b1f5566c-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:52:45 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-64177285-36cd-4258-9d51-4fda13f4620f tempest-ProjectMemberTests-864505458 None] Lock "cinder-c73a09a2-ee2f-4e94-8698-a702b1f5566c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:52:45 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-64177285-36cd-4258-9d51-4fda13f4620f tempest-ProjectMemberTests-864505458 None] Acquiring lock "cinder-quobyte-c73a09a2-ee2f-4e94-8698-a702b1f5566c" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:52:45 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-64177285-36cd-4258-9d51-4fda13f4620f tempest-ProjectMemberTests-864505458 None] Lock "cinder-quobyte-c73a09a2-ee2f-4e94-8698-a702b1f5566c" acquired by "delete_volume" :: waited 0.021s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:52:45 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[998bfbaa-75ae-40c9-993f-33e2f0288aac]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:52:45 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-64177285-36cd-4258-9d51-4fda13f4620f tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c73a09a2-ee2f-4e94-8698-a702b1f5566c {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:45 devstack sudo[105481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c73a09a2-ee2f-4e94-8698-a702b1f5566c Sep 18 21:52:45 devstack sudo[105481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:46 devstack sudo[105481]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-64177285-36cd-4258-9d51-4fda13f4620f tempest-ProjectMemberTests-864505458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c73a09a2-ee2f-4e94-8698-a702b1f5566c" returned: 0 in 0.386s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-64177285-36cd-4258-9d51-4fda13f4620f tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c73a09a2-ee2f-4e94-8698-a702b1f5566c {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:46 devstack sudo[105487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c73a09a2-ee2f-4e94-8698-a702b1f5566c Sep 18 21:52:46 devstack sudo[105487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:46 devstack sudo[105487]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-64177285-36cd-4258-9d51-4fda13f4620f tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-c73a09a2-ee2f-4e94-8698-a702b1f5566c" returned: 0 in 0.258s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:46 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-64177285-36cd-4258-9d51-4fda13f4620f tempest-ProjectMemberTests-864505458 None] Lock "cinder-quobyte-c73a09a2-ee2f-4e94-8698-a702b1f5566c" released by "delete_volume" :: held 0.722s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:52:46 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-64177285-36cd-4258-9d51-4fda13f4620f tempest-ProjectMemberTests-864505458 None] Created reservations ['d260cb72-fe8d-482d-a74d-8dfc2146fbd2', 'fa4b8f14-a851-4a1e-980f-032af1911ca9', '6b4d8568-3768-404b-81c6-692601f60632', '8734aee7-18dc-4fa9-9134-db03cb214899'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:52:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-64177285-36cd-4258-9d51-4fda13f4620f tempest-ProjectMemberTests-864505458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:52:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-64177285-36cd-4258-9d51-4fda13f4620f tempest-ProjectMemberTests-864505458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:52:46 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-64177285-36cd-4258-9d51-4fda13f4620f tempest-ProjectMemberTests-864505458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:52:46 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-64177285-36cd-4258-9d51-4fda13f4620f tempest-ProjectMemberTests-864505458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:52:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-64177285-36cd-4258-9d51-4fda13f4620f tempest-ProjectMemberTests-864505458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:52:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-64177285-36cd-4258-9d51-4fda13f4620f tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:46 devstack sudo[105490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:52:46 devstack sudo[105490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:46 devstack sudo[105490]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:46 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-64177285-36cd-4258-9d51-4fda13f4620f tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.270s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:46 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-64177285-36cd-4258-9d51-4fda13f4620f tempest-ProjectMemberTests-864505458 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:52:46 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-64177285-36cd-4258-9d51-4fda13f4620f tempest-ProjectMemberTests-864505458 None] Deleted volume successfully. Sep 18 21:52:46 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-64177285-36cd-4258-9d51-4fda13f4620f tempest-ProjectMemberTests-864505458 None] Lock "cinder-c73a09a2-ee2f-4e94-8698-a702b1f5566c-delete_volume" released by "delete_volume" :: held 1.214s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:52:47 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-865ebf14-998a-42bc-8ab6-351da787e8a1 tempest-ProjectMemberTests-864505458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:52:47 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-865ebf14-998a-42bc-8ab6-351da787e8a1 tempest-ProjectMemberTests-864505458 None] Flow 'volume_create_manager' (c6e87eec-b93c-4b7d-b31f-17dc33ce39f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:52:47 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-865ebf14-998a-42bc-8ab6-351da787e8a1 tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b50a1d6-e90b-4287-8661-508670a9c1b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:52:47 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-865ebf14-998a-42bc-8ab6-351da787e8a1 tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b50a1d6-e90b-4287-8661-508670a9c1b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:52:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1433549418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7172c499-f8e2-4b4f-a374-1d1742c4195e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44aed77f70a242029bc978ba9aa69a78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:52:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:52:47Z,use_quota=True,user_id='fbe2b10fb8584161a20a4564db383b3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:52:47 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-865ebf14-998a-42bc-8ab6-351da787e8a1 tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e876f7e-1b0d-450a-b1dd-f34a14002643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:52:47 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-865ebf14-998a-42bc-8ab6-351da787e8a1 tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e876f7e-1b0d-450a-b1dd-f34a14002643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:52:47 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-865ebf14-998a-42bc-8ab6-351da787e8a1 tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a06978a-19b5-4a11-bda9-6c9de669d356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:52:47 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-865ebf14-998a-42bc-8ab6-351da787e8a1 tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a06978a-19b5-4a11-bda9-6c9de669d356) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7172c499-f8e2-4b4f-a374-1d1742c4195e', 'volume_name': 'volume-7172c499-f8e2-4b4f-a374-1d1742c4195e', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:52:47 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-865ebf14-998a-42bc-8ab6-351da787e8a1 tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79bc3dff-d86f-4a9d-8d34-d5cd6bd1e2a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:52:47 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-865ebf14-998a-42bc-8ab6-351da787e8a1 tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79bc3dff-d86f-4a9d-8d34-d5cd6bd1e2a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:52:47 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-865ebf14-998a-42bc-8ab6-351da787e8a1 tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03830ced-de2a-4be9-b078-0d7c3e436775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:52:47 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-865ebf14-998a-42bc-8ab6-351da787e8a1 tempest-ProjectMemberTests-864505458 None] Volume 7172c499-f8e2-4b4f-a374-1d1742c4195e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7172c499-f8e2-4b4f-a374-1d1742c4195e', 'volume_size': 1} Sep 18 21:52:47 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-865ebf14-998a-42bc-8ab6-351da787e8a1 tempest-ProjectMemberTests-864505458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:52:47 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-865ebf14-998a-42bc-8ab6-351da787e8a1 tempest-ProjectMemberTests-864505458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:52:47 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-865ebf14-998a-42bc-8ab6-351da787e8a1 tempest-ProjectMemberTests-864505458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:52:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1433549418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7172c499-f8e2-4b4f-a374-1d1742c4195e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44aed77f70a242029bc978ba9aa69a78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:52:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:52:47Z,use_quota=True,user_id='fbe2b10fb8584161a20a4564db383b3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:52:47 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-865ebf14-998a-42bc-8ab6-351da787e8a1 tempest-ProjectMemberTests-864505458 None] Creating volume 7172c499-f8e2-4b4f-a374-1d1742c4195e {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:52:47 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-865ebf14-998a-42bc-8ab6-351da787e8a1 tempest-ProjectMemberTests-864505458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:52:47 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-865ebf14-998a-42bc-8ab6-351da787e8a1 tempest-ProjectMemberTests-864505458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:52:47 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-865ebf14-998a-42bc-8ab6-351da787e8a1 tempest-ProjectMemberTests-864505458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:52:47 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-865ebf14-998a-42bc-8ab6-351da787e8a1 tempest-ProjectMemberTests-864505458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:52:47 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-865ebf14-998a-42bc-8ab6-351da787e8a1 tempest-ProjectMemberTests-864505458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:52:47 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-865ebf14-998a-42bc-8ab6-351da787e8a1 tempest-ProjectMemberTests-864505458 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:52:47 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-865ebf14-998a-42bc-8ab6-351da787e8a1 tempest-ProjectMemberTests-864505458 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:52:47 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-865ebf14-998a-42bc-8ab6-351da787e8a1 tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7172c499-f8e2-4b4f-a374-1d1742c4195e 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:47 devstack sudo[105494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7172c499-f8e2-4b4f-a374-1d1742c4195e 1073741824 Sep 18 21:52:47 devstack sudo[105494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:47 devstack sudo[105494]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:47 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-865ebf14-998a-42bc-8ab6-351da787e8a1 tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7172c499-f8e2-4b4f-a374-1d1742c4195e 1073741824" returned: 0 in 0.447s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:47 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-865ebf14-998a-42bc-8ab6-351da787e8a1 tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7172c499-f8e2-4b4f-a374-1d1742c4195e {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:47 devstack sudo[105500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7172c499-f8e2-4b4f-a374-1d1742c4195e Sep 18 21:52:47 devstack sudo[105500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:48 devstack sudo[105500]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:48 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-865ebf14-998a-42bc-8ab6-351da787e8a1 tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7172c499-f8e2-4b4f-a374-1d1742c4195e" returned: 0 in 0.264s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:48 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-865ebf14-998a-42bc-8ab6-351da787e8a1 tempest-ProjectMemberTests-864505458 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:52:48 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-865ebf14-998a-42bc-8ab6-351da787e8a1 tempest-ProjectMemberTests-864505458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:52:48 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-865ebf14-998a-42bc-8ab6-351da787e8a1 tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03830ced-de2a-4be9-b078-0d7c3e436775) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7172c499-f8e2-4b4f-a374-1d1742c4195e', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:52:48 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-865ebf14-998a-42bc-8ab6-351da787e8a1 tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d96b9fb-a63f-44b3-a1e2-afe2da61b986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:52:48 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-865ebf14-998a-42bc-8ab6-351da787e8a1 tempest-ProjectMemberTests-864505458 None] Volume volume-7172c499-f8e2-4b4f-a374-1d1742c4195e (7172c499-f8e2-4b4f-a374-1d1742c4195e): created successfully Sep 18 21:52:48 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-865ebf14-998a-42bc-8ab6-351da787e8a1 tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d96b9fb-a63f-44b3-a1e2-afe2da61b986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:52:48 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-865ebf14-998a-42bc-8ab6-351da787e8a1 tempest-ProjectMemberTests-864505458 None] Flow 'volume_create_manager' (c6e87eec-b93c-4b7d-b31f-17dc33ce39f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:52:48 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-865ebf14-998a-42bc-8ab6-351da787e8a1 tempest-ProjectMemberTests-864505458 None] Created volume successfully. Sep 18 21:52:48 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-bf1cdd03-5ee9-4435-90ef-659745d73d4d tempest-ProjectMemberTests-864505458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:52:48 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-bf1cdd03-5ee9-4435-90ef-659745d73d4d tempest-ProjectMemberTests-864505458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:52:48 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-bf1cdd03-5ee9-4435-90ef-659745d73d4d tempest-ProjectMemberTests-864505458 None] Creating offline snapshot e40ca622-bc3c-4139-90cc-8cefb3f016d4 of volume 7172c499-f8e2-4b4f-a374-1d1742c4195e {{(pid=86136) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 21:52:48 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f5c4a75-a697-4a31-af67-5e91ea20972a]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:52:48 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-bf1cdd03-5ee9-4435-90ef-659745d73d4d tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7172c499-f8e2-4b4f-a374-1d1742c4195e {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:48 devstack sudo[105503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7172c499-f8e2-4b4f-a374-1d1742c4195e Sep 18 21:52:48 devstack sudo[105503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:48 devstack sudo[105503]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:48 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-bf1cdd03-5ee9-4435-90ef-659745d73d4d tempest-ProjectMemberTests-864505458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7172c499-f8e2-4b4f-a374-1d1742c4195e" returned: 0 in 0.412s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:48 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-bf1cdd03-5ee9-4435-90ef-659745d73d4d tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7172c499-f8e2-4b4f-a374-1d1742c4195e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7172c499-f8e2-4b4f-a374-1d1742c4195e.e40ca622-bc3c-4139-90cc-8cefb3f016d4 1G {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:48 devstack sudo[105510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7172c499-f8e2-4b4f-a374-1d1742c4195e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7172c499-f8e2-4b4f-a374-1d1742c4195e.e40ca622-bc3c-4139-90cc-8cefb3f016d4 1G Sep 18 21:52:48 devstack sudo[105510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:49 devstack sudo[105510]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:49 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-bf1cdd03-5ee9-4435-90ef-659745d73d4d tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7172c499-f8e2-4b4f-a374-1d1742c4195e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7172c499-f8e2-4b4f-a374-1d1742c4195e.e40ca622-bc3c-4139-90cc-8cefb3f016d4 1G" returned: 0 in 0.425s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:49 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-bf1cdd03-5ee9-4435-90ef-659745d73d4d tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7172c499-f8e2-4b4f-a374-1d1742c4195e -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7172c499-f8e2-4b4f-a374-1d1742c4195e.e40ca622-bc3c-4139-90cc-8cefb3f016d4 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:49 devstack sudo[105516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7172c499-f8e2-4b4f-a374-1d1742c4195e -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7172c499-f8e2-4b4f-a374-1d1742c4195e.e40ca622-bc3c-4139-90cc-8cefb3f016d4 Sep 18 21:52:49 devstack sudo[105516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:49 devstack sudo[105516]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:49 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-bf1cdd03-5ee9-4435-90ef-659745d73d4d tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7172c499-f8e2-4b4f-a374-1d1742c4195e -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7172c499-f8e2-4b4f-a374-1d1742c4195e.e40ca622-bc3c-4139-90cc-8cefb3f016d4" returned: 0 in 0.313s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:49 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-bf1cdd03-5ee9-4435-90ef-659745d73d4d tempest-ProjectMemberTests-864505458 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7172c499-f8e2-4b4f-a374-1d1742c4195e.e40ca622-bc3c-4139-90cc-8cefb3f016d4 is being set with open permissions: ugo+rw Sep 18 21:52:49 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-bf1cdd03-5ee9-4435-90ef-659745d73d4d tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7172c499-f8e2-4b4f-a374-1d1742c4195e.e40ca622-bc3c-4139-90cc-8cefb3f016d4 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:49 devstack sudo[105526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7172c499-f8e2-4b4f-a374-1d1742c4195e.e40ca622-bc3c-4139-90cc-8cefb3f016d4 Sep 18 21:52:49 devstack sudo[105526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:49 devstack sudo[105526]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:49 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-bf1cdd03-5ee9-4435-90ef-659745d73d4d tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7172c499-f8e2-4b4f-a374-1d1742c4195e.e40ca622-bc3c-4139-90cc-8cefb3f016d4" returned: 0 in 0.269s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:49 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-bf1cdd03-5ee9-4435-90ef-659745d73d4d tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7172c499-f8e2-4b4f-a374-1d1742c4195e.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:49 devstack sudo[105529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7172c499-f8e2-4b4f-a374-1d1742c4195e.info Sep 18 21:52:49 devstack sudo[105529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:50 devstack sudo[105529]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:50 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-bf1cdd03-5ee9-4435-90ef-659745d73d4d tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7172c499-f8e2-4b4f-a374-1d1742c4195e.info" returned: 0 in 0.289s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:50 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-bf1cdd03-5ee9-4435-90ef-659745d73d4d tempest-ProjectMemberTests-864505458 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7172c499-f8e2-4b4f-a374-1d1742c4195e.info is being set with open permissions: ugo+rw Sep 18 21:52:50 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-bf1cdd03-5ee9-4435-90ef-659745d73d4d tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7172c499-f8e2-4b4f-a374-1d1742c4195e.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:50 devstack sudo[105532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7172c499-f8e2-4b4f-a374-1d1742c4195e.info Sep 18 21:52:50 devstack sudo[105532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:50 devstack sudo[105532]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:50 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-bf1cdd03-5ee9-4435-90ef-659745d73d4d tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7172c499-f8e2-4b4f-a374-1d1742c4195e.info" returned: 0 in 0.255s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:50 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-bf1cdd03-5ee9-4435-90ef-659745d73d4d tempest-ProjectMemberTests-864505458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.057s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:52:50 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-bf1cdd03-5ee9-4435-90ef-659745d73d4d tempest-ProjectMemberTests-864505458 None] Create snapshot completed successfully Sep 18 21:52:51 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-3564a002-af75-48d1-8830-9a63d4f61095 tempest-ProjectMemberTests-864505458 None] Acquiring lock "cinder-e40ca622-bc3c-4139-90cc-8cefb3f016d4-delete_snapshot" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:52:51 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-3564a002-af75-48d1-8830-9a63d4f61095 tempest-ProjectMemberTests-864505458 None] Lock "cinder-e40ca622-bc3c-4139-90cc-8cefb3f016d4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:52:51 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-3564a002-af75-48d1-8830-9a63d4f61095 tempest-ProjectMemberTests-864505458 None] Acquiring lock "cinder-quobyte-7172c499-f8e2-4b4f-a374-1d1742c4195e" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:52:51 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-3564a002-af75-48d1-8830-9a63d4f61095 tempest-ProjectMemberTests-864505458 None] Lock "cinder-quobyte-7172c499-f8e2-4b4f-a374-1d1742c4195e" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:52:51 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-3564a002-af75-48d1-8830-9a63d4f61095 tempest-ProjectMemberTests-864505458 None] Acquiring lock "cinder-quobyte-e40ca622-bc3c-4139-90cc-8cefb3f016d4" by "_delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:52:51 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-3564a002-af75-48d1-8830-9a63d4f61095 tempest-ProjectMemberTests-864505458 None] Lock "cinder-quobyte-e40ca622-bc3c-4139-90cc-8cefb3f016d4" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:52:51 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-3564a002-af75-48d1-8830-9a63d4f61095 tempest-ProjectMemberTests-864505458 None] Deleting offline snapshot e40ca622-bc3c-4139-90cc-8cefb3f016d4 of volume 7172c499-f8e2-4b4f-a374-1d1742c4195e {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 21:52:51 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-3564a002-af75-48d1-8830-9a63d4f61095 tempest-ProjectMemberTests-864505458 None] snapshot_file for this snap is: volume-7172c499-f8e2-4b4f-a374-1d1742c4195e.e40ca622-bc3c-4139-90cc-8cefb3f016d4 {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 21:52:51 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b2a55a-086b-46c1-a55d-daa12fb63a28]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:52:51 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3564a002-af75-48d1-8830-9a63d4f61095 tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7172c499-f8e2-4b4f-a374-1d1742c4195e.e40ca622-bc3c-4139-90cc-8cefb3f016d4 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:51 devstack sudo[105536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7172c499-f8e2-4b4f-a374-1d1742c4195e.e40ca622-bc3c-4139-90cc-8cefb3f016d4 Sep 18 21:52:51 devstack sudo[105536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:52 devstack sudo[105536]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:52 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3564a002-af75-48d1-8830-9a63d4f61095 tempest-ProjectMemberTests-864505458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7172c499-f8e2-4b4f-a374-1d1742c4195e.e40ca622-bc3c-4139-90cc-8cefb3f016d4" returned: 0 in 0.385s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:52 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-3564a002-af75-48d1-8830-9a63d4f61095 tempest-ProjectMemberTests-864505458 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7172c499-f8e2-4b4f-a374-1d1742c4195e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86136) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 21:52:52 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[df8999d9-ddc9-4c16-b00f-ad3e7e2334fb]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:52:52 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3564a002-af75-48d1-8830-9a63d4f61095 tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7172c499-f8e2-4b4f-a374-1d1742c4195e {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:52 devstack sudo[105541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7172c499-f8e2-4b4f-a374-1d1742c4195e Sep 18 21:52:52 devstack sudo[105541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:52 devstack sudo[105541]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:52 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3564a002-af75-48d1-8830-9a63d4f61095 tempest-ProjectMemberTests-864505458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7172c499-f8e2-4b4f-a374-1d1742c4195e" returned: 0 in 0.372s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:52 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3564a002-af75-48d1-8830-9a63d4f61095 tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7172c499-f8e2-4b4f-a374-1d1742c4195e.e40ca622-bc3c-4139-90cc-8cefb3f016d4 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:52 devstack sudo[105546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7172c499-f8e2-4b4f-a374-1d1742c4195e.e40ca622-bc3c-4139-90cc-8cefb3f016d4 Sep 18 21:52:52 devstack sudo[105546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:52 devstack sudo[105546]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:52 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3564a002-af75-48d1-8830-9a63d4f61095 tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7172c499-f8e2-4b4f-a374-1d1742c4195e.e40ca622-bc3c-4139-90cc-8cefb3f016d4" returned: 0 in 0.362s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:52 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3564a002-af75-48d1-8830-9a63d4f61095 tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7172c499-f8e2-4b4f-a374-1d1742c4195e.e40ca622-bc3c-4139-90cc-8cefb3f016d4 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:52 devstack sudo[105551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7172c499-f8e2-4b4f-a374-1d1742c4195e.e40ca622-bc3c-4139-90cc-8cefb3f016d4 Sep 18 21:52:52 devstack sudo[105551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:53 devstack sudo[105551]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:53 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3564a002-af75-48d1-8830-9a63d4f61095 tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7172c499-f8e2-4b4f-a374-1d1742c4195e.e40ca622-bc3c-4139-90cc-8cefb3f016d4" returned: 0 in 0.264s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:53 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-3564a002-af75-48d1-8830-9a63d4f61095 tempest-ProjectMemberTests-864505458 None] Lock "cinder-quobyte-e40ca622-bc3c-4139-90cc-8cefb3f016d4" released by "_delete_snapshot" :: held 1.515s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:52:53 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-3564a002-af75-48d1-8830-9a63d4f61095 tempest-ProjectMemberTests-864505458 None] Lock "cinder-quobyte-7172c499-f8e2-4b4f-a374-1d1742c4195e" released by "delete_snapshot" :: held 1.552s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:52:53 devstack cinder-volume[86136]: DEBUG dbcounter [-] [86136] Writing DB stats cinder:UPDATE=201,cinder:SELECT=172,cinder:INSERT=55,cinder:DELETE=15 {{(pid=86136) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 21:52:53 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-3564a002-af75-48d1-8830-9a63d4f61095 tempest-ProjectMemberTests-864505458 None] Created reservations ['b9a353e7-dbed-4bc2-a0d1-fd5682448642', '2d4a7e54-dd29-489c-9a4b-fd36f6c29b7a', '1404c846-cc0c-498f-a3b7-b3476e93edcc', '5d658d97-99b4-4951-8165-70bd318b20ed'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:52:53 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-3564a002-af75-48d1-8830-9a63d4f61095 tempest-ProjectMemberTests-864505458 None] Delete snapshot completed successfully. Sep 18 21:52:53 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-3564a002-af75-48d1-8830-9a63d4f61095 tempest-ProjectMemberTests-864505458 None] Lock "cinder-e40ca622-bc3c-4139-90cc-8cefb3f016d4-delete_snapshot" released by "delete_snapshot" :: held 1.708s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:52:53 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-26fb2b59-521b-42ec-bb66-0ba08015e985 tempest-ProjectMemberTests-864505458 None] Acquiring lock "cinder-7172c499-f8e2-4b4f-a374-1d1742c4195e-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:52:53 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-26fb2b59-521b-42ec-bb66-0ba08015e985 tempest-ProjectMemberTests-864505458 None] Lock "cinder-7172c499-f8e2-4b4f-a374-1d1742c4195e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:52:53 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-26fb2b59-521b-42ec-bb66-0ba08015e985 tempest-ProjectMemberTests-864505458 None] Acquiring lock "cinder-quobyte-7172c499-f8e2-4b4f-a374-1d1742c4195e" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:52:53 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-26fb2b59-521b-42ec-bb66-0ba08015e985 tempest-ProjectMemberTests-864505458 None] Lock "cinder-quobyte-7172c499-f8e2-4b4f-a374-1d1742c4195e" acquired by "delete_volume" :: waited 0.017s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:52:53 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[f466c164-ed53-4d14-8305-11b0eeb954a2]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:52:53 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-26fb2b59-521b-42ec-bb66-0ba08015e985 tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7172c499-f8e2-4b4f-a374-1d1742c4195e {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:53 devstack sudo[105554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7172c499-f8e2-4b4f-a374-1d1742c4195e Sep 18 21:52:53 devstack sudo[105554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:54 devstack sudo[105554]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:54 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-26fb2b59-521b-42ec-bb66-0ba08015e985 tempest-ProjectMemberTests-864505458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7172c499-f8e2-4b4f-a374-1d1742c4195e" returned: 0 in 0.381s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:54 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-26fb2b59-521b-42ec-bb66-0ba08015e985 tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7172c499-f8e2-4b4f-a374-1d1742c4195e {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:54 devstack sudo[105559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7172c499-f8e2-4b4f-a374-1d1742c4195e Sep 18 21:52:54 devstack sudo[105559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:54 devstack sudo[105559]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:54 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-26fb2b59-521b-42ec-bb66-0ba08015e985 tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-7172c499-f8e2-4b4f-a374-1d1742c4195e" returned: 0 in 0.246s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:54 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-26fb2b59-521b-42ec-bb66-0ba08015e985 tempest-ProjectMemberTests-864505458 None] Lock "cinder-quobyte-7172c499-f8e2-4b4f-a374-1d1742c4195e" released by "delete_volume" :: held 0.703s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:52:54 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-26fb2b59-521b-42ec-bb66-0ba08015e985 tempest-ProjectMemberTests-864505458 None] Created reservations ['b859c4d6-6eb9-4740-8e64-189fe1d30d98', '9f37b3f0-0405-4efd-8a06-d316a8f704af', '8fd8744e-09cd-4d76-b663-289d835fd32e', '15b28060-be91-4d9d-8582-e07a825d73b4'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:52:54 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-26fb2b59-521b-42ec-bb66-0ba08015e985 tempest-ProjectMemberTests-864505458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:52:54 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-26fb2b59-521b-42ec-bb66-0ba08015e985 tempest-ProjectMemberTests-864505458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:52:54 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-26fb2b59-521b-42ec-bb66-0ba08015e985 tempest-ProjectMemberTests-864505458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:52:54 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-26fb2b59-521b-42ec-bb66-0ba08015e985 tempest-ProjectMemberTests-864505458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:52:54 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-26fb2b59-521b-42ec-bb66-0ba08015e985 tempest-ProjectMemberTests-864505458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:52:54 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-26fb2b59-521b-42ec-bb66-0ba08015e985 tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:54 devstack sudo[105562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:52:54 devstack sudo[105562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:54 devstack sudo[105562]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:54 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-26fb2b59-521b-42ec-bb66-0ba08015e985 tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.267s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:54 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-26fb2b59-521b-42ec-bb66-0ba08015e985 tempest-ProjectMemberTests-864505458 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:52:54 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-26fb2b59-521b-42ec-bb66-0ba08015e985 tempest-ProjectMemberTests-864505458 None] Deleted volume successfully. Sep 18 21:52:54 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-26fb2b59-521b-42ec-bb66-0ba08015e985 tempest-ProjectMemberTests-864505458 None] Lock "cinder-7172c499-f8e2-4b4f-a374-1d1742c4195e-delete_volume" released by "delete_volume" :: held 1.190s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:52:55 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-f32e51e8-7fcc-47e9-9e84-575d14e6bb0e tempest-ProjectMemberTests-864505458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:52:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f32e51e8-7fcc-47e9-9e84-575d14e6bb0e tempest-ProjectMemberTests-864505458 None] Flow 'volume_create_manager' (8118862d-da52-4397-979b-3e603bd24cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:52:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f32e51e8-7fcc-47e9-9e84-575d14e6bb0e tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ec4fee7-f4f9-40fa-8ed0-e523b019aceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:52:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f32e51e8-7fcc-47e9-9e84-575d14e6bb0e tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ec4fee7-f4f9-40fa-8ed0-e523b019aceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:52:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1150150222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24315cb1-5b91-481e-84d8-d0acf8c45945,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44aed77f70a242029bc978ba9aa69a78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:52:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:52:55Z,use_quota=True,user_id='fbe2b10fb8584161a20a4564db383b3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:52:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f32e51e8-7fcc-47e9-9e84-575d14e6bb0e tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b58d840-5ebc-4b9c-a7be-e8c962186e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:52:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f32e51e8-7fcc-47e9-9e84-575d14e6bb0e tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b58d840-5ebc-4b9c-a7be-e8c962186e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:52:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f32e51e8-7fcc-47e9-9e84-575d14e6bb0e tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (749fdcd3-2cc4-4f0f-9167-65c792817312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:52:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f32e51e8-7fcc-47e9-9e84-575d14e6bb0e tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (749fdcd3-2cc4-4f0f-9167-65c792817312) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24315cb1-5b91-481e-84d8-d0acf8c45945', 'volume_name': 'volume-24315cb1-5b91-481e-84d8-d0acf8c45945', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:52:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f32e51e8-7fcc-47e9-9e84-575d14e6bb0e tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f262980-3ea7-435d-b806-ccfc54e6f541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:52:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f32e51e8-7fcc-47e9-9e84-575d14e6bb0e tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f262980-3ea7-435d-b806-ccfc54e6f541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:52:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f32e51e8-7fcc-47e9-9e84-575d14e6bb0e tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96228372-929e-4c06-b889-e5295ed766e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:52:55 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-f32e51e8-7fcc-47e9-9e84-575d14e6bb0e tempest-ProjectMemberTests-864505458 None] Volume 24315cb1-5b91-481e-84d8-d0acf8c45945: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24315cb1-5b91-481e-84d8-d0acf8c45945', 'volume_size': 1} Sep 18 21:52:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-f32e51e8-7fcc-47e9-9e84-575d14e6bb0e tempest-ProjectMemberTests-864505458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:52:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-f32e51e8-7fcc-47e9-9e84-575d14e6bb0e tempest-ProjectMemberTests-864505458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:52:55 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-f32e51e8-7fcc-47e9-9e84-575d14e6bb0e tempest-ProjectMemberTests-864505458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:52:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1150150222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24315cb1-5b91-481e-84d8-d0acf8c45945,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44aed77f70a242029bc978ba9aa69a78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:52:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:52:55Z,use_quota=True,user_id='fbe2b10fb8584161a20a4564db383b3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:52:55 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-f32e51e8-7fcc-47e9-9e84-575d14e6bb0e tempest-ProjectMemberTests-864505458 None] Creating volume 24315cb1-5b91-481e-84d8-d0acf8c45945 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:52:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-f32e51e8-7fcc-47e9-9e84-575d14e6bb0e tempest-ProjectMemberTests-864505458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:52:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-f32e51e8-7fcc-47e9-9e84-575d14e6bb0e tempest-ProjectMemberTests-864505458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:52:55 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-f32e51e8-7fcc-47e9-9e84-575d14e6bb0e tempest-ProjectMemberTests-864505458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:52:55 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-f32e51e8-7fcc-47e9-9e84-575d14e6bb0e tempest-ProjectMemberTests-864505458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:52:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-f32e51e8-7fcc-47e9-9e84-575d14e6bb0e tempest-ProjectMemberTests-864505458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:52:55 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-f32e51e8-7fcc-47e9-9e84-575d14e6bb0e tempest-ProjectMemberTests-864505458 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:52:55 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-f32e51e8-7fcc-47e9-9e84-575d14e6bb0e tempest-ProjectMemberTests-864505458 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:52:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f32e51e8-7fcc-47e9-9e84-575d14e6bb0e tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-24315cb1-5b91-481e-84d8-d0acf8c45945 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:55 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-b256451a-bc19-4e59-8069-6bddd6a70280 tempest-ProjectReaderTests-1915593202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:52:55 devstack sudo[105565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-24315cb1-5b91-481e-84d8-d0acf8c45945 1073741824 Sep 18 21:52:55 devstack sudo[105565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b256451a-bc19-4e59-8069-6bddd6a70280 tempest-ProjectReaderTests-1915593202 None] Flow 'volume_create_manager' (004c5451-3965-4167-a422-a9cf58b5da80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:52:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b256451a-bc19-4e59-8069-6bddd6a70280 tempest-ProjectReaderTests-1915593202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72acebf5-8e4a-4126-83e3-09a641e9d147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:52:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b256451a-bc19-4e59-8069-6bddd6a70280 tempest-ProjectReaderTests-1915593202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72acebf5-8e4a-4126-83e3-09a641e9d147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:52:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-476940883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77ad0a7b-9605-4a0e-9562-381b351af4a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3c1d723082a404daad4c7e7764ea643',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:52:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:52:55Z,use_quota=True,user_id='9f21132c312d4262a7b00cfaec17f8d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:52:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b256451a-bc19-4e59-8069-6bddd6a70280 tempest-ProjectReaderTests-1915593202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d3dad0a-1f05-4b8e-ae4a-eae80bc7d158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:52:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b256451a-bc19-4e59-8069-6bddd6a70280 tempest-ProjectReaderTests-1915593202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d3dad0a-1f05-4b8e-ae4a-eae80bc7d158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:52:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b256451a-bc19-4e59-8069-6bddd6a70280 tempest-ProjectReaderTests-1915593202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52231b2c-2fda-4a8a-9367-2a7144f0dc8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:52:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b256451a-bc19-4e59-8069-6bddd6a70280 tempest-ProjectReaderTests-1915593202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52231b2c-2fda-4a8a-9367-2a7144f0dc8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77ad0a7b-9605-4a0e-9562-381b351af4a0', 'volume_name': 'volume-77ad0a7b-9605-4a0e-9562-381b351af4a0', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:52:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b256451a-bc19-4e59-8069-6bddd6a70280 tempest-ProjectReaderTests-1915593202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d729bf7c-88b7-48cc-ae7e-48c6eb91001f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:52:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b256451a-bc19-4e59-8069-6bddd6a70280 tempest-ProjectReaderTests-1915593202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d729bf7c-88b7-48cc-ae7e-48c6eb91001f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:52:55 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b256451a-bc19-4e59-8069-6bddd6a70280 tempest-ProjectReaderTests-1915593202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (393545e3-a268-4b2e-b11e-2920c22095e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:52:55 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-b256451a-bc19-4e59-8069-6bddd6a70280 tempest-ProjectReaderTests-1915593202 None] Volume 77ad0a7b-9605-4a0e-9562-381b351af4a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77ad0a7b-9605-4a0e-9562-381b351af4a0', 'volume_size': 1} Sep 18 21:52:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-b256451a-bc19-4e59-8069-6bddd6a70280 tempest-ProjectReaderTests-1915593202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:52:55 devstack sudo[105565]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:55 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f32e51e8-7fcc-47e9-9e84-575d14e6bb0e tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-24315cb1-5b91-481e-84d8-d0acf8c45945 1073741824" returned: 0 in 0.416s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f32e51e8-7fcc-47e9-9e84-575d14e6bb0e tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-24315cb1-5b91-481e-84d8-d0acf8c45945 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:56 devstack sudo[105571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-24315cb1-5b91-481e-84d8-d0acf8c45945 Sep 18 21:52:56 devstack sudo[105571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:56 devstack sudo[105571]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f32e51e8-7fcc-47e9-9e84-575d14e6bb0e tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-24315cb1-5b91-481e-84d8-d0acf8c45945" returned: 0 in 0.241s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:56 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-f32e51e8-7fcc-47e9-9e84-575d14e6bb0e tempest-ProjectMemberTests-864505458 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:52:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-f32e51e8-7fcc-47e9-9e84-575d14e6bb0e tempest-ProjectMemberTests-864505458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:52:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-b256451a-bc19-4e59-8069-6bddd6a70280 tempest-ProjectReaderTests-1915593202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.587s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:52:56 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-b256451a-bc19-4e59-8069-6bddd6a70280 tempest-ProjectReaderTests-1915593202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:52:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-476940883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77ad0a7b-9605-4a0e-9562-381b351af4a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3c1d723082a404daad4c7e7764ea643',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:52:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:52:55Z,use_quota=True,user_id='9f21132c312d4262a7b00cfaec17f8d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:52:56 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-b256451a-bc19-4e59-8069-6bddd6a70280 tempest-ProjectReaderTests-1915593202 None] Creating volume 77ad0a7b-9605-4a0e-9562-381b351af4a0 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:52:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-b256451a-bc19-4e59-8069-6bddd6a70280 tempest-ProjectReaderTests-1915593202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:52:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-b256451a-bc19-4e59-8069-6bddd6a70280 tempest-ProjectReaderTests-1915593202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:52:56 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-b256451a-bc19-4e59-8069-6bddd6a70280 tempest-ProjectReaderTests-1915593202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:52:56 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-b256451a-bc19-4e59-8069-6bddd6a70280 tempest-ProjectReaderTests-1915593202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:52:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-b256451a-bc19-4e59-8069-6bddd6a70280 tempest-ProjectReaderTests-1915593202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:52:56 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-b256451a-bc19-4e59-8069-6bddd6a70280 tempest-ProjectReaderTests-1915593202 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:52:56 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-b256451a-bc19-4e59-8069-6bddd6a70280 tempest-ProjectReaderTests-1915593202 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:52:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-b256451a-bc19-4e59-8069-6bddd6a70280 tempest-ProjectReaderTests-1915593202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-77ad0a7b-9605-4a0e-9562-381b351af4a0 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:56 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f32e51e8-7fcc-47e9-9e84-575d14e6bb0e tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96228372-929e-4c06-b889-e5295ed766e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24315cb1-5b91-481e-84d8-d0acf8c45945', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:52:56 devstack sudo[105574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-77ad0a7b-9605-4a0e-9562-381b351af4a0 1073741824 Sep 18 21:52:56 devstack sudo[105574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:56 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f32e51e8-7fcc-47e9-9e84-575d14e6bb0e tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba6a171b-b573-4115-b68d-b8b1be9d47af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:52:56 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-f32e51e8-7fcc-47e9-9e84-575d14e6bb0e tempest-ProjectMemberTests-864505458 None] Volume volume-24315cb1-5b91-481e-84d8-d0acf8c45945 (24315cb1-5b91-481e-84d8-d0acf8c45945): created successfully Sep 18 21:52:56 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f32e51e8-7fcc-47e9-9e84-575d14e6bb0e tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba6a171b-b573-4115-b68d-b8b1be9d47af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:52:56 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-f32e51e8-7fcc-47e9-9e84-575d14e6bb0e tempest-ProjectMemberTests-864505458 None] Flow 'volume_create_manager' (8118862d-da52-4397-979b-3e603bd24cff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:52:56 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-f32e51e8-7fcc-47e9-9e84-575d14e6bb0e tempest-ProjectMemberTests-864505458 None] Created volume successfully. Sep 18 21:52:56 devstack sudo[105574]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-b256451a-bc19-4e59-8069-6bddd6a70280 tempest-ProjectReaderTests-1915593202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-77ad0a7b-9605-4a0e-9562-381b351af4a0 1073741824" returned: 0 in 0.443s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-b256451a-bc19-4e59-8069-6bddd6a70280 tempest-ProjectReaderTests-1915593202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-77ad0a7b-9605-4a0e-9562-381b351af4a0 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:56 devstack sudo[105580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-77ad0a7b-9605-4a0e-9562-381b351af4a0 Sep 18 21:52:56 devstack sudo[105580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:56 devstack sudo[105580]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-b256451a-bc19-4e59-8069-6bddd6a70280 tempest-ProjectReaderTests-1915593202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-77ad0a7b-9605-4a0e-9562-381b351af4a0" returned: 0 in 0.239s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:56 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-b256451a-bc19-4e59-8069-6bddd6a70280 tempest-ProjectReaderTests-1915593202 None] <== create_volume: return (721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:52:56 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-b256451a-bc19-4e59-8069-6bddd6a70280 tempest-ProjectReaderTests-1915593202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:52:56 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b256451a-bc19-4e59-8069-6bddd6a70280 tempest-ProjectReaderTests-1915593202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (393545e3-a268-4b2e-b11e-2920c22095e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77ad0a7b-9605-4a0e-9562-381b351af4a0', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:52:57 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b256451a-bc19-4e59-8069-6bddd6a70280 tempest-ProjectReaderTests-1915593202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe03866c-4561-494d-ad0d-2bff3cf4ad0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:52:57 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-b256451a-bc19-4e59-8069-6bddd6a70280 tempest-ProjectReaderTests-1915593202 None] Volume volume-77ad0a7b-9605-4a0e-9562-381b351af4a0 (77ad0a7b-9605-4a0e-9562-381b351af4a0): created successfully Sep 18 21:52:57 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b256451a-bc19-4e59-8069-6bddd6a70280 tempest-ProjectReaderTests-1915593202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe03866c-4561-494d-ad0d-2bff3cf4ad0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:52:57 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-b256451a-bc19-4e59-8069-6bddd6a70280 tempest-ProjectReaderTests-1915593202 None] Flow 'volume_create_manager' (004c5451-3965-4167-a422-a9cf58b5da80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:52:57 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-b256451a-bc19-4e59-8069-6bddd6a70280 tempest-ProjectReaderTests-1915593202 None] Created volume successfully. Sep 18 21:52:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-e501c8cc-f265-4485-a588-6d4b0053e344 tempest-ProjectMemberTests-864505458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:52:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-e501c8cc-f265-4485-a588-6d4b0053e344 tempest-ProjectMemberTests-864505458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:52:57 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-e501c8cc-f265-4485-a588-6d4b0053e344 tempest-ProjectMemberTests-864505458 None] Creating offline snapshot 9b7cb7a9-4c18-4a89-96df-c19f6bc10188 of volume 24315cb1-5b91-481e-84d8-d0acf8c45945 {{(pid=86136) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 21:52:57 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab49241-3c4d-4bb3-b209-ea8d2d6b5379]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:52:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e501c8cc-f265-4485-a588-6d4b0053e344 tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-24315cb1-5b91-481e-84d8-d0acf8c45945 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:57 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-3d646cee-3d48-4714-a280-5c200a0453fe tempest-ProjectReaderTests-1915593202 None] Acquiring lock "cinder-77ad0a7b-9605-4a0e-9562-381b351af4a0-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:52:57 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-3d646cee-3d48-4714-a280-5c200a0453fe tempest-ProjectReaderTests-1915593202 None] Lock "cinder-77ad0a7b-9605-4a0e-9562-381b351af4a0-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:52:57 devstack sudo[105583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-24315cb1-5b91-481e-84d8-d0acf8c45945 Sep 18 21:52:57 devstack sudo[105583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:57 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-3d646cee-3d48-4714-a280-5c200a0453fe tempest-ProjectReaderTests-1915593202 None] Acquiring lock "cinder-quobyte-77ad0a7b-9605-4a0e-9562-381b351af4a0" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:52:57 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-3d646cee-3d48-4714-a280-5c200a0453fe tempest-ProjectReaderTests-1915593202 None] Lock "cinder-quobyte-77ad0a7b-9605-4a0e-9562-381b351af4a0" acquired by "delete_volume" :: waited 0.015s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:52:57 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fcc7852-ce25-4dda-8670-ec500dbb0034]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:52:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3d646cee-3d48-4714-a280-5c200a0453fe tempest-ProjectReaderTests-1915593202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-77ad0a7b-9605-4a0e-9562-381b351af4a0 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:57 devstack sudo[105585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-77ad0a7b-9605-4a0e-9562-381b351af4a0 Sep 18 21:52:57 devstack sudo[105585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:57 devstack sudo[105583]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e501c8cc-f265-4485-a588-6d4b0053e344 tempest-ProjectMemberTests-864505458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-24315cb1-5b91-481e-84d8-d0acf8c45945" returned: 0 in 0.363s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:57 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e501c8cc-f265-4485-a588-6d4b0053e344 tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-24315cb1-5b91-481e-84d8-d0acf8c45945,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-24315cb1-5b91-481e-84d8-d0acf8c45945.9b7cb7a9-4c18-4a89-96df-c19f6bc10188 1G {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:57 devstack sudo[105590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-24315cb1-5b91-481e-84d8-d0acf8c45945,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-24315cb1-5b91-481e-84d8-d0acf8c45945.9b7cb7a9-4c18-4a89-96df-c19f6bc10188 1G Sep 18 21:52:57 devstack sudo[105590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:58 devstack sudo[105585]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3d646cee-3d48-4714-a280-5c200a0453fe tempest-ProjectReaderTests-1915593202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-77ad0a7b-9605-4a0e-9562-381b351af4a0" returned: 0 in 0.377s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3d646cee-3d48-4714-a280-5c200a0453fe tempest-ProjectReaderTests-1915593202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-77ad0a7b-9605-4a0e-9562-381b351af4a0 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:58 devstack sudo[105595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-77ad0a7b-9605-4a0e-9562-381b351af4a0 Sep 18 21:52:58 devstack sudo[105595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:58 devstack sudo[105590]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e501c8cc-f265-4485-a588-6d4b0053e344 tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-24315cb1-5b91-481e-84d8-d0acf8c45945,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-24315cb1-5b91-481e-84d8-d0acf8c45945.9b7cb7a9-4c18-4a89-96df-c19f6bc10188 1G" returned: 0 in 0.396s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e501c8cc-f265-4485-a588-6d4b0053e344 tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24315cb1-5b91-481e-84d8-d0acf8c45945 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-24315cb1-5b91-481e-84d8-d0acf8c45945.9b7cb7a9-4c18-4a89-96df-c19f6bc10188 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:58 devstack sudo[105595]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:58 devstack sudo[105601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24315cb1-5b91-481e-84d8-d0acf8c45945 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-24315cb1-5b91-481e-84d8-d0acf8c45945.9b7cb7a9-4c18-4a89-96df-c19f6bc10188 Sep 18 21:52:58 devstack sudo[105601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3d646cee-3d48-4714-a280-5c200a0453fe tempest-ProjectReaderTests-1915593202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-77ad0a7b-9605-4a0e-9562-381b351af4a0" returned: 0 in 0.259s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:58 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-3d646cee-3d48-4714-a280-5c200a0453fe tempest-ProjectReaderTests-1915593202 None] Lock "cinder-quobyte-77ad0a7b-9605-4a0e-9562-381b351af4a0" released by "delete_volume" :: held 0.680s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:52:58 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-3d646cee-3d48-4714-a280-5c200a0453fe tempest-ProjectReaderTests-1915593202 None] Created reservations ['b4f20b04-3e3c-4ddd-9ec5-6c5f5279784d', '1be487e6-d9f8-4db1-af10-ff557406eb4f', 'ccc72430-40d7-4557-b519-94fc8160db54', '1bcfe732-c94b-4193-92ec-3987949adb82'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:52:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-3d646cee-3d48-4714-a280-5c200a0453fe tempest-ProjectReaderTests-1915593202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:52:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-3d646cee-3d48-4714-a280-5c200a0453fe tempest-ProjectReaderTests-1915593202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:52:58 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-3d646cee-3d48-4714-a280-5c200a0453fe tempest-ProjectReaderTests-1915593202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:52:58 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-3d646cee-3d48-4714-a280-5c200a0453fe tempest-ProjectReaderTests-1915593202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:52:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-3d646cee-3d48-4714-a280-5c200a0453fe tempest-ProjectReaderTests-1915593202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:52:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3d646cee-3d48-4714-a280-5c200a0453fe tempest-ProjectReaderTests-1915593202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:58 devstack sudo[105603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:52:58 devstack sudo[105603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:58 devstack sudo[105601]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e501c8cc-f265-4485-a588-6d4b0053e344 tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24315cb1-5b91-481e-84d8-d0acf8c45945 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-24315cb1-5b91-481e-84d8-d0acf8c45945.9b7cb7a9-4c18-4a89-96df-c19f6bc10188" returned: 0 in 0.295s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:58 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-e501c8cc-f265-4485-a588-6d4b0053e344 tempest-ProjectMemberTests-864505458 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-24315cb1-5b91-481e-84d8-d0acf8c45945.9b7cb7a9-4c18-4a89-96df-c19f6bc10188 is being set with open permissions: ugo+rw Sep 18 21:52:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e501c8cc-f265-4485-a588-6d4b0053e344 tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-24315cb1-5b91-481e-84d8-d0acf8c45945.9b7cb7a9-4c18-4a89-96df-c19f6bc10188 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:58 devstack sudo[105608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-24315cb1-5b91-481e-84d8-d0acf8c45945.9b7cb7a9-4c18-4a89-96df-c19f6bc10188 Sep 18 21:52:58 devstack sudo[105608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:58 devstack sudo[105603]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3d646cee-3d48-4714-a280-5c200a0453fe tempest-ProjectReaderTests-1915593202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.273s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:58 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-3d646cee-3d48-4714-a280-5c200a0453fe tempest-ProjectReaderTests-1915593202 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:52:58 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-3d646cee-3d48-4714-a280-5c200a0453fe tempest-ProjectReaderTests-1915593202 None] Deleted volume successfully. Sep 18 21:52:58 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-3d646cee-3d48-4714-a280-5c200a0453fe tempest-ProjectReaderTests-1915593202 None] Lock "cinder-77ad0a7b-9605-4a0e-9562-381b351af4a0-delete_volume" released by "delete_volume" :: held 1.174s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:52:58 devstack sudo[105608]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e501c8cc-f265-4485-a588-6d4b0053e344 tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-24315cb1-5b91-481e-84d8-d0acf8c45945.9b7cb7a9-4c18-4a89-96df-c19f6bc10188" returned: 0 in 0.246s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:58 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e501c8cc-f265-4485-a588-6d4b0053e344 tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-24315cb1-5b91-481e-84d8-d0acf8c45945.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:58 devstack sudo[105612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-24315cb1-5b91-481e-84d8-d0acf8c45945.info Sep 18 21:52:58 devstack sudo[105612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:59 devstack sudo[105612]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e501c8cc-f265-4485-a588-6d4b0053e344 tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-24315cb1-5b91-481e-84d8-d0acf8c45945.info" returned: 0 in 0.259s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:59 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-e501c8cc-f265-4485-a588-6d4b0053e344 tempest-ProjectMemberTests-864505458 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-24315cb1-5b91-481e-84d8-d0acf8c45945.info is being set with open permissions: ugo+rw Sep 18 21:52:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e501c8cc-f265-4485-a588-6d4b0053e344 tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-24315cb1-5b91-481e-84d8-d0acf8c45945.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:59 devstack sudo[105615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-24315cb1-5b91-481e-84d8-d0acf8c45945.info Sep 18 21:52:59 devstack sudo[105615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:59 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ddb1b25-7295-4e37-9560-41e28956abb5 tempest-ProjectReaderTests-1915593202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:52:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-5ddb1b25-7295-4e37-9560-41e28956abb5 tempest-ProjectReaderTests-1915593202 None] Flow 'volume_create_manager' (180db989-da04-452c-bcd3-54fea70182b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:52:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-5ddb1b25-7295-4e37-9560-41e28956abb5 tempest-ProjectReaderTests-1915593202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72a2190a-0806-4fb0-830a-460f1cd20dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:52:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-5ddb1b25-7295-4e37-9560-41e28956abb5 tempest-ProjectReaderTests-1915593202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72a2190a-0806-4fb0-830a-460f1cd20dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:52:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1871109704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01fefd86-ddb0-4c7a-99d6-7e35ec2286e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3c1d723082a404daad4c7e7764ea643',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:52:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:52:59Z,use_quota=True,user_id='9f21132c312d4262a7b00cfaec17f8d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:52:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-5ddb1b25-7295-4e37-9560-41e28956abb5 tempest-ProjectReaderTests-1915593202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f58d558-404d-44ec-b549-adfe283c81a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:52:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-5ddb1b25-7295-4e37-9560-41e28956abb5 tempest-ProjectReaderTests-1915593202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f58d558-404d-44ec-b549-adfe283c81a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:52:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-5ddb1b25-7295-4e37-9560-41e28956abb5 tempest-ProjectReaderTests-1915593202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6bd3936-3f59-4cc1-9425-e8cfa66bda24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:52:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-5ddb1b25-7295-4e37-9560-41e28956abb5 tempest-ProjectReaderTests-1915593202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6bd3936-3f59-4cc1-9425-e8cfa66bda24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01fefd86-ddb0-4c7a-99d6-7e35ec2286e1', 'volume_name': 'volume-01fefd86-ddb0-4c7a-99d6-7e35ec2286e1', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:52:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-5ddb1b25-7295-4e37-9560-41e28956abb5 tempest-ProjectReaderTests-1915593202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4143645-e10b-449a-bbfb-cb216ab4214e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:52:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-5ddb1b25-7295-4e37-9560-41e28956abb5 tempest-ProjectReaderTests-1915593202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4143645-e10b-449a-bbfb-cb216ab4214e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:52:59 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-5ddb1b25-7295-4e37-9560-41e28956abb5 tempest-ProjectReaderTests-1915593202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (140e9b37-8345-4d29-9312-f2343bf34aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:52:59 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-5ddb1b25-7295-4e37-9560-41e28956abb5 tempest-ProjectReaderTests-1915593202 None] Volume 01fefd86-ddb0-4c7a-99d6-7e35ec2286e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01fefd86-ddb0-4c7a-99d6-7e35ec2286e1', 'volume_size': 1} Sep 18 21:52:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-5ddb1b25-7295-4e37-9560-41e28956abb5 tempest-ProjectReaderTests-1915593202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:52:59 devstack sudo[105615]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-e501c8cc-f265-4485-a588-6d4b0053e344 tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-24315cb1-5b91-481e-84d8-d0acf8c45945.info" returned: 0 in 0.256s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-e501c8cc-f265-4485-a588-6d4b0053e344 tempest-ProjectMemberTests-864505458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.907s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:52:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-5ddb1b25-7295-4e37-9560-41e28956abb5 tempest-ProjectReaderTests-1915593202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.122s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:52:59 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-5ddb1b25-7295-4e37-9560-41e28956abb5 tempest-ProjectReaderTests-1915593202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:52:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1871109704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01fefd86-ddb0-4c7a-99d6-7e35ec2286e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3c1d723082a404daad4c7e7764ea643',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:52:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:52:59Z,use_quota=True,user_id='9f21132c312d4262a7b00cfaec17f8d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:52:59 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-5ddb1b25-7295-4e37-9560-41e28956abb5 tempest-ProjectReaderTests-1915593202 None] Creating volume 01fefd86-ddb0-4c7a-99d6-7e35ec2286e1 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:52:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-5ddb1b25-7295-4e37-9560-41e28956abb5 tempest-ProjectReaderTests-1915593202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:52:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-5ddb1b25-7295-4e37-9560-41e28956abb5 tempest-ProjectReaderTests-1915593202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:52:59 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-5ddb1b25-7295-4e37-9560-41e28956abb5 tempest-ProjectReaderTests-1915593202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:52:59 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-5ddb1b25-7295-4e37-9560-41e28956abb5 tempest-ProjectReaderTests-1915593202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:52:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-5ddb1b25-7295-4e37-9560-41e28956abb5 tempest-ProjectReaderTests-1915593202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:52:59 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-5ddb1b25-7295-4e37-9560-41e28956abb5 tempest-ProjectReaderTests-1915593202 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:52:59 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-5ddb1b25-7295-4e37-9560-41e28956abb5 tempest-ProjectReaderTests-1915593202 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:52:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5ddb1b25-7295-4e37-9560-41e28956abb5 tempest-ProjectReaderTests-1915593202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-01fefd86-ddb0-4c7a-99d6-7e35ec2286e1 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:59 devstack sudo[105618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-01fefd86-ddb0-4c7a-99d6-7e35ec2286e1 1073741824 Sep 18 21:52:59 devstack sudo[105618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:59 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-e501c8cc-f265-4485-a588-6d4b0053e344 tempest-ProjectMemberTests-864505458 None] Create snapshot completed successfully Sep 18 21:52:59 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-31f562ad-dd38-4797-ba69-dba1c516b990 tempest-ProjectMemberTests-864505458 None] Acquiring lock "cinder-9b7cb7a9-4c18-4a89-96df-c19f6bc10188-delete_snapshot" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:52:59 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-31f562ad-dd38-4797-ba69-dba1c516b990 tempest-ProjectMemberTests-864505458 None] Lock "cinder-9b7cb7a9-4c18-4a89-96df-c19f6bc10188-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:52:59 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-31f562ad-dd38-4797-ba69-dba1c516b990 tempest-ProjectMemberTests-864505458 None] Acquiring lock "cinder-quobyte-24315cb1-5b91-481e-84d8-d0acf8c45945" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:52:59 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-31f562ad-dd38-4797-ba69-dba1c516b990 tempest-ProjectMemberTests-864505458 None] Lock "cinder-quobyte-24315cb1-5b91-481e-84d8-d0acf8c45945" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:52:59 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-31f562ad-dd38-4797-ba69-dba1c516b990 tempest-ProjectMemberTests-864505458 None] Acquiring lock "cinder-quobyte-9b7cb7a9-4c18-4a89-96df-c19f6bc10188" by "_delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:52:59 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-31f562ad-dd38-4797-ba69-dba1c516b990 tempest-ProjectMemberTests-864505458 None] Lock "cinder-quobyte-9b7cb7a9-4c18-4a89-96df-c19f6bc10188" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:52:59 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-31f562ad-dd38-4797-ba69-dba1c516b990 tempest-ProjectMemberTests-864505458 None] Deleting offline snapshot 9b7cb7a9-4c18-4a89-96df-c19f6bc10188 of volume 24315cb1-5b91-481e-84d8-d0acf8c45945 {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 21:52:59 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-31f562ad-dd38-4797-ba69-dba1c516b990 tempest-ProjectMemberTests-864505458 None] snapshot_file for this snap is: volume-24315cb1-5b91-481e-84d8-d0acf8c45945.9b7cb7a9-4c18-4a89-96df-c19f6bc10188 {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 21:52:59 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bee9458-ebe4-40f7-8ed2-618097aab608]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:52:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-31f562ad-dd38-4797-ba69-dba1c516b990 tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-24315cb1-5b91-481e-84d8-d0acf8c45945.9b7cb7a9-4c18-4a89-96df-c19f6bc10188 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:59 devstack sudo[105623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-24315cb1-5b91-481e-84d8-d0acf8c45945.9b7cb7a9-4c18-4a89-96df-c19f6bc10188 Sep 18 21:52:59 devstack sudo[105623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:52:59 devstack sudo[105618]: pam_unix(sudo:session): session closed for user root Sep 18 21:52:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5ddb1b25-7295-4e37-9560-41e28956abb5 tempest-ProjectReaderTests-1915593202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-01fefd86-ddb0-4c7a-99d6-7e35ec2286e1 1073741824" returned: 0 in 0.454s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:52:59 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5ddb1b25-7295-4e37-9560-41e28956abb5 tempest-ProjectReaderTests-1915593202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-01fefd86-ddb0-4c7a-99d6-7e35ec2286e1 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:52:59 devstack sudo[105625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-01fefd86-ddb0-4c7a-99d6-7e35ec2286e1 Sep 18 21:52:59 devstack sudo[105625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:53:00 devstack sudo[105623]: pam_unix(sudo:session): session closed for user root Sep 18 21:53:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-31f562ad-dd38-4797-ba69-dba1c516b990 tempest-ProjectMemberTests-864505458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-24315cb1-5b91-481e-84d8-d0acf8c45945.9b7cb7a9-4c18-4a89-96df-c19f6bc10188" returned: 0 in 0.376s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:53:00 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-31f562ad-dd38-4797-ba69-dba1c516b990 tempest-ProjectMemberTests-864505458 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-24315cb1-5b91-481e-84d8-d0acf8c45945(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86136) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 21:53:00 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6e74c9-bd49-4564-a457-8e1822636f25]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:53:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-31f562ad-dd38-4797-ba69-dba1c516b990 tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-24315cb1-5b91-481e-84d8-d0acf8c45945 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:53:00 devstack sudo[105625]: pam_unix(sudo:session): session closed for user root Sep 18 21:53:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-5ddb1b25-7295-4e37-9560-41e28956abb5 tempest-ProjectReaderTests-1915593202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-01fefd86-ddb0-4c7a-99d6-7e35ec2286e1" returned: 0 in 0.270s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:53:00 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-5ddb1b25-7295-4e37-9560-41e28956abb5 tempest-ProjectReaderTests-1915593202 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:53:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-5ddb1b25-7295-4e37-9560-41e28956abb5 tempest-ProjectReaderTests-1915593202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:53:00 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-5ddb1b25-7295-4e37-9560-41e28956abb5 tempest-ProjectReaderTests-1915593202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (140e9b37-8345-4d29-9312-f2343bf34aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01fefd86-ddb0-4c7a-99d6-7e35ec2286e1', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:53:00 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-5ddb1b25-7295-4e37-9560-41e28956abb5 tempest-ProjectReaderTests-1915593202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e87a6399-9c2a-4d17-862c-226fe28f6bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:53:00 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-5ddb1b25-7295-4e37-9560-41e28956abb5 tempest-ProjectReaderTests-1915593202 None] Volume volume-01fefd86-ddb0-4c7a-99d6-7e35ec2286e1 (01fefd86-ddb0-4c7a-99d6-7e35ec2286e1): created successfully Sep 18 21:53:00 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-5ddb1b25-7295-4e37-9560-41e28956abb5 tempest-ProjectReaderTests-1915593202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e87a6399-9c2a-4d17-862c-226fe28f6bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:53:00 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-5ddb1b25-7295-4e37-9560-41e28956abb5 tempest-ProjectReaderTests-1915593202 None] Flow 'volume_create_manager' (180db989-da04-452c-bcd3-54fea70182b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:53:00 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-5ddb1b25-7295-4e37-9560-41e28956abb5 tempest-ProjectReaderTests-1915593202 None] Created volume successfully. Sep 18 21:53:00 devstack sudo[105631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-24315cb1-5b91-481e-84d8-d0acf8c45945 Sep 18 21:53:00 devstack sudo[105631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:53:00 devstack sudo[105631]: pam_unix(sudo:session): session closed for user root Sep 18 21:53:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-31f562ad-dd38-4797-ba69-dba1c516b990 tempest-ProjectMemberTests-864505458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-24315cb1-5b91-481e-84d8-d0acf8c45945" returned: 0 in 0.357s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:53:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-31f562ad-dd38-4797-ba69-dba1c516b990 tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-24315cb1-5b91-481e-84d8-d0acf8c45945.9b7cb7a9-4c18-4a89-96df-c19f6bc10188 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:53:00 devstack sudo[105636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-24315cb1-5b91-481e-84d8-d0acf8c45945.9b7cb7a9-4c18-4a89-96df-c19f6bc10188 Sep 18 21:53:00 devstack sudo[105636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:53:00 devstack sudo[105636]: pam_unix(sudo:session): session closed for user root Sep 18 21:53:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-31f562ad-dd38-4797-ba69-dba1c516b990 tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-24315cb1-5b91-481e-84d8-d0acf8c45945.9b7cb7a9-4c18-4a89-96df-c19f6bc10188" returned: 0 in 0.333s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:53:00 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-31f562ad-dd38-4797-ba69-dba1c516b990 tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-24315cb1-5b91-481e-84d8-d0acf8c45945.9b7cb7a9-4c18-4a89-96df-c19f6bc10188 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:53:00 devstack sudo[105642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-24315cb1-5b91-481e-84d8-d0acf8c45945.9b7cb7a9-4c18-4a89-96df-c19f6bc10188 Sep 18 21:53:00 devstack sudo[105642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:53:01 devstack sudo[105642]: pam_unix(sudo:session): session closed for user root Sep 18 21:53:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-31f562ad-dd38-4797-ba69-dba1c516b990 tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-24315cb1-5b91-481e-84d8-d0acf8c45945.9b7cb7a9-4c18-4a89-96df-c19f6bc10188" returned: 0 in 0.248s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:53:01 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-31f562ad-dd38-4797-ba69-dba1c516b990 tempest-ProjectMemberTests-864505458 None] Lock "cinder-quobyte-9b7cb7a9-4c18-4a89-96df-c19f6bc10188" released by "_delete_snapshot" :: held 1.427s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:53:01 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-31f562ad-dd38-4797-ba69-dba1c516b990 tempest-ProjectMemberTests-864505458 None] Lock "cinder-quobyte-24315cb1-5b91-481e-84d8-d0acf8c45945" released by "delete_snapshot" :: held 1.451s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:53:01 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-31f562ad-dd38-4797-ba69-dba1c516b990 tempest-ProjectMemberTests-864505458 None] Created reservations ['b42499ff-eb84-474e-9a30-02ef08dcd431', '63db08f6-37fc-4297-be90-64d5c1999c37', '938abcae-7f71-495f-9eb9-c744e4b20e13', '7f0b7b1b-cde4-4a16-aca0-29bd68f7d813'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:53:01 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-31f562ad-dd38-4797-ba69-dba1c516b990 tempest-ProjectMemberTests-864505458 None] Delete snapshot completed successfully. Sep 18 21:53:01 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-31f562ad-dd38-4797-ba69-dba1c516b990 tempest-ProjectMemberTests-864505458 None] Lock "cinder-9b7cb7a9-4c18-4a89-96df-c19f6bc10188-delete_snapshot" released by "delete_snapshot" :: held 1.588s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:53:01 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-bf8b7281-22cc-4a06-95aa-ba7737b6ea40 tempest-ProjectReaderTests-1915593202 None] Acquiring lock "cinder-01fefd86-ddb0-4c7a-99d6-7e35ec2286e1-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:53:01 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-bf8b7281-22cc-4a06-95aa-ba7737b6ea40 tempest-ProjectReaderTests-1915593202 None] Lock "cinder-01fefd86-ddb0-4c7a-99d6-7e35ec2286e1-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:53:01 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-bf8b7281-22cc-4a06-95aa-ba7737b6ea40 tempest-ProjectReaderTests-1915593202 None] Acquiring lock "cinder-quobyte-01fefd86-ddb0-4c7a-99d6-7e35ec2286e1" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:53:01 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-bf8b7281-22cc-4a06-95aa-ba7737b6ea40 tempest-ProjectReaderTests-1915593202 None] Lock "cinder-quobyte-01fefd86-ddb0-4c7a-99d6-7e35ec2286e1" acquired by "delete_volume" :: waited 0.013s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:53:01 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3a1c7d-ec37-4e85-af6a-eb94b7671e5f]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:53:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-bf8b7281-22cc-4a06-95aa-ba7737b6ea40 tempest-ProjectReaderTests-1915593202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-01fefd86-ddb0-4c7a-99d6-7e35ec2286e1 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:53:01 devstack sudo[105645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-01fefd86-ddb0-4c7a-99d6-7e35ec2286e1 Sep 18 21:53:01 devstack sudo[105645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:53:01 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-b70efece-436b-45a1-be47-9aaf3cd803e2 tempest-ProjectMemberTests-864505458 None] Acquiring lock "cinder-24315cb1-5b91-481e-84d8-d0acf8c45945-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:53:01 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-b70efece-436b-45a1-be47-9aaf3cd803e2 tempest-ProjectMemberTests-864505458 None] Lock "cinder-24315cb1-5b91-481e-84d8-d0acf8c45945-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:53:01 devstack sudo[105645]: pam_unix(sudo:session): session closed for user root Sep 18 21:53:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-bf8b7281-22cc-4a06-95aa-ba7737b6ea40 tempest-ProjectReaderTests-1915593202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-01fefd86-ddb0-4c7a-99d6-7e35ec2286e1" returned: 0 in 0.410s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:53:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-bf8b7281-22cc-4a06-95aa-ba7737b6ea40 tempest-ProjectReaderTests-1915593202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-01fefd86-ddb0-4c7a-99d6-7e35ec2286e1 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:53:01 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-b70efece-436b-45a1-be47-9aaf3cd803e2 tempest-ProjectMemberTests-864505458 None] Acquiring lock "cinder-quobyte-24315cb1-5b91-481e-84d8-d0acf8c45945" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:53:01 devstack sudo[105650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-01fefd86-ddb0-4c7a-99d6-7e35ec2286e1 Sep 18 21:53:01 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-b70efece-436b-45a1-be47-9aaf3cd803e2 tempest-ProjectMemberTests-864505458 None] Lock "cinder-quobyte-24315cb1-5b91-481e-84d8-d0acf8c45945" acquired by "delete_volume" :: waited 0.017s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:53:01 devstack sudo[105650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:53:01 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[2754f854-fbc8-4953-b127-18d1c37fa939]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:53:01 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-b70efece-436b-45a1-be47-9aaf3cd803e2 tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-24315cb1-5b91-481e-84d8-d0acf8c45945 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:53:02 devstack sudo[105652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-24315cb1-5b91-481e-84d8-d0acf8c45945 Sep 18 21:53:02 devstack sudo[105652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:53:02 devstack sudo[105650]: pam_unix(sudo:session): session closed for user root Sep 18 21:53:02 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-bf8b7281-22cc-4a06-95aa-ba7737b6ea40 tempest-ProjectReaderTests-1915593202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-01fefd86-ddb0-4c7a-99d6-7e35ec2286e1" returned: 0 in 0.268s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:53:02 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-bf8b7281-22cc-4a06-95aa-ba7737b6ea40 tempest-ProjectReaderTests-1915593202 None] Lock "cinder-quobyte-01fefd86-ddb0-4c7a-99d6-7e35ec2286e1" released by "delete_volume" :: held 0.719s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:53:02 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-bf8b7281-22cc-4a06-95aa-ba7737b6ea40 tempest-ProjectReaderTests-1915593202 None] Created reservations ['07547bff-40fe-4ebc-9682-1ab2d45a1aba', 'ee7f76e6-e3bd-4109-9840-3ba8cab4594e', 'c3c32c1b-2a56-4676-aaac-010ba3a229f2', '31363038-ea08-4536-ad90-c6285cb5fdcb'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:53:02 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-bf8b7281-22cc-4a06-95aa-ba7737b6ea40 tempest-ProjectReaderTests-1915593202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:53:02 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-bf8b7281-22cc-4a06-95aa-ba7737b6ea40 tempest-ProjectReaderTests-1915593202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:53:02 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-bf8b7281-22cc-4a06-95aa-ba7737b6ea40 tempest-ProjectReaderTests-1915593202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:53:02 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-bf8b7281-22cc-4a06-95aa-ba7737b6ea40 tempest-ProjectReaderTests-1915593202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:53:02 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-bf8b7281-22cc-4a06-95aa-ba7737b6ea40 tempest-ProjectReaderTests-1915593202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:53:02 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-bf8b7281-22cc-4a06-95aa-ba7737b6ea40 tempest-ProjectReaderTests-1915593202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:53:02 devstack sudo[105657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:53:02 devstack sudo[105657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:53:02 devstack sudo[105652]: pam_unix(sudo:session): session closed for user root Sep 18 21:53:02 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-b70efece-436b-45a1-be47-9aaf3cd803e2 tempest-ProjectMemberTests-864505458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-24315cb1-5b91-481e-84d8-d0acf8c45945" returned: 0 in 0.398s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:53:02 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-b70efece-436b-45a1-be47-9aaf3cd803e2 tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-24315cb1-5b91-481e-84d8-d0acf8c45945 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:53:02 devstack sudo[105660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-24315cb1-5b91-481e-84d8-d0acf8c45945 Sep 18 21:53:02 devstack sudo[105660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:53:02 devstack sudo[105657]: pam_unix(sudo:session): session closed for user root Sep 18 21:53:02 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-bf8b7281-22cc-4a06-95aa-ba7737b6ea40 tempest-ProjectReaderTests-1915593202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.258s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:53:02 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-bf8b7281-22cc-4a06-95aa-ba7737b6ea40 tempest-ProjectReaderTests-1915593202 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:53:02 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-bf8b7281-22cc-4a06-95aa-ba7737b6ea40 tempest-ProjectReaderTests-1915593202 None] Deleted volume successfully. Sep 18 21:53:02 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-bf8b7281-22cc-4a06-95aa-ba7737b6ea40 tempest-ProjectReaderTests-1915593202 None] Lock "cinder-01fefd86-ddb0-4c7a-99d6-7e35ec2286e1-delete_volume" released by "delete_volume" :: held 1.180s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:53:02 devstack sudo[105660]: pam_unix(sudo:session): session closed for user root Sep 18 21:53:02 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-b70efece-436b-45a1-be47-9aaf3cd803e2 tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-24315cb1-5b91-481e-84d8-d0acf8c45945" returned: 0 in 0.265s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:53:02 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-b70efece-436b-45a1-be47-9aaf3cd803e2 tempest-ProjectMemberTests-864505458 None] Lock "cinder-quobyte-24315cb1-5b91-481e-84d8-d0acf8c45945" released by "delete_volume" :: held 0.733s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:53:02 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-b70efece-436b-45a1-be47-9aaf3cd803e2 tempest-ProjectMemberTests-864505458 None] Created reservations ['9ede90e6-8fb5-40dd-b2e0-e21ff9a6dfb6', '10f53113-3ab7-453c-a39d-ad5fdbab0abb', '9925cdaf-23ea-414d-b90f-34bef6ada6d9', '9135e6ae-0c8e-473c-87ea-6a72c72a2725'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:53:02 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-b70efece-436b-45a1-be47-9aaf3cd803e2 tempest-ProjectMemberTests-864505458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:53:02 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-b70efece-436b-45a1-be47-9aaf3cd803e2 tempest-ProjectMemberTests-864505458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:53:02 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-b70efece-436b-45a1-be47-9aaf3cd803e2 tempest-ProjectMemberTests-864505458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:53:02 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-b70efece-436b-45a1-be47-9aaf3cd803e2 tempest-ProjectMemberTests-864505458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:53:02 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-b70efece-436b-45a1-be47-9aaf3cd803e2 tempest-ProjectMemberTests-864505458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:53:02 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-b70efece-436b-45a1-be47-9aaf3cd803e2 tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:53:02 devstack sudo[105664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:53:02 devstack sudo[105664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:53:03 devstack sudo[105664]: pam_unix(sudo:session): session closed for user root Sep 18 21:53:03 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fc8cfa3-585a-4cf3-b244-a15635641da9 tempest-ProjectReaderTests-1915593202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:53:03 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-0fc8cfa3-585a-4cf3-b244-a15635641da9 tempest-ProjectReaderTests-1915593202 None] Flow 'volume_create_manager' (92de849e-e6c7-421f-bff2-4d5ced2ace23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:53:03 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-0fc8cfa3-585a-4cf3-b244-a15635641da9 tempest-ProjectReaderTests-1915593202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31780d86-5b1a-4aa6-8538-8883adbd2858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:53:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-b70efece-436b-45a1-be47-9aaf3cd803e2 tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.304s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:53:03 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-b70efece-436b-45a1-be47-9aaf3cd803e2 tempest-ProjectMemberTests-864505458 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:53:03 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-b70efece-436b-45a1-be47-9aaf3cd803e2 tempest-ProjectMemberTests-864505458 None] Deleted volume successfully. Sep 18 21:53:03 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-0fc8cfa3-585a-4cf3-b244-a15635641da9 tempest-ProjectReaderTests-1915593202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31780d86-5b1a-4aa6-8538-8883adbd2858) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:53:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-874260161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=310119c3-13f5-4f5c-ba34-33c1f9d376ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3c1d723082a404daad4c7e7764ea643',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:53:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:53:03Z,use_quota=True,user_id='9f21132c312d4262a7b00cfaec17f8d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:53:03 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-0fc8cfa3-585a-4cf3-b244-a15635641da9 tempest-ProjectReaderTests-1915593202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a745e1a3-6ff3-49b6-a8c2-7e1550704e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:53:03 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-0fc8cfa3-585a-4cf3-b244-a15635641da9 tempest-ProjectReaderTests-1915593202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a745e1a3-6ff3-49b6-a8c2-7e1550704e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:53:03 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-0fc8cfa3-585a-4cf3-b244-a15635641da9 tempest-ProjectReaderTests-1915593202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (153c5306-3269-483c-8365-eb58ffe0991f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:53:03 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-0fc8cfa3-585a-4cf3-b244-a15635641da9 tempest-ProjectReaderTests-1915593202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (153c5306-3269-483c-8365-eb58ffe0991f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '310119c3-13f5-4f5c-ba34-33c1f9d376ad', 'volume_name': 'volume-310119c3-13f5-4f5c-ba34-33c1f9d376ad', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:53:03 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-0fc8cfa3-585a-4cf3-b244-a15635641da9 tempest-ProjectReaderTests-1915593202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02b5c61b-1017-4eb5-8e08-e67710e31f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:53:03 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-0fc8cfa3-585a-4cf3-b244-a15635641da9 tempest-ProjectReaderTests-1915593202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02b5c61b-1017-4eb5-8e08-e67710e31f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:53:03 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-0fc8cfa3-585a-4cf3-b244-a15635641da9 tempest-ProjectReaderTests-1915593202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56f62247-76fc-47da-bdd7-e4a2697e2236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:53:03 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-0fc8cfa3-585a-4cf3-b244-a15635641da9 tempest-ProjectReaderTests-1915593202 None] Volume 310119c3-13f5-4f5c-ba34-33c1f9d376ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-310119c3-13f5-4f5c-ba34-33c1f9d376ad', 'volume_size': 1} Sep 18 21:53:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-0fc8cfa3-585a-4cf3-b244-a15635641da9 tempest-ProjectReaderTests-1915593202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:53:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-0fc8cfa3-585a-4cf3-b244-a15635641da9 tempest-ProjectReaderTests-1915593202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:53:03 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-0fc8cfa3-585a-4cf3-b244-a15635641da9 tempest-ProjectReaderTests-1915593202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:53:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-874260161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=310119c3-13f5-4f5c-ba34-33c1f9d376ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3c1d723082a404daad4c7e7764ea643',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:53:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:53:03Z,use_quota=True,user_id='9f21132c312d4262a7b00cfaec17f8d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:53:03 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-0fc8cfa3-585a-4cf3-b244-a15635641da9 tempest-ProjectReaderTests-1915593202 None] Creating volume 310119c3-13f5-4f5c-ba34-33c1f9d376ad {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:53:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-0fc8cfa3-585a-4cf3-b244-a15635641da9 tempest-ProjectReaderTests-1915593202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:53:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-0fc8cfa3-585a-4cf3-b244-a15635641da9 tempest-ProjectReaderTests-1915593202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:53:03 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-0fc8cfa3-585a-4cf3-b244-a15635641da9 tempest-ProjectReaderTests-1915593202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:53:03 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-0fc8cfa3-585a-4cf3-b244-a15635641da9 tempest-ProjectReaderTests-1915593202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:53:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-0fc8cfa3-585a-4cf3-b244-a15635641da9 tempest-ProjectReaderTests-1915593202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:53:03 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-0fc8cfa3-585a-4cf3-b244-a15635641da9 tempest-ProjectReaderTests-1915593202 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:53:03 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-0fc8cfa3-585a-4cf3-b244-a15635641da9 tempest-ProjectReaderTests-1915593202 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:53:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0fc8cfa3-585a-4cf3-b244-a15635641da9 tempest-ProjectReaderTests-1915593202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-310119c3-13f5-4f5c-ba34-33c1f9d376ad 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:53:03 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-b70efece-436b-45a1-be47-9aaf3cd803e2 tempest-ProjectMemberTests-864505458 None] Lock "cinder-24315cb1-5b91-481e-84d8-d0acf8c45945-delete_volume" released by "delete_volume" :: held 1.338s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:53:03 devstack sudo[105667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-310119c3-13f5-4f5c-ba34-33c1f9d376ad 1073741824 Sep 18 21:53:03 devstack sudo[105667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:53:03 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-d540b03b-bed9-4500-a2f1-63ac6df1b283 tempest-ProjectMemberTests-864505458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:53:03 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d540b03b-bed9-4500-a2f1-63ac6df1b283 tempest-ProjectMemberTests-864505458 None] Flow 'volume_create_manager' (08e88b99-2da3-473f-9db0-9f66359a378c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:53:03 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d540b03b-bed9-4500-a2f1-63ac6df1b283 tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afbfd277-ec6d-43d0-a5c3-42d62a3b0899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:53:03 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d540b03b-bed9-4500-a2f1-63ac6df1b283 tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afbfd277-ec6d-43d0-a5c3-42d62a3b0899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:53:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-604451403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34b48d23-08be-4aa5-9b87-85080f0dde8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44aed77f70a242029bc978ba9aa69a78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:53:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:53:03Z,use_quota=True,user_id='fbe2b10fb8584161a20a4564db383b3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:53:03 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d540b03b-bed9-4500-a2f1-63ac6df1b283 tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (223ae01a-befd-4b33-8de0-fa9e84e3e9b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:53:03 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d540b03b-bed9-4500-a2f1-63ac6df1b283 tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (223ae01a-befd-4b33-8de0-fa9e84e3e9b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:53:03 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d540b03b-bed9-4500-a2f1-63ac6df1b283 tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4ba03bc-4067-4ae3-a26a-eedfbb4530ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:53:03 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d540b03b-bed9-4500-a2f1-63ac6df1b283 tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4ba03bc-4067-4ae3-a26a-eedfbb4530ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34b48d23-08be-4aa5-9b87-85080f0dde8a', 'volume_name': 'volume-34b48d23-08be-4aa5-9b87-85080f0dde8a', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:53:03 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d540b03b-bed9-4500-a2f1-63ac6df1b283 tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c44d7f63-d7b2-4cd3-a43b-d055659f606c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:53:03 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d540b03b-bed9-4500-a2f1-63ac6df1b283 tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c44d7f63-d7b2-4cd3-a43b-d055659f606c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:53:03 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d540b03b-bed9-4500-a2f1-63ac6df1b283 tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c8f1e12-a480-4302-a45b-9d75a326c7ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:53:03 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-d540b03b-bed9-4500-a2f1-63ac6df1b283 tempest-ProjectMemberTests-864505458 None] Volume 34b48d23-08be-4aa5-9b87-85080f0dde8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34b48d23-08be-4aa5-9b87-85080f0dde8a', 'volume_size': 1} Sep 18 21:53:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-d540b03b-bed9-4500-a2f1-63ac6df1b283 tempest-ProjectMemberTests-864505458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:53:03 devstack sudo[105667]: pam_unix(sudo:session): session closed for user root Sep 18 21:53:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0fc8cfa3-585a-4cf3-b244-a15635641da9 tempest-ProjectReaderTests-1915593202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-310119c3-13f5-4f5c-ba34-33c1f9d376ad 1073741824" returned: 0 in 0.447s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:53:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0fc8cfa3-585a-4cf3-b244-a15635641da9 tempest-ProjectReaderTests-1915593202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-310119c3-13f5-4f5c-ba34-33c1f9d376ad {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:53:03 devstack sudo[105673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-310119c3-13f5-4f5c-ba34-33c1f9d376ad Sep 18 21:53:03 devstack sudo[105673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:53:03 devstack sudo[105673]: pam_unix(sudo:session): session closed for user root Sep 18 21:53:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0fc8cfa3-585a-4cf3-b244-a15635641da9 tempest-ProjectReaderTests-1915593202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-310119c3-13f5-4f5c-ba34-33c1f9d376ad" returned: 0 in 0.248s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:53:03 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-0fc8cfa3-585a-4cf3-b244-a15635641da9 tempest-ProjectReaderTests-1915593202 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:53:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-0fc8cfa3-585a-4cf3-b244-a15635641da9 tempest-ProjectReaderTests-1915593202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:53:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-d540b03b-bed9-4500-a2f1-63ac6df1b283 tempest-ProjectMemberTests-864505458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.327s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:53:03 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-d540b03b-bed9-4500-a2f1-63ac6df1b283 tempest-ProjectMemberTests-864505458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:53:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-604451403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34b48d23-08be-4aa5-9b87-85080f0dde8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44aed77f70a242029bc978ba9aa69a78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:53:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:53:03Z,use_quota=True,user_id='fbe2b10fb8584161a20a4564db383b3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:53:03 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-d540b03b-bed9-4500-a2f1-63ac6df1b283 tempest-ProjectMemberTests-864505458 None] Creating volume 34b48d23-08be-4aa5-9b87-85080f0dde8a {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:53:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-d540b03b-bed9-4500-a2f1-63ac6df1b283 tempest-ProjectMemberTests-864505458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:53:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-d540b03b-bed9-4500-a2f1-63ac6df1b283 tempest-ProjectMemberTests-864505458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:53:03 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-d540b03b-bed9-4500-a2f1-63ac6df1b283 tempest-ProjectMemberTests-864505458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:53:03 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-d540b03b-bed9-4500-a2f1-63ac6df1b283 tempest-ProjectMemberTests-864505458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:53:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-d540b03b-bed9-4500-a2f1-63ac6df1b283 tempest-ProjectMemberTests-864505458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:53:03 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-d540b03b-bed9-4500-a2f1-63ac6df1b283 tempest-ProjectMemberTests-864505458 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:53:03 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-d540b03b-bed9-4500-a2f1-63ac6df1b283 tempest-ProjectMemberTests-864505458 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:53:03 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d540b03b-bed9-4500-a2f1-63ac6df1b283 tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-34b48d23-08be-4aa5-9b87-85080f0dde8a 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:53:03 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-0fc8cfa3-585a-4cf3-b244-a15635641da9 tempest-ProjectReaderTests-1915593202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56f62247-76fc-47da-bdd7-e4a2697e2236) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-310119c3-13f5-4f5c-ba34-33c1f9d376ad', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:53:03 devstack sudo[105676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-34b48d23-08be-4aa5-9b87-85080f0dde8a 1073741824 Sep 18 21:53:03 devstack sudo[105676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:53:03 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-0fc8cfa3-585a-4cf3-b244-a15635641da9 tempest-ProjectReaderTests-1915593202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89cd0bb0-ea88-4172-b944-20e77511fea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:53:03 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-0fc8cfa3-585a-4cf3-b244-a15635641da9 tempest-ProjectReaderTests-1915593202 None] Volume volume-310119c3-13f5-4f5c-ba34-33c1f9d376ad (310119c3-13f5-4f5c-ba34-33c1f9d376ad): created successfully Sep 18 21:53:03 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-0fc8cfa3-585a-4cf3-b244-a15635641da9 tempest-ProjectReaderTests-1915593202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89cd0bb0-ea88-4172-b944-20e77511fea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:53:03 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-0fc8cfa3-585a-4cf3-b244-a15635641da9 tempest-ProjectReaderTests-1915593202 None] Flow 'volume_create_manager' (92de849e-e6c7-421f-bff2-4d5ced2ace23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:53:04 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-0fc8cfa3-585a-4cf3-b244-a15635641da9 tempest-ProjectReaderTests-1915593202 None] Created volume successfully. Sep 18 21:53:04 devstack sudo[105676]: pam_unix(sudo:session): session closed for user root Sep 18 21:53:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d540b03b-bed9-4500-a2f1-63ac6df1b283 tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-34b48d23-08be-4aa5-9b87-85080f0dde8a 1073741824" returned: 0 in 0.408s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:53:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d540b03b-bed9-4500-a2f1-63ac6df1b283 tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-34b48d23-08be-4aa5-9b87-85080f0dde8a {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:53:04 devstack sudo[105682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-34b48d23-08be-4aa5-9b87-85080f0dde8a Sep 18 21:53:04 devstack sudo[105682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:53:04 devstack sudo[105682]: pam_unix(sudo:session): session closed for user root Sep 18 21:53:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d540b03b-bed9-4500-a2f1-63ac6df1b283 tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-34b48d23-08be-4aa5-9b87-85080f0dde8a" returned: 0 in 0.252s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:53:04 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-d540b03b-bed9-4500-a2f1-63ac6df1b283 tempest-ProjectMemberTests-864505458 None] <== create_volume: return (702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:53:04 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-d540b03b-bed9-4500-a2f1-63ac6df1b283 tempest-ProjectMemberTests-864505458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:53:04 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d540b03b-bed9-4500-a2f1-63ac6df1b283 tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c8f1e12-a480-4302-a45b-9d75a326c7ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34b48d23-08be-4aa5-9b87-85080f0dde8a', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:53:04 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d540b03b-bed9-4500-a2f1-63ac6df1b283 tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccb6f612-b89f-4ea1-aba7-488fc5a2df4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:53:04 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-d540b03b-bed9-4500-a2f1-63ac6df1b283 tempest-ProjectMemberTests-864505458 None] Volume volume-34b48d23-08be-4aa5-9b87-85080f0dde8a (34b48d23-08be-4aa5-9b87-85080f0dde8a): created successfully Sep 18 21:53:04 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d540b03b-bed9-4500-a2f1-63ac6df1b283 tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccb6f612-b89f-4ea1-aba7-488fc5a2df4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:53:04 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d540b03b-bed9-4500-a2f1-63ac6df1b283 tempest-ProjectMemberTests-864505458 None] Flow 'volume_create_manager' (08e88b99-2da3-473f-9db0-9f66359a378c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:53:04 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-d540b03b-bed9-4500-a2f1-63ac6df1b283 tempest-ProjectMemberTests-864505458 None] Created volume successfully. Sep 18 21:53:05 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d0691c26-1cbf-49c7-92b5-9ec8496c4bcb tempest-ProjectReaderTests-1915593202 None] Acquiring lock "cinder-310119c3-13f5-4f5c-ba34-33c1f9d376ad-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:53:05 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d0691c26-1cbf-49c7-92b5-9ec8496c4bcb tempest-ProjectReaderTests-1915593202 None] Lock "cinder-310119c3-13f5-4f5c-ba34-33c1f9d376ad-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:53:05 devstack cinder-volume[86136]: DEBUG oslo_service.periodic_task [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86136) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 21:53:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:53:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:53:05 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:53:05 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:53:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:53:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:53:05 devstack sudo[105685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:53:05 devstack sudo[105685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:53:05 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d0691c26-1cbf-49c7-92b5-9ec8496c4bcb tempest-ProjectReaderTests-1915593202 None] Acquiring lock "cinder-quobyte-310119c3-13f5-4f5c-ba34-33c1f9d376ad" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:53:05 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d0691c26-1cbf-49c7-92b5-9ec8496c4bcb tempest-ProjectReaderTests-1915593202 None] Lock "cinder-quobyte-310119c3-13f5-4f5c-ba34-33c1f9d376ad" acquired by "delete_volume" :: waited 0.018s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:53:05 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[796b05e9-e32f-49ff-9831-2c05c5ed7e6c]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:53:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d0691c26-1cbf-49c7-92b5-9ec8496c4bcb tempest-ProjectReaderTests-1915593202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-310119c3-13f5-4f5c-ba34-33c1f9d376ad {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:53:05 devstack sudo[105687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-310119c3-13f5-4f5c-ba34-33c1f9d376ad Sep 18 21:53:05 devstack sudo[105687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:53:05 devstack sudo[105685]: pam_unix(sudo:session): session closed for user root Sep 18 21:53:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.250s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:53:05 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:53:05 devstack cinder-volume[86136]: DEBUG oslo_service.periodic_task [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] Running periodic task VolumeManager._thread_info {{(pid=86136) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 21:53:05 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] thread count: 28 {{(pid=86136) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 18 21:53:05 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-47e0165e-3d13-44f8-a731-e12bef60ca6a None None] thread info: [<_MainThread(MainThread, started 138548347871360)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86136) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 18 21:53:05 devstack sudo[105687]: pam_unix(sudo:session): session closed for user root Sep 18 21:53:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d0691c26-1cbf-49c7-92b5-9ec8496c4bcb tempest-ProjectReaderTests-1915593202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-310119c3-13f5-4f5c-ba34-33c1f9d376ad" returned: 0 in 0.370s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:53:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d0691c26-1cbf-49c7-92b5-9ec8496c4bcb tempest-ProjectReaderTests-1915593202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-310119c3-13f5-4f5c-ba34-33c1f9d376ad {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:53:05 devstack sudo[105693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-310119c3-13f5-4f5c-ba34-33c1f9d376ad Sep 18 21:53:05 devstack sudo[105693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:53:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-4c033d8f-d4a6-41ed-b779-cf4d51adaafc tempest-ProjectMemberTests-864505458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:53:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-4c033d8f-d4a6-41ed-b779-cf4d51adaafc tempest-ProjectMemberTests-864505458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:53:05 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-4c033d8f-d4a6-41ed-b779-cf4d51adaafc tempest-ProjectMemberTests-864505458 None] Creating offline snapshot ef5c835a-cbb0-4fd6-83a0-0695126e8bba of volume 34b48d23-08be-4aa5-9b87-85080f0dde8a {{(pid=86136) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 21:53:05 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[8741f351-d072-4ae0-a2e7-8df9f8e8d3ad]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:53:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-4c033d8f-d4a6-41ed-b779-cf4d51adaafc tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-34b48d23-08be-4aa5-9b87-85080f0dde8a {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:53:05 devstack sudo[105695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-34b48d23-08be-4aa5-9b87-85080f0dde8a Sep 18 21:53:05 devstack sudo[105695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:53:05 devstack sudo[105693]: pam_unix(sudo:session): session closed for user root Sep 18 21:53:05 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d0691c26-1cbf-49c7-92b5-9ec8496c4bcb tempest-ProjectReaderTests-1915593202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-310119c3-13f5-4f5c-ba34-33c1f9d376ad" returned: 0 in 0.267s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:53:05 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d0691c26-1cbf-49c7-92b5-9ec8496c4bcb tempest-ProjectReaderTests-1915593202 None] Lock "cinder-quobyte-310119c3-13f5-4f5c-ba34-33c1f9d376ad" released by "delete_volume" :: held 0.678s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:53:05 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-d0691c26-1cbf-49c7-92b5-9ec8496c4bcb tempest-ProjectReaderTests-1915593202 None] Created reservations ['f11ac475-1af0-4bf2-8622-a968aba55171', '4da65357-72c8-483c-bb9c-b70438bac86f', 'c1307e52-6112-4f04-bfcc-32aac47336ee', '74f198d5-ae58-4393-802c-f8ee0094951d'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:53:06 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-d0691c26-1cbf-49c7-92b5-9ec8496c4bcb tempest-ProjectReaderTests-1915593202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:53:06 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-d0691c26-1cbf-49c7-92b5-9ec8496c4bcb tempest-ProjectReaderTests-1915593202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:53:06 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-d0691c26-1cbf-49c7-92b5-9ec8496c4bcb tempest-ProjectReaderTests-1915593202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:53:06 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-d0691c26-1cbf-49c7-92b5-9ec8496c4bcb tempest-ProjectReaderTests-1915593202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:53:06 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-d0691c26-1cbf-49c7-92b5-9ec8496c4bcb tempest-ProjectReaderTests-1915593202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:53:06 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d0691c26-1cbf-49c7-92b5-9ec8496c4bcb tempest-ProjectReaderTests-1915593202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:53:06 devstack sudo[105698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:53:06 devstack sudo[105698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:53:06 devstack sudo[105695]: pam_unix(sudo:session): session closed for user root Sep 18 21:53:06 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-4c033d8f-d4a6-41ed-b779-cf4d51adaafc tempest-ProjectMemberTests-864505458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-34b48d23-08be-4aa5-9b87-85080f0dde8a" returned: 0 in 0.396s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:53:06 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-4c033d8f-d4a6-41ed-b779-cf4d51adaafc tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-34b48d23-08be-4aa5-9b87-85080f0dde8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-34b48d23-08be-4aa5-9b87-85080f0dde8a.ef5c835a-cbb0-4fd6-83a0-0695126e8bba 1G {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:53:06 devstack sudo[105703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-34b48d23-08be-4aa5-9b87-85080f0dde8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-34b48d23-08be-4aa5-9b87-85080f0dde8a.ef5c835a-cbb0-4fd6-83a0-0695126e8bba 1G Sep 18 21:53:06 devstack sudo[105703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:53:06 devstack sudo[105698]: pam_unix(sudo:session): session closed for user root Sep 18 21:53:06 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d0691c26-1cbf-49c7-92b5-9ec8496c4bcb tempest-ProjectReaderTests-1915593202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.276s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:53:06 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-d0691c26-1cbf-49c7-92b5-9ec8496c4bcb tempest-ProjectReaderTests-1915593202 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:53:06 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-d0691c26-1cbf-49c7-92b5-9ec8496c4bcb tempest-ProjectReaderTests-1915593202 None] Deleted volume successfully. Sep 18 21:53:06 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d0691c26-1cbf-49c7-92b5-9ec8496c4bcb tempest-ProjectReaderTests-1915593202 None] Lock "cinder-310119c3-13f5-4f5c-ba34-33c1f9d376ad-delete_volume" released by "delete_volume" :: held 1.183s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:53:06 devstack sudo[105703]: pam_unix(sudo:session): session closed for user root Sep 18 21:53:06 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-4c033d8f-d4a6-41ed-b779-cf4d51adaafc tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-34b48d23-08be-4aa5-9b87-85080f0dde8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-34b48d23-08be-4aa5-9b87-85080f0dde8a.ef5c835a-cbb0-4fd6-83a0-0695126e8bba 1G" returned: 0 in 0.434s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:53:06 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-4c033d8f-d4a6-41ed-b779-cf4d51adaafc tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34b48d23-08be-4aa5-9b87-85080f0dde8a -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-34b48d23-08be-4aa5-9b87-85080f0dde8a.ef5c835a-cbb0-4fd6-83a0-0695126e8bba {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:53:06 devstack sudo[105710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34b48d23-08be-4aa5-9b87-85080f0dde8a -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-34b48d23-08be-4aa5-9b87-85080f0dde8a.ef5c835a-cbb0-4fd6-83a0-0695126e8bba Sep 18 21:53:06 devstack sudo[105710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:53:06 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-d36e4d42-89bb-47eb-9f79-d6be252d39e2 tempest-ProjectReaderTests-1915593202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:53:06 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d36e4d42-89bb-47eb-9f79-d6be252d39e2 tempest-ProjectReaderTests-1915593202 None] Flow 'volume_create_manager' (a9c6f4bb-4194-40ed-a1fa-a82ca7de416c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:53:06 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d36e4d42-89bb-47eb-9f79-d6be252d39e2 tempest-ProjectReaderTests-1915593202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20838f84-5f2e-45ea-a013-1e1b6807c6d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:53:06 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d36e4d42-89bb-47eb-9f79-d6be252d39e2 tempest-ProjectReaderTests-1915593202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20838f84-5f2e-45ea-a013-1e1b6807c6d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:53:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1718922542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a87025c1-5267-4cba-9fef-32b3cf9acc05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3c1d723082a404daad4c7e7764ea643',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:53:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:53:07Z,use_quota=True,user_id='9f21132c312d4262a7b00cfaec17f8d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:53:06 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d36e4d42-89bb-47eb-9f79-d6be252d39e2 tempest-ProjectReaderTests-1915593202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c1bb876-a662-4cef-9ce8-c0eee500876c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:53:06 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d36e4d42-89bb-47eb-9f79-d6be252d39e2 tempest-ProjectReaderTests-1915593202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c1bb876-a662-4cef-9ce8-c0eee500876c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:53:06 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d36e4d42-89bb-47eb-9f79-d6be252d39e2 tempest-ProjectReaderTests-1915593202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91e25fe6-9750-4cf9-a016-c059f7e25b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:53:06 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d36e4d42-89bb-47eb-9f79-d6be252d39e2 tempest-ProjectReaderTests-1915593202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91e25fe6-9750-4cf9-a016-c059f7e25b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a87025c1-5267-4cba-9fef-32b3cf9acc05', 'volume_name': 'volume-a87025c1-5267-4cba-9fef-32b3cf9acc05', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:53:06 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d36e4d42-89bb-47eb-9f79-d6be252d39e2 tempest-ProjectReaderTests-1915593202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da2c7e3f-caa7-4b72-9add-fcff3ebab081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:53:06 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d36e4d42-89bb-47eb-9f79-d6be252d39e2 tempest-ProjectReaderTests-1915593202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da2c7e3f-caa7-4b72-9add-fcff3ebab081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:53:06 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d36e4d42-89bb-47eb-9f79-d6be252d39e2 tempest-ProjectReaderTests-1915593202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf7ccfff-3363-481b-b560-37d65303c94c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:53:06 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-d36e4d42-89bb-47eb-9f79-d6be252d39e2 tempest-ProjectReaderTests-1915593202 None] Volume a87025c1-5267-4cba-9fef-32b3cf9acc05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a87025c1-5267-4cba-9fef-32b3cf9acc05', 'volume_size': 1} Sep 18 21:53:06 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-d36e4d42-89bb-47eb-9f79-d6be252d39e2 tempest-ProjectReaderTests-1915593202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:53:06 devstack sudo[105710]: pam_unix(sudo:session): session closed for user root Sep 18 21:53:06 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-4c033d8f-d4a6-41ed-b779-cf4d51adaafc tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34b48d23-08be-4aa5-9b87-85080f0dde8a -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-34b48d23-08be-4aa5-9b87-85080f0dde8a.ef5c835a-cbb0-4fd6-83a0-0695126e8bba" returned: 0 in 0.319s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:53:06 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-4c033d8f-d4a6-41ed-b779-cf4d51adaafc tempest-ProjectMemberTests-864505458 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-34b48d23-08be-4aa5-9b87-85080f0dde8a.ef5c835a-cbb0-4fd6-83a0-0695126e8bba is being set with open permissions: ugo+rw Sep 18 21:53:06 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-4c033d8f-d4a6-41ed-b779-cf4d51adaafc tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-34b48d23-08be-4aa5-9b87-85080f0dde8a.ef5c835a-cbb0-4fd6-83a0-0695126e8bba {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:53:06 devstack sudo[105715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-34b48d23-08be-4aa5-9b87-85080f0dde8a.ef5c835a-cbb0-4fd6-83a0-0695126e8bba Sep 18 21:53:06 devstack sudo[105715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:53:07 devstack sudo[105715]: pam_unix(sudo:session): session closed for user root Sep 18 21:53:07 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-4c033d8f-d4a6-41ed-b779-cf4d51adaafc tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-34b48d23-08be-4aa5-9b87-85080f0dde8a.ef5c835a-cbb0-4fd6-83a0-0695126e8bba" returned: 0 in 0.244s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:53:07 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-4c033d8f-d4a6-41ed-b779-cf4d51adaafc tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-34b48d23-08be-4aa5-9b87-85080f0dde8a.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:53:07 devstack sudo[105718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-34b48d23-08be-4aa5-9b87-85080f0dde8a.info Sep 18 21:53:07 devstack sudo[105718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:53:07 devstack sudo[105718]: pam_unix(sudo:session): session closed for user root Sep 18 21:53:07 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-4c033d8f-d4a6-41ed-b779-cf4d51adaafc tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-34b48d23-08be-4aa5-9b87-85080f0dde8a.info" returned: 0 in 0.240s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:53:07 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-4c033d8f-d4a6-41ed-b779-cf4d51adaafc tempest-ProjectMemberTests-864505458 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-34b48d23-08be-4aa5-9b87-85080f0dde8a.info is being set with open permissions: ugo+rw Sep 18 21:53:07 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-4c033d8f-d4a6-41ed-b779-cf4d51adaafc tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-34b48d23-08be-4aa5-9b87-85080f0dde8a.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:53:07 devstack sudo[105721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-34b48d23-08be-4aa5-9b87-85080f0dde8a.info Sep 18 21:53:07 devstack sudo[105721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:53:07 devstack sudo[105721]: pam_unix(sudo:session): session closed for user root Sep 18 21:53:07 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-4c033d8f-d4a6-41ed-b779-cf4d51adaafc tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-34b48d23-08be-4aa5-9b87-85080f0dde8a.info" returned: 0 in 0.244s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:53:07 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-4c033d8f-d4a6-41ed-b779-cf4d51adaafc tempest-ProjectMemberTests-864505458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.954s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:53:07 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-d36e4d42-89bb-47eb-9f79-d6be252d39e2 tempest-ProjectReaderTests-1915593202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.786s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:53:07 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-d36e4d42-89bb-47eb-9f79-d6be252d39e2 tempest-ProjectReaderTests-1915593202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:53:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1718922542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a87025c1-5267-4cba-9fef-32b3cf9acc05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3c1d723082a404daad4c7e7764ea643',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:53:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:53:07Z,use_quota=True,user_id='9f21132c312d4262a7b00cfaec17f8d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:53:07 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-d36e4d42-89bb-47eb-9f79-d6be252d39e2 tempest-ProjectReaderTests-1915593202 None] Creating volume a87025c1-5267-4cba-9fef-32b3cf9acc05 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:53:07 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-d36e4d42-89bb-47eb-9f79-d6be252d39e2 tempest-ProjectReaderTests-1915593202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:53:07 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-d36e4d42-89bb-47eb-9f79-d6be252d39e2 tempest-ProjectReaderTests-1915593202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:53:07 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-d36e4d42-89bb-47eb-9f79-d6be252d39e2 tempest-ProjectReaderTests-1915593202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:53:07 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-d36e4d42-89bb-47eb-9f79-d6be252d39e2 tempest-ProjectReaderTests-1915593202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:53:07 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-d36e4d42-89bb-47eb-9f79-d6be252d39e2 tempest-ProjectReaderTests-1915593202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:53:07 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-d36e4d42-89bb-47eb-9f79-d6be252d39e2 tempest-ProjectReaderTests-1915593202 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:53:07 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-d36e4d42-89bb-47eb-9f79-d6be252d39e2 tempest-ProjectReaderTests-1915593202 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:53:07 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d36e4d42-89bb-47eb-9f79-d6be252d39e2 tempest-ProjectReaderTests-1915593202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a87025c1-5267-4cba-9fef-32b3cf9acc05 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:53:07 devstack sudo[105724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a87025c1-5267-4cba-9fef-32b3cf9acc05 1073741824 Sep 18 21:53:07 devstack sudo[105724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:53:07 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-4c033d8f-d4a6-41ed-b779-cf4d51adaafc tempest-ProjectMemberTests-864505458 None] Create snapshot completed successfully Sep 18 21:53:07 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-f9f3e1ce-5aa2-4c2f-9a37-d911bcb51cb2 tempest-ProjectMemberTests-864505458 None] Acquiring lock "cinder-ef5c835a-cbb0-4fd6-83a0-0695126e8bba-delete_snapshot" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:53:07 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-f9f3e1ce-5aa2-4c2f-9a37-d911bcb51cb2 tempest-ProjectMemberTests-864505458 None] Lock "cinder-ef5c835a-cbb0-4fd6-83a0-0695126e8bba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:53:07 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-f9f3e1ce-5aa2-4c2f-9a37-d911bcb51cb2 tempest-ProjectMemberTests-864505458 None] Acquiring lock "cinder-quobyte-34b48d23-08be-4aa5-9b87-85080f0dde8a" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:53:07 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-f9f3e1ce-5aa2-4c2f-9a37-d911bcb51cb2 tempest-ProjectMemberTests-864505458 None] Lock "cinder-quobyte-34b48d23-08be-4aa5-9b87-85080f0dde8a" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:53:07 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-f9f3e1ce-5aa2-4c2f-9a37-d911bcb51cb2 tempest-ProjectMemberTests-864505458 None] Acquiring lock "cinder-quobyte-ef5c835a-cbb0-4fd6-83a0-0695126e8bba" by "_delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:53:07 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-f9f3e1ce-5aa2-4c2f-9a37-d911bcb51cb2 tempest-ProjectMemberTests-864505458 None] Lock "cinder-quobyte-ef5c835a-cbb0-4fd6-83a0-0695126e8bba" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:53:07 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-f9f3e1ce-5aa2-4c2f-9a37-d911bcb51cb2 tempest-ProjectMemberTests-864505458 None] Deleting offline snapshot ef5c835a-cbb0-4fd6-83a0-0695126e8bba of volume 34b48d23-08be-4aa5-9b87-85080f0dde8a {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 21:53:07 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-f9f3e1ce-5aa2-4c2f-9a37-d911bcb51cb2 tempest-ProjectMemberTests-864505458 None] snapshot_file for this snap is: volume-34b48d23-08be-4aa5-9b87-85080f0dde8a.ef5c835a-cbb0-4fd6-83a0-0695126e8bba {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 21:53:07 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb0a839-d740-4467-abd9-d836f8dae7ef]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:53:07 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f9f3e1ce-5aa2-4c2f-9a37-d911bcb51cb2 tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-34b48d23-08be-4aa5-9b87-85080f0dde8a.ef5c835a-cbb0-4fd6-83a0-0695126e8bba {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:53:08 devstack sudo[105729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-34b48d23-08be-4aa5-9b87-85080f0dde8a.ef5c835a-cbb0-4fd6-83a0-0695126e8bba Sep 18 21:53:08 devstack sudo[105729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:53:08 devstack sudo[105724]: pam_unix(sudo:session): session closed for user root Sep 18 21:53:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d36e4d42-89bb-47eb-9f79-d6be252d39e2 tempest-ProjectReaderTests-1915593202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a87025c1-5267-4cba-9fef-32b3cf9acc05 1073741824" returned: 0 in 0.435s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:53:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d36e4d42-89bb-47eb-9f79-d6be252d39e2 tempest-ProjectReaderTests-1915593202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a87025c1-5267-4cba-9fef-32b3cf9acc05 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:53:08 devstack sudo[105731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a87025c1-5267-4cba-9fef-32b3cf9acc05 Sep 18 21:53:08 devstack sudo[105731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:53:08 devstack sudo[105729]: pam_unix(sudo:session): session closed for user root Sep 18 21:53:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f9f3e1ce-5aa2-4c2f-9a37-d911bcb51cb2 tempest-ProjectMemberTests-864505458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-34b48d23-08be-4aa5-9b87-85080f0dde8a.ef5c835a-cbb0-4fd6-83a0-0695126e8bba" returned: 0 in 0.399s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:53:08 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-f9f3e1ce-5aa2-4c2f-9a37-d911bcb51cb2 tempest-ProjectMemberTests-864505458 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34b48d23-08be-4aa5-9b87-85080f0dde8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86136) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 21:53:08 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[c02a8e6d-6713-4e50-8da2-fb0c31a0e704]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:53:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f9f3e1ce-5aa2-4c2f-9a37-d911bcb51cb2 tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-34b48d23-08be-4aa5-9b87-85080f0dde8a {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:53:08 devstack sudo[105731]: pam_unix(sudo:session): session closed for user root Sep 18 21:53:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d36e4d42-89bb-47eb-9f79-d6be252d39e2 tempest-ProjectReaderTests-1915593202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a87025c1-5267-4cba-9fef-32b3cf9acc05" returned: 0 in 0.258s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:53:08 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-d36e4d42-89bb-47eb-9f79-d6be252d39e2 tempest-ProjectReaderTests-1915593202 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:53:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-d36e4d42-89bb-47eb-9f79-d6be252d39e2 tempest-ProjectReaderTests-1915593202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:53:08 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d36e4d42-89bb-47eb-9f79-d6be252d39e2 tempest-ProjectReaderTests-1915593202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf7ccfff-3363-481b-b560-37d65303c94c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a87025c1-5267-4cba-9fef-32b3cf9acc05', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:53:08 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d36e4d42-89bb-47eb-9f79-d6be252d39e2 tempest-ProjectReaderTests-1915593202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (432f0550-5ae9-43a6-9e2c-7b01efa600c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:53:08 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-d36e4d42-89bb-47eb-9f79-d6be252d39e2 tempest-ProjectReaderTests-1915593202 None] Volume volume-a87025c1-5267-4cba-9fef-32b3cf9acc05 (a87025c1-5267-4cba-9fef-32b3cf9acc05): created successfully Sep 18 21:53:08 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d36e4d42-89bb-47eb-9f79-d6be252d39e2 tempest-ProjectReaderTests-1915593202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (432f0550-5ae9-43a6-9e2c-7b01efa600c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:53:08 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d36e4d42-89bb-47eb-9f79-d6be252d39e2 tempest-ProjectReaderTests-1915593202 None] Flow 'volume_create_manager' (a9c6f4bb-4194-40ed-a1fa-a82ca7de416c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:53:08 devstack sudo[105736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-34b48d23-08be-4aa5-9b87-85080f0dde8a Sep 18 21:53:08 devstack sudo[105736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:53:08 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-d36e4d42-89bb-47eb-9f79-d6be252d39e2 tempest-ProjectReaderTests-1915593202 None] Created volume successfully. Sep 18 21:53:08 devstack sudo[105736]: pam_unix(sudo:session): session closed for user root Sep 18 21:53:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f9f3e1ce-5aa2-4c2f-9a37-d911bcb51cb2 tempest-ProjectMemberTests-864505458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-34b48d23-08be-4aa5-9b87-85080f0dde8a" returned: 0 in 0.358s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:53:08 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f9f3e1ce-5aa2-4c2f-9a37-d911bcb51cb2 tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-34b48d23-08be-4aa5-9b87-85080f0dde8a.ef5c835a-cbb0-4fd6-83a0-0695126e8bba {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:53:08 devstack sudo[105742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-34b48d23-08be-4aa5-9b87-85080f0dde8a.ef5c835a-cbb0-4fd6-83a0-0695126e8bba Sep 18 21:53:08 devstack sudo[105742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:53:08 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-579fe66a-3f84-47d4-adb8-a01da04ae14c tempest-ProjectReaderTests-1915593202 None] Acquiring lock "cinder-a87025c1-5267-4cba-9fef-32b3cf9acc05-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:53:08 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-579fe66a-3f84-47d4-adb8-a01da04ae14c tempest-ProjectReaderTests-1915593202 None] Lock "cinder-a87025c1-5267-4cba-9fef-32b3cf9acc05-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:53:08 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-579fe66a-3f84-47d4-adb8-a01da04ae14c tempest-ProjectReaderTests-1915593202 None] Acquiring lock "cinder-quobyte-a87025c1-5267-4cba-9fef-32b3cf9acc05" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:53:08 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-579fe66a-3f84-47d4-adb8-a01da04ae14c tempest-ProjectReaderTests-1915593202 None] Lock "cinder-quobyte-a87025c1-5267-4cba-9fef-32b3cf9acc05" acquired by "delete_volume" :: waited 0.017s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:53:09 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[6777f239-3df2-4c6a-9353-c2a302ac7593]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:53:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-579fe66a-3f84-47d4-adb8-a01da04ae14c tempest-ProjectReaderTests-1915593202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a87025c1-5267-4cba-9fef-32b3cf9acc05 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:53:09 devstack sudo[105742]: pam_unix(sudo:session): session closed for user root Sep 18 21:53:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f9f3e1ce-5aa2-4c2f-9a37-d911bcb51cb2 tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-34b48d23-08be-4aa5-9b87-85080f0dde8a.ef5c835a-cbb0-4fd6-83a0-0695126e8bba" returned: 0 in 0.364s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:53:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f9f3e1ce-5aa2-4c2f-9a37-d911bcb51cb2 tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-34b48d23-08be-4aa5-9b87-85080f0dde8a.ef5c835a-cbb0-4fd6-83a0-0695126e8bba {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:53:09 devstack sudo[105747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a87025c1-5267-4cba-9fef-32b3cf9acc05 Sep 18 21:53:09 devstack sudo[105747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:53:09 devstack sudo[105748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-34b48d23-08be-4aa5-9b87-85080f0dde8a.ef5c835a-cbb0-4fd6-83a0-0695126e8bba Sep 18 21:53:09 devstack sudo[105748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:53:09 devstack sudo[105748]: pam_unix(sudo:session): session closed for user root Sep 18 21:53:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f9f3e1ce-5aa2-4c2f-9a37-d911bcb51cb2 tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-34b48d23-08be-4aa5-9b87-85080f0dde8a.ef5c835a-cbb0-4fd6-83a0-0695126e8bba" returned: 0 in 0.247s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:53:09 devstack sudo[105747]: pam_unix(sudo:session): session closed for user root Sep 18 21:53:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-579fe66a-3f84-47d4-adb8-a01da04ae14c tempest-ProjectReaderTests-1915593202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a87025c1-5267-4cba-9fef-32b3cf9acc05" returned: 0 in 0.373s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:53:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-579fe66a-3f84-47d4-adb8-a01da04ae14c tempest-ProjectReaderTests-1915593202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a87025c1-5267-4cba-9fef-32b3cf9acc05 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:53:09 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-f9f3e1ce-5aa2-4c2f-9a37-d911bcb51cb2 tempest-ProjectMemberTests-864505458 None] Lock "cinder-quobyte-ef5c835a-cbb0-4fd6-83a0-0695126e8bba" released by "_delete_snapshot" :: held 1.480s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:53:09 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-f9f3e1ce-5aa2-4c2f-9a37-d911bcb51cb2 tempest-ProjectMemberTests-864505458 None] Lock "cinder-quobyte-34b48d23-08be-4aa5-9b87-85080f0dde8a" released by "delete_snapshot" :: held 1.508s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:53:09 devstack sudo[105755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a87025c1-5267-4cba-9fef-32b3cf9acc05 Sep 18 21:53:09 devstack sudo[105755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:53:09 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-f9f3e1ce-5aa2-4c2f-9a37-d911bcb51cb2 tempest-ProjectMemberTests-864505458 None] Created reservations ['d99caf31-d4d5-4c21-a210-98d2cac494f4', '609d533c-ea7c-4a71-980c-1ed48f9946b5', 'df975a00-a7d2-48c5-8123-22a945d56562', '0d82861e-fb5f-4359-be7f-4865cf414932'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:53:09 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-f9f3e1ce-5aa2-4c2f-9a37-d911bcb51cb2 tempest-ProjectMemberTests-864505458 None] Delete snapshot completed successfully. Sep 18 21:53:09 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-f9f3e1ce-5aa2-4c2f-9a37-d911bcb51cb2 tempest-ProjectMemberTests-864505458 None] Lock "cinder-ef5c835a-cbb0-4fd6-83a0-0695126e8bba-delete_snapshot" released by "delete_snapshot" :: held 1.642s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:53:09 devstack sudo[105755]: pam_unix(sudo:session): session closed for user root Sep 18 21:53:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-579fe66a-3f84-47d4-adb8-a01da04ae14c tempest-ProjectReaderTests-1915593202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-a87025c1-5267-4cba-9fef-32b3cf9acc05" returned: 0 in 0.252s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:53:09 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-579fe66a-3f84-47d4-adb8-a01da04ae14c tempest-ProjectReaderTests-1915593202 None] Lock "cinder-quobyte-a87025c1-5267-4cba-9fef-32b3cf9acc05" released by "delete_volume" :: held 0.663s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:53:09 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-579fe66a-3f84-47d4-adb8-a01da04ae14c tempest-ProjectReaderTests-1915593202 None] Created reservations ['bcab348b-a0a5-40a7-b45e-e46ada9b9419', '772dc6a6-d3d3-45af-ae8d-eb41e2e04ed8', '01f2db6b-9763-4860-83c3-e505c634e251', '36a1b35f-a7be-44df-a44f-c7f0755c7040'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:53:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-579fe66a-3f84-47d4-adb8-a01da04ae14c tempest-ProjectReaderTests-1915593202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:53:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-579fe66a-3f84-47d4-adb8-a01da04ae14c tempest-ProjectReaderTests-1915593202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:53:09 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-579fe66a-3f84-47d4-adb8-a01da04ae14c tempest-ProjectReaderTests-1915593202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:53:09 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-579fe66a-3f84-47d4-adb8-a01da04ae14c tempest-ProjectReaderTests-1915593202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:53:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-579fe66a-3f84-47d4-adb8-a01da04ae14c tempest-ProjectReaderTests-1915593202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:53:09 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-579fe66a-3f84-47d4-adb8-a01da04ae14c tempest-ProjectReaderTests-1915593202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:53:09 devstack sudo[105758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:53:09 devstack sudo[105758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:53:10 devstack sudo[105758]: pam_unix(sudo:session): session closed for user root Sep 18 21:53:10 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-eee7756c-3784-427c-b0ac-425a100a1b44 tempest-ProjectMemberTests-864505458 None] Acquiring lock "cinder-34b48d23-08be-4aa5-9b87-85080f0dde8a-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:53:10 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-579fe66a-3f84-47d4-adb8-a01da04ae14c tempest-ProjectReaderTests-1915593202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.264s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:53:10 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-579fe66a-3f84-47d4-adb8-a01da04ae14c tempest-ProjectReaderTests-1915593202 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:53:10 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-579fe66a-3f84-47d4-adb8-a01da04ae14c tempest-ProjectReaderTests-1915593202 None] Deleted volume successfully. Sep 18 21:53:10 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-eee7756c-3784-427c-b0ac-425a100a1b44 tempest-ProjectMemberTests-864505458 None] Lock "cinder-34b48d23-08be-4aa5-9b87-85080f0dde8a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:53:10 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-579fe66a-3f84-47d4-adb8-a01da04ae14c tempest-ProjectReaderTests-1915593202 None] Lock "cinder-a87025c1-5267-4cba-9fef-32b3cf9acc05-delete_volume" released by "delete_volume" :: held 1.129s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:53:10 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-eee7756c-3784-427c-b0ac-425a100a1b44 tempest-ProjectMemberTests-864505458 None] Acquiring lock "cinder-quobyte-34b48d23-08be-4aa5-9b87-85080f0dde8a" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:53:10 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-eee7756c-3784-427c-b0ac-425a100a1b44 tempest-ProjectMemberTests-864505458 None] Lock "cinder-quobyte-34b48d23-08be-4aa5-9b87-85080f0dde8a" acquired by "delete_volume" :: waited 0.018s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:53:10 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[b524c9ff-41c6-4135-8549-0f7e5462e126]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:53:10 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-eee7756c-3784-427c-b0ac-425a100a1b44 tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-34b48d23-08be-4aa5-9b87-85080f0dde8a {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:53:10 devstack sudo[105761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-34b48d23-08be-4aa5-9b87-85080f0dde8a Sep 18 21:53:10 devstack sudo[105761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:53:10 devstack sudo[105761]: pam_unix(sudo:session): session closed for user root Sep 18 21:53:10 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-eee7756c-3784-427c-b0ac-425a100a1b44 tempest-ProjectMemberTests-864505458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-34b48d23-08be-4aa5-9b87-85080f0dde8a" returned: 0 in 0.391s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:53:10 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-eee7756c-3784-427c-b0ac-425a100a1b44 tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-34b48d23-08be-4aa5-9b87-85080f0dde8a {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:53:10 devstack sudo[105767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-34b48d23-08be-4aa5-9b87-85080f0dde8a Sep 18 21:53:10 devstack sudo[105767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:53:10 devstack sudo[105767]: pam_unix(sudo:session): session closed for user root Sep 18 21:53:10 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-eee7756c-3784-427c-b0ac-425a100a1b44 tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-34b48d23-08be-4aa5-9b87-85080f0dde8a" returned: 0 in 0.283s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:53:10 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-eee7756c-3784-427c-b0ac-425a100a1b44 tempest-ProjectMemberTests-864505458 None] Lock "cinder-quobyte-34b48d23-08be-4aa5-9b87-85080f0dde8a" released by "delete_volume" :: held 0.739s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:53:10 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-eee7756c-3784-427c-b0ac-425a100a1b44 tempest-ProjectMemberTests-864505458 None] Created reservations ['7e7e1ed5-da84-43a8-9bb9-042002ec55e4', '0c816222-6cb7-404f-8516-34c84d54b297', 'ea788e7d-1d1f-48b6-b8bc-6c04d98a339a', 'afdf1bdf-cf4e-4dae-bfc4-a532a23cb4d6'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:53:10 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-eee7756c-3784-427c-b0ac-425a100a1b44 tempest-ProjectMemberTests-864505458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:53:10 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-eee7756c-3784-427c-b0ac-425a100a1b44 tempest-ProjectMemberTests-864505458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:53:10 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-eee7756c-3784-427c-b0ac-425a100a1b44 tempest-ProjectMemberTests-864505458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:53:10 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-eee7756c-3784-427c-b0ac-425a100a1b44 tempest-ProjectMemberTests-864505458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:53:10 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-eee7756c-3784-427c-b0ac-425a100a1b44 tempest-ProjectMemberTests-864505458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:53:10 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-eee7756c-3784-427c-b0ac-425a100a1b44 tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:53:10 devstack sudo[105771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:53:10 devstack sudo[105771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:53:11 devstack sudo[105771]: pam_unix(sudo:session): session closed for user root Sep 18 21:53:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-eee7756c-3784-427c-b0ac-425a100a1b44 tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.293s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:53:11 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-eee7756c-3784-427c-b0ac-425a100a1b44 tempest-ProjectMemberTests-864505458 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:53:11 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-eee7756c-3784-427c-b0ac-425a100a1b44 tempest-ProjectMemberTests-864505458 None] Deleted volume successfully. Sep 18 21:53:11 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-eee7756c-3784-427c-b0ac-425a100a1b44 tempest-ProjectMemberTests-864505458 None] Lock "cinder-34b48d23-08be-4aa5-9b87-85080f0dde8a-delete_volume" released by "delete_volume" :: held 1.259s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:53:11 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-3af0af84-dcc3-4fb6-8770-9681ff6ca69b tempest-ProjectMemberTests-864505458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:53:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-3af0af84-dcc3-4fb6-8770-9681ff6ca69b tempest-ProjectMemberTests-864505458 None] Flow 'volume_create_manager' (5f7963f6-d9de-4f8f-944b-7930751615e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:53:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-3af0af84-dcc3-4fb6-8770-9681ff6ca69b tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c67fb69-8e9b-4868-9ce7-8a7e700cc556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:53:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-3af0af84-dcc3-4fb6-8770-9681ff6ca69b tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c67fb69-8e9b-4868-9ce7-8a7e700cc556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:53:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-492784285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff02d9e4-e982-4a79-81ae-41b0baf4609f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44aed77f70a242029bc978ba9aa69a78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:53:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:53:12Z,use_quota=True,user_id='fbe2b10fb8584161a20a4564db383b3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:53:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-3af0af84-dcc3-4fb6-8770-9681ff6ca69b tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a83415ea-db43-4940-8dc5-7acb0291dd2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:53:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-3af0af84-dcc3-4fb6-8770-9681ff6ca69b tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a83415ea-db43-4940-8dc5-7acb0291dd2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:53:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-3af0af84-dcc3-4fb6-8770-9681ff6ca69b tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a41d6772-6a03-42f3-9458-1cc1b97bf1f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:53:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-3af0af84-dcc3-4fb6-8770-9681ff6ca69b tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a41d6772-6a03-42f3-9458-1cc1b97bf1f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff02d9e4-e982-4a79-81ae-41b0baf4609f', 'volume_name': 'volume-ff02d9e4-e982-4a79-81ae-41b0baf4609f', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:53:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-3af0af84-dcc3-4fb6-8770-9681ff6ca69b tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac297bb1-f485-4715-9c91-951288f40e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:53:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-3af0af84-dcc3-4fb6-8770-9681ff6ca69b tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac297bb1-f485-4715-9c91-951288f40e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:53:11 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-3af0af84-dcc3-4fb6-8770-9681ff6ca69b tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7131fdb-3d90-4b8c-934c-56c2c394772b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:53:11 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-3af0af84-dcc3-4fb6-8770-9681ff6ca69b tempest-ProjectMemberTests-864505458 None] Volume ff02d9e4-e982-4a79-81ae-41b0baf4609f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff02d9e4-e982-4a79-81ae-41b0baf4609f', 'volume_size': 1} Sep 18 21:53:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-3af0af84-dcc3-4fb6-8770-9681ff6ca69b tempest-ProjectMemberTests-864505458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:53:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-3af0af84-dcc3-4fb6-8770-9681ff6ca69b tempest-ProjectMemberTests-864505458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:53:11 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-3af0af84-dcc3-4fb6-8770-9681ff6ca69b tempest-ProjectMemberTests-864505458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:53:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-492784285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff02d9e4-e982-4a79-81ae-41b0baf4609f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44aed77f70a242029bc978ba9aa69a78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:53:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:53:12Z,use_quota=True,user_id='fbe2b10fb8584161a20a4564db383b3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:53:11 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-3af0af84-dcc3-4fb6-8770-9681ff6ca69b tempest-ProjectMemberTests-864505458 None] Creating volume ff02d9e4-e982-4a79-81ae-41b0baf4609f {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:53:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-3af0af84-dcc3-4fb6-8770-9681ff6ca69b tempest-ProjectMemberTests-864505458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:53:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-3af0af84-dcc3-4fb6-8770-9681ff6ca69b tempest-ProjectMemberTests-864505458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:53:11 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-3af0af84-dcc3-4fb6-8770-9681ff6ca69b tempest-ProjectMemberTests-864505458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:53:11 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-3af0af84-dcc3-4fb6-8770-9681ff6ca69b tempest-ProjectMemberTests-864505458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:53:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-3af0af84-dcc3-4fb6-8770-9681ff6ca69b tempest-ProjectMemberTests-864505458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:53:11 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-3af0af84-dcc3-4fb6-8770-9681ff6ca69b tempest-ProjectMemberTests-864505458 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:53:11 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-3af0af84-dcc3-4fb6-8770-9681ff6ca69b tempest-ProjectMemberTests-864505458 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:53:11 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3af0af84-dcc3-4fb6-8770-9681ff6ca69b tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ff02d9e4-e982-4a79-81ae-41b0baf4609f 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:53:11 devstack sudo[105775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ff02d9e4-e982-4a79-81ae-41b0baf4609f 1073741824 Sep 18 21:53:11 devstack sudo[105775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:53:12 devstack sudo[105775]: pam_unix(sudo:session): session closed for user root Sep 18 21:53:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3af0af84-dcc3-4fb6-8770-9681ff6ca69b tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ff02d9e4-e982-4a79-81ae-41b0baf4609f 1073741824" returned: 0 in 0.427s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:53:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3af0af84-dcc3-4fb6-8770-9681ff6ca69b tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ff02d9e4-e982-4a79-81ae-41b0baf4609f {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:53:12 devstack sudo[105780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ff02d9e4-e982-4a79-81ae-41b0baf4609f Sep 18 21:53:12 devstack sudo[105780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:53:12 devstack sudo[105780]: pam_unix(sudo:session): session closed for user root Sep 18 21:53:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-3af0af84-dcc3-4fb6-8770-9681ff6ca69b tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ff02d9e4-e982-4a79-81ae-41b0baf4609f" returned: 0 in 0.247s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:53:12 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-3af0af84-dcc3-4fb6-8770-9681ff6ca69b tempest-ProjectMemberTests-864505458 None] <== create_volume: return (714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:53:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-3af0af84-dcc3-4fb6-8770-9681ff6ca69b tempest-ProjectMemberTests-864505458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.716s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:53:12 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-3af0af84-dcc3-4fb6-8770-9681ff6ca69b tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7131fdb-3d90-4b8c-934c-56c2c394772b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff02d9e4-e982-4a79-81ae-41b0baf4609f', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:53:12 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-3af0af84-dcc3-4fb6-8770-9681ff6ca69b tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7a3d5eb-9a2c-462a-8644-8f6677b13ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:53:12 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-3af0af84-dcc3-4fb6-8770-9681ff6ca69b tempest-ProjectMemberTests-864505458 None] Volume volume-ff02d9e4-e982-4a79-81ae-41b0baf4609f (ff02d9e4-e982-4a79-81ae-41b0baf4609f): created successfully Sep 18 21:53:12 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-3af0af84-dcc3-4fb6-8770-9681ff6ca69b tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7a3d5eb-9a2c-462a-8644-8f6677b13ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:53:12 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-3af0af84-dcc3-4fb6-8770-9681ff6ca69b tempest-ProjectMemberTests-864505458 None] Flow 'volume_create_manager' (5f7963f6-d9de-4f8f-944b-7930751615e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:53:12 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-3af0af84-dcc3-4fb6-8770-9681ff6ca69b tempest-ProjectMemberTests-864505458 None] Created volume successfully. Sep 18 21:53:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-f0fd396d-c87b-4c02-bc75-8ad3baba6049 tempest-ProjectMemberTests-864505458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:53:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-f0fd396d-c87b-4c02-bc75-8ad3baba6049 tempest-ProjectMemberTests-864505458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:53:12 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-f0fd396d-c87b-4c02-bc75-8ad3baba6049 tempest-ProjectMemberTests-864505458 None] Creating offline snapshot a800e9f2-bd91-4c0e-90a1-31aaa58f4379 of volume ff02d9e4-e982-4a79-81ae-41b0baf4609f {{(pid=86136) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 21:53:12 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[13defca7-861d-4deb-b20b-5ec7c0d291c5]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:53:12 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f0fd396d-c87b-4c02-bc75-8ad3baba6049 tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ff02d9e4-e982-4a79-81ae-41b0baf4609f {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:53:12 devstack sudo[105783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ff02d9e4-e982-4a79-81ae-41b0baf4609f Sep 18 21:53:12 devstack sudo[105783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:53:13 devstack sudo[105783]: pam_unix(sudo:session): session closed for user root Sep 18 21:53:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f0fd396d-c87b-4c02-bc75-8ad3baba6049 tempest-ProjectMemberTests-864505458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ff02d9e4-e982-4a79-81ae-41b0baf4609f" returned: 0 in 0.357s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:53:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f0fd396d-c87b-4c02-bc75-8ad3baba6049 tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ff02d9e4-e982-4a79-81ae-41b0baf4609f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ff02d9e4-e982-4a79-81ae-41b0baf4609f.a800e9f2-bd91-4c0e-90a1-31aaa58f4379 1G {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:53:13 devstack sudo[105788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ff02d9e4-e982-4a79-81ae-41b0baf4609f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ff02d9e4-e982-4a79-81ae-41b0baf4609f.a800e9f2-bd91-4c0e-90a1-31aaa58f4379 1G Sep 18 21:53:13 devstack sudo[105788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:53:13 devstack sudo[105788]: pam_unix(sudo:session): session closed for user root Sep 18 21:53:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f0fd396d-c87b-4c02-bc75-8ad3baba6049 tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ff02d9e4-e982-4a79-81ae-41b0baf4609f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ff02d9e4-e982-4a79-81ae-41b0baf4609f.a800e9f2-bd91-4c0e-90a1-31aaa58f4379 1G" returned: 0 in 0.381s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:53:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f0fd396d-c87b-4c02-bc75-8ad3baba6049 tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff02d9e4-e982-4a79-81ae-41b0baf4609f -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ff02d9e4-e982-4a79-81ae-41b0baf4609f.a800e9f2-bd91-4c0e-90a1-31aaa58f4379 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:53:13 devstack sudo[105793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff02d9e4-e982-4a79-81ae-41b0baf4609f -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ff02d9e4-e982-4a79-81ae-41b0baf4609f.a800e9f2-bd91-4c0e-90a1-31aaa58f4379 Sep 18 21:53:13 devstack sudo[105793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:53:13 devstack sudo[105793]: pam_unix(sudo:session): session closed for user root Sep 18 21:53:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f0fd396d-c87b-4c02-bc75-8ad3baba6049 tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff02d9e4-e982-4a79-81ae-41b0baf4609f -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ff02d9e4-e982-4a79-81ae-41b0baf4609f.a800e9f2-bd91-4c0e-90a1-31aaa58f4379" returned: 0 in 0.293s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:53:13 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-f0fd396d-c87b-4c02-bc75-8ad3baba6049 tempest-ProjectMemberTests-864505458 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ff02d9e4-e982-4a79-81ae-41b0baf4609f.a800e9f2-bd91-4c0e-90a1-31aaa58f4379 is being set with open permissions: ugo+rw Sep 18 21:53:13 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f0fd396d-c87b-4c02-bc75-8ad3baba6049 tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ff02d9e4-e982-4a79-81ae-41b0baf4609f.a800e9f2-bd91-4c0e-90a1-31aaa58f4379 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:53:13 devstack sudo[105798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ff02d9e4-e982-4a79-81ae-41b0baf4609f.a800e9f2-bd91-4c0e-90a1-31aaa58f4379 Sep 18 21:53:13 devstack sudo[105798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:53:14 devstack sudo[105798]: pam_unix(sudo:session): session closed for user root Sep 18 21:53:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f0fd396d-c87b-4c02-bc75-8ad3baba6049 tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ff02d9e4-e982-4a79-81ae-41b0baf4609f.a800e9f2-bd91-4c0e-90a1-31aaa58f4379" returned: 0 in 0.242s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:53:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f0fd396d-c87b-4c02-bc75-8ad3baba6049 tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ff02d9e4-e982-4a79-81ae-41b0baf4609f.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:53:14 devstack sudo[105801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ff02d9e4-e982-4a79-81ae-41b0baf4609f.info Sep 18 21:53:14 devstack sudo[105801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:53:14 devstack sudo[105801]: pam_unix(sudo:session): session closed for user root Sep 18 21:53:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f0fd396d-c87b-4c02-bc75-8ad3baba6049 tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ff02d9e4-e982-4a79-81ae-41b0baf4609f.info" returned: 0 in 0.248s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:53:14 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-f0fd396d-c87b-4c02-bc75-8ad3baba6049 tempest-ProjectMemberTests-864505458 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ff02d9e4-e982-4a79-81ae-41b0baf4609f.info is being set with open permissions: ugo+rw Sep 18 21:53:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f0fd396d-c87b-4c02-bc75-8ad3baba6049 tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ff02d9e4-e982-4a79-81ae-41b0baf4609f.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:53:14 devstack sudo[105804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ff02d9e4-e982-4a79-81ae-41b0baf4609f.info Sep 18 21:53:14 devstack sudo[105804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:53:14 devstack sudo[105804]: pam_unix(sudo:session): session closed for user root Sep 18 21:53:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-f0fd396d-c87b-4c02-bc75-8ad3baba6049 tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ff02d9e4-e982-4a79-81ae-41b0baf4609f.info" returned: 0 in 0.237s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:53:14 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-f0fd396d-c87b-4c02-bc75-8ad3baba6049 tempest-ProjectMemberTests-864505458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.842s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:53:14 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-f0fd396d-c87b-4c02-bc75-8ad3baba6049 tempest-ProjectMemberTests-864505458 None] Create snapshot completed successfully Sep 18 21:53:14 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-8aad4c91-458e-4c10-96b9-409edc29c6f1 tempest-ProjectMemberTests-864505458 None] Acquiring lock "cinder-a800e9f2-bd91-4c0e-90a1-31aaa58f4379-delete_snapshot" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:53:14 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-8aad4c91-458e-4c10-96b9-409edc29c6f1 tempest-ProjectMemberTests-864505458 None] Lock "cinder-a800e9f2-bd91-4c0e-90a1-31aaa58f4379-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:53:14 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-8aad4c91-458e-4c10-96b9-409edc29c6f1 tempest-ProjectMemberTests-864505458 None] Acquiring lock "cinder-quobyte-ff02d9e4-e982-4a79-81ae-41b0baf4609f" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:53:14 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-8aad4c91-458e-4c10-96b9-409edc29c6f1 tempest-ProjectMemberTests-864505458 None] Lock "cinder-quobyte-ff02d9e4-e982-4a79-81ae-41b0baf4609f" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:53:14 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-8aad4c91-458e-4c10-96b9-409edc29c6f1 tempest-ProjectMemberTests-864505458 None] Acquiring lock "cinder-quobyte-a800e9f2-bd91-4c0e-90a1-31aaa58f4379" by "_delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:53:14 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-8aad4c91-458e-4c10-96b9-409edc29c6f1 tempest-ProjectMemberTests-864505458 None] Lock "cinder-quobyte-a800e9f2-bd91-4c0e-90a1-31aaa58f4379" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:53:14 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-8aad4c91-458e-4c10-96b9-409edc29c6f1 tempest-ProjectMemberTests-864505458 None] Deleting offline snapshot a800e9f2-bd91-4c0e-90a1-31aaa58f4379 of volume ff02d9e4-e982-4a79-81ae-41b0baf4609f {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 21:53:14 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-8aad4c91-458e-4c10-96b9-409edc29c6f1 tempest-ProjectMemberTests-864505458 None] snapshot_file for this snap is: volume-ff02d9e4-e982-4a79-81ae-41b0baf4609f.a800e9f2-bd91-4c0e-90a1-31aaa58f4379 {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 21:53:15 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9160141-a34b-43f5-ab36-ef6bdf5ff75e]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:53:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-8aad4c91-458e-4c10-96b9-409edc29c6f1 tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ff02d9e4-e982-4a79-81ae-41b0baf4609f.a800e9f2-bd91-4c0e-90a1-31aaa58f4379 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:53:15 devstack sudo[105807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ff02d9e4-e982-4a79-81ae-41b0baf4609f.a800e9f2-bd91-4c0e-90a1-31aaa58f4379 Sep 18 21:53:15 devstack sudo[105807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:53:15 devstack sudo[105807]: pam_unix(sudo:session): session closed for user root Sep 18 21:53:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-8aad4c91-458e-4c10-96b9-409edc29c6f1 tempest-ProjectMemberTests-864505458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ff02d9e4-e982-4a79-81ae-41b0baf4609f.a800e9f2-bd91-4c0e-90a1-31aaa58f4379" returned: 0 in 0.355s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:53:15 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-8aad4c91-458e-4c10-96b9-409edc29c6f1 tempest-ProjectMemberTests-864505458 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff02d9e4-e982-4a79-81ae-41b0baf4609f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86136) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 21:53:15 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e001fa9-6d23-47f4-a461-d9487c371072]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:53:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-8aad4c91-458e-4c10-96b9-409edc29c6f1 tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ff02d9e4-e982-4a79-81ae-41b0baf4609f {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:53:15 devstack sudo[105812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ff02d9e4-e982-4a79-81ae-41b0baf4609f Sep 18 21:53:15 devstack sudo[105812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:53:15 devstack sudo[105812]: pam_unix(sudo:session): session closed for user root Sep 18 21:53:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-8aad4c91-458e-4c10-96b9-409edc29c6f1 tempest-ProjectMemberTests-864505458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ff02d9e4-e982-4a79-81ae-41b0baf4609f" returned: 0 in 0.353s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:53:15 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-8aad4c91-458e-4c10-96b9-409edc29c6f1 tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ff02d9e4-e982-4a79-81ae-41b0baf4609f.a800e9f2-bd91-4c0e-90a1-31aaa58f4379 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:53:15 devstack sudo[105817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ff02d9e4-e982-4a79-81ae-41b0baf4609f.a800e9f2-bd91-4c0e-90a1-31aaa58f4379 Sep 18 21:53:15 devstack sudo[105817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:53:16 devstack sudo[105817]: pam_unix(sudo:session): session closed for user root Sep 18 21:53:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-8aad4c91-458e-4c10-96b9-409edc29c6f1 tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ff02d9e4-e982-4a79-81ae-41b0baf4609f.a800e9f2-bd91-4c0e-90a1-31aaa58f4379" returned: 0 in 0.324s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:53:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-8aad4c91-458e-4c10-96b9-409edc29c6f1 tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ff02d9e4-e982-4a79-81ae-41b0baf4609f.a800e9f2-bd91-4c0e-90a1-31aaa58f4379 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:53:16 devstack sudo[105823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ff02d9e4-e982-4a79-81ae-41b0baf4609f.a800e9f2-bd91-4c0e-90a1-31aaa58f4379 Sep 18 21:53:16 devstack sudo[105823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:53:16 devstack sudo[105823]: pam_unix(sudo:session): session closed for user root Sep 18 21:53:16 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-8aad4c91-458e-4c10-96b9-409edc29c6f1 tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ff02d9e4-e982-4a79-81ae-41b0baf4609f.a800e9f2-bd91-4c0e-90a1-31aaa58f4379" returned: 0 in 0.246s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:53:16 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-8aad4c91-458e-4c10-96b9-409edc29c6f1 tempest-ProjectMemberTests-864505458 None] Lock "cinder-quobyte-a800e9f2-bd91-4c0e-90a1-31aaa58f4379" released by "_delete_snapshot" :: held 1.372s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:53:16 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-8aad4c91-458e-4c10-96b9-409edc29c6f1 tempest-ProjectMemberTests-864505458 None] Lock "cinder-quobyte-ff02d9e4-e982-4a79-81ae-41b0baf4609f" released by "delete_snapshot" :: held 1.393s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:53:16 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-8aad4c91-458e-4c10-96b9-409edc29c6f1 tempest-ProjectMemberTests-864505458 None] Created reservations ['9dc9b74d-7d34-4eae-b500-184cbfdb8f6b', '43337cf3-a5c4-4d48-be4a-1c9073dc2c80', 'ea672a54-263d-4f8a-94bd-f434621d9c17', 'f1355427-eed4-469b-b8f5-0312d2f8b58c'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:53:16 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-8aad4c91-458e-4c10-96b9-409edc29c6f1 tempest-ProjectMemberTests-864505458 None] Delete snapshot completed successfully. Sep 18 21:53:16 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-8aad4c91-458e-4c10-96b9-409edc29c6f1 tempest-ProjectMemberTests-864505458 None] Lock "cinder-a800e9f2-bd91-4c0e-90a1-31aaa58f4379-delete_snapshot" released by "delete_snapshot" :: held 1.512s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:53:17 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-1a0328ee-c151-45bd-90aa-4ad90bc58e47 tempest-ProjectMemberTests-864505458 None] Acquiring lock "cinder-ff02d9e4-e982-4a79-81ae-41b0baf4609f-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:53:17 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-1a0328ee-c151-45bd-90aa-4ad90bc58e47 tempest-ProjectMemberTests-864505458 None] Lock "cinder-ff02d9e4-e982-4a79-81ae-41b0baf4609f-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:53:17 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-1a0328ee-c151-45bd-90aa-4ad90bc58e47 tempest-ProjectMemberTests-864505458 None] Acquiring lock "cinder-quobyte-ff02d9e4-e982-4a79-81ae-41b0baf4609f" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:53:17 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-1a0328ee-c151-45bd-90aa-4ad90bc58e47 tempest-ProjectMemberTests-864505458 None] Lock "cinder-quobyte-ff02d9e4-e982-4a79-81ae-41b0baf4609f" acquired by "delete_volume" :: waited 0.016s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:53:17 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b8ff7b0-1ca2-4127-9a39-a7f4aa78fade]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:53:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1a0328ee-c151-45bd-90aa-4ad90bc58e47 tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ff02d9e4-e982-4a79-81ae-41b0baf4609f {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:53:17 devstack sudo[105826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ff02d9e4-e982-4a79-81ae-41b0baf4609f Sep 18 21:53:17 devstack sudo[105826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:53:17 devstack sudo[105826]: pam_unix(sudo:session): session closed for user root Sep 18 21:53:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1a0328ee-c151-45bd-90aa-4ad90bc58e47 tempest-ProjectMemberTests-864505458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ff02d9e4-e982-4a79-81ae-41b0baf4609f" returned: 0 in 0.355s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:53:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1a0328ee-c151-45bd-90aa-4ad90bc58e47 tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ff02d9e4-e982-4a79-81ae-41b0baf4609f {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:53:17 devstack sudo[105831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ff02d9e4-e982-4a79-81ae-41b0baf4609f Sep 18 21:53:17 devstack sudo[105831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:53:17 devstack sudo[105831]: pam_unix(sudo:session): session closed for user root Sep 18 21:53:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1a0328ee-c151-45bd-90aa-4ad90bc58e47 tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-ff02d9e4-e982-4a79-81ae-41b0baf4609f" returned: 0 in 0.245s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:53:17 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-1a0328ee-c151-45bd-90aa-4ad90bc58e47 tempest-ProjectMemberTests-864505458 None] Lock "cinder-quobyte-ff02d9e4-e982-4a79-81ae-41b0baf4609f" released by "delete_volume" :: held 0.660s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:53:17 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-1a0328ee-c151-45bd-90aa-4ad90bc58e47 tempest-ProjectMemberTests-864505458 None] Created reservations ['0e1b1b94-2a82-44ff-bb16-b9060edefb5d', 'e4196b09-2e98-418b-b1d9-4869a4749ed4', '0403aa0c-df0a-4b60-bae4-a7d72cd0db9b', 'e14d585e-27b5-467d-9c04-62cc965599ac'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:53:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-1a0328ee-c151-45bd-90aa-4ad90bc58e47 tempest-ProjectMemberTests-864505458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:53:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-1a0328ee-c151-45bd-90aa-4ad90bc58e47 tempest-ProjectMemberTests-864505458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:53:17 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-1a0328ee-c151-45bd-90aa-4ad90bc58e47 tempest-ProjectMemberTests-864505458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:53:17 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-1a0328ee-c151-45bd-90aa-4ad90bc58e47 tempest-ProjectMemberTests-864505458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:53:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-1a0328ee-c151-45bd-90aa-4ad90bc58e47 tempest-ProjectMemberTests-864505458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:53:17 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1a0328ee-c151-45bd-90aa-4ad90bc58e47 tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:53:17 devstack sudo[105834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:53:17 devstack sudo[105834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:53:18 devstack sudo[105834]: pam_unix(sudo:session): session closed for user root Sep 18 21:53:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-1a0328ee-c151-45bd-90aa-4ad90bc58e47 tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.246s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:53:18 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-1a0328ee-c151-45bd-90aa-4ad90bc58e47 tempest-ProjectMemberTests-864505458 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:53:18 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-1a0328ee-c151-45bd-90aa-4ad90bc58e47 tempest-ProjectMemberTests-864505458 None] Deleted volume successfully. Sep 18 21:53:18 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-1a0328ee-c151-45bd-90aa-4ad90bc58e47 tempest-ProjectMemberTests-864505458 None] Lock "cinder-ff02d9e4-e982-4a79-81ae-41b0baf4609f-delete_volume" released by "delete_volume" :: held 1.101s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:53:18 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdc25739-d2c8-4a15-ba44-cdd299b761cb tempest-ProjectMemberTests-864505458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:53:18 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-bdc25739-d2c8-4a15-ba44-cdd299b761cb tempest-ProjectMemberTests-864505458 None] Flow 'volume_create_manager' (803c06cb-93e2-41af-b927-dd9e8cda9f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:53:18 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-bdc25739-d2c8-4a15-ba44-cdd299b761cb tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82b9eb0b-cee9-4c7e-87e9-7485180f9a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:53:18 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-bdc25739-d2c8-4a15-ba44-cdd299b761cb tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82b9eb0b-cee9-4c7e-87e9-7485180f9a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:53:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1407160204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f12f4ae4-3fc3-4874-95d3-d448db54b18a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44aed77f70a242029bc978ba9aa69a78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:53:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:53:19Z,use_quota=True,user_id='fbe2b10fb8584161a20a4564db383b3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:53:18 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-bdc25739-d2c8-4a15-ba44-cdd299b761cb tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5182258-a78b-41c9-8602-5e3ceedcd92d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:53:18 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-bdc25739-d2c8-4a15-ba44-cdd299b761cb tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5182258-a78b-41c9-8602-5e3ceedcd92d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:53:18 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-bdc25739-d2c8-4a15-ba44-cdd299b761cb tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f387c40-26b0-49cb-99d8-dd53c8388c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:53:18 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-bdc25739-d2c8-4a15-ba44-cdd299b761cb tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f387c40-26b0-49cb-99d8-dd53c8388c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f12f4ae4-3fc3-4874-95d3-d448db54b18a', 'volume_name': 'volume-f12f4ae4-3fc3-4874-95d3-d448db54b18a', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:53:18 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-bdc25739-d2c8-4a15-ba44-cdd299b761cb tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d857b9c-9f6f-4463-bbc4-28450d128120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:53:18 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-bdc25739-d2c8-4a15-ba44-cdd299b761cb tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d857b9c-9f6f-4463-bbc4-28450d128120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:53:18 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-bdc25739-d2c8-4a15-ba44-cdd299b761cb tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca3ef005-1874-4c83-a0e9-b137ece5f7e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:53:18 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-bdc25739-d2c8-4a15-ba44-cdd299b761cb tempest-ProjectMemberTests-864505458 None] Volume f12f4ae4-3fc3-4874-95d3-d448db54b18a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f12f4ae4-3fc3-4874-95d3-d448db54b18a', 'volume_size': 1} Sep 18 21:53:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-bdc25739-d2c8-4a15-ba44-cdd299b761cb tempest-ProjectMemberTests-864505458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:53:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-bdc25739-d2c8-4a15-ba44-cdd299b761cb tempest-ProjectMemberTests-864505458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:53:18 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-bdc25739-d2c8-4a15-ba44-cdd299b761cb tempest-ProjectMemberTests-864505458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:53:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1407160204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f12f4ae4-3fc3-4874-95d3-d448db54b18a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44aed77f70a242029bc978ba9aa69a78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:53:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:53:19Z,use_quota=True,user_id='fbe2b10fb8584161a20a4564db383b3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:53:18 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-bdc25739-d2c8-4a15-ba44-cdd299b761cb tempest-ProjectMemberTests-864505458 None] Creating volume f12f4ae4-3fc3-4874-95d3-d448db54b18a {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:53:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-bdc25739-d2c8-4a15-ba44-cdd299b761cb tempest-ProjectMemberTests-864505458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:53:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-bdc25739-d2c8-4a15-ba44-cdd299b761cb tempest-ProjectMemberTests-864505458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:53:18 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-bdc25739-d2c8-4a15-ba44-cdd299b761cb tempest-ProjectMemberTests-864505458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:53:18 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-bdc25739-d2c8-4a15-ba44-cdd299b761cb tempest-ProjectMemberTests-864505458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:53:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-bdc25739-d2c8-4a15-ba44-cdd299b761cb tempest-ProjectMemberTests-864505458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:53:18 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-bdc25739-d2c8-4a15-ba44-cdd299b761cb tempest-ProjectMemberTests-864505458 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:53:18 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-bdc25739-d2c8-4a15-ba44-cdd299b761cb tempest-ProjectMemberTests-864505458 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:53:18 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-bdc25739-d2c8-4a15-ba44-cdd299b761cb tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f12f4ae4-3fc3-4874-95d3-d448db54b18a 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:53:18 devstack sudo[105837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f12f4ae4-3fc3-4874-95d3-d448db54b18a 1073741824 Sep 18 21:53:18 devstack sudo[105837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:53:19 devstack sudo[105837]: pam_unix(sudo:session): session closed for user root Sep 18 21:53:19 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-bdc25739-d2c8-4a15-ba44-cdd299b761cb tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f12f4ae4-3fc3-4874-95d3-d448db54b18a 1073741824" returned: 0 in 0.406s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:53:19 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-bdc25739-d2c8-4a15-ba44-cdd299b761cb tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f12f4ae4-3fc3-4874-95d3-d448db54b18a {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:53:19 devstack sudo[105842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f12f4ae4-3fc3-4874-95d3-d448db54b18a Sep 18 21:53:19 devstack sudo[105842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:53:19 devstack sudo[105842]: pam_unix(sudo:session): session closed for user root Sep 18 21:53:19 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-bdc25739-d2c8-4a15-ba44-cdd299b761cb tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f12f4ae4-3fc3-4874-95d3-d448db54b18a" returned: 0 in 0.254s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:53:19 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-bdc25739-d2c8-4a15-ba44-cdd299b761cb tempest-ProjectMemberTests-864505458 None] <== create_volume: return (701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:53:19 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-bdc25739-d2c8-4a15-ba44-cdd299b761cb tempest-ProjectMemberTests-864505458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.703s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:53:19 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-bdc25739-d2c8-4a15-ba44-cdd299b761cb tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca3ef005-1874-4c83-a0e9-b137ece5f7e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f12f4ae4-3fc3-4874-95d3-d448db54b18a', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:53:19 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-bdc25739-d2c8-4a15-ba44-cdd299b761cb tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9c65c2c-1925-44cc-9e10-4027f3f34137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:53:19 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-bdc25739-d2c8-4a15-ba44-cdd299b761cb tempest-ProjectMemberTests-864505458 None] Volume volume-f12f4ae4-3fc3-4874-95d3-d448db54b18a (f12f4ae4-3fc3-4874-95d3-d448db54b18a): created successfully Sep 18 21:53:19 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-bdc25739-d2c8-4a15-ba44-cdd299b761cb tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9c65c2c-1925-44cc-9e10-4027f3f34137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:53:19 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-bdc25739-d2c8-4a15-ba44-cdd299b761cb tempest-ProjectMemberTests-864505458 None] Flow 'volume_create_manager' (803c06cb-93e2-41af-b927-dd9e8cda9f93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:53:19 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-bdc25739-d2c8-4a15-ba44-cdd299b761cb tempest-ProjectMemberTests-864505458 None] Created volume successfully. Sep 18 21:53:19 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c537edc0-13e3-4f9c-8961-0bebeeab274b tempest-ProjectMemberTests-864505458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:53:19 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c537edc0-13e3-4f9c-8961-0bebeeab274b tempest-ProjectMemberTests-864505458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:53:19 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-c537edc0-13e3-4f9c-8961-0bebeeab274b tempest-ProjectMemberTests-864505458 None] Creating offline snapshot 2af17268-a8b0-4f4b-aa23-d12f1bdc4b98 of volume f12f4ae4-3fc3-4874-95d3-d448db54b18a {{(pid=86136) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 21:53:19 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1212e88-e285-40b3-8001-6c9eb2ad25da]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:53:19 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c537edc0-13e3-4f9c-8961-0bebeeab274b tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f12f4ae4-3fc3-4874-95d3-d448db54b18a {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:53:19 devstack sudo[105845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f12f4ae4-3fc3-4874-95d3-d448db54b18a Sep 18 21:53:19 devstack sudo[105845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:53:20 devstack sudo[105845]: pam_unix(sudo:session): session closed for user root Sep 18 21:53:20 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c537edc0-13e3-4f9c-8961-0bebeeab274b tempest-ProjectMemberTests-864505458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f12f4ae4-3fc3-4874-95d3-d448db54b18a" returned: 0 in 0.355s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:53:20 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c537edc0-13e3-4f9c-8961-0bebeeab274b tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f12f4ae4-3fc3-4874-95d3-d448db54b18a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f12f4ae4-3fc3-4874-95d3-d448db54b18a.2af17268-a8b0-4f4b-aa23-d12f1bdc4b98 1G {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:53:20 devstack sudo[105850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f12f4ae4-3fc3-4874-95d3-d448db54b18a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f12f4ae4-3fc3-4874-95d3-d448db54b18a.2af17268-a8b0-4f4b-aa23-d12f1bdc4b98 1G Sep 18 21:53:20 devstack sudo[105850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:53:20 devstack sudo[105850]: pam_unix(sudo:session): session closed for user root Sep 18 21:53:20 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c537edc0-13e3-4f9c-8961-0bebeeab274b tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f12f4ae4-3fc3-4874-95d3-d448db54b18a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f12f4ae4-3fc3-4874-95d3-d448db54b18a.2af17268-a8b0-4f4b-aa23-d12f1bdc4b98 1G" returned: 0 in 0.388s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:53:20 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c537edc0-13e3-4f9c-8961-0bebeeab274b tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f12f4ae4-3fc3-4874-95d3-d448db54b18a -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f12f4ae4-3fc3-4874-95d3-d448db54b18a.2af17268-a8b0-4f4b-aa23-d12f1bdc4b98 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:53:20 devstack sudo[105855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f12f4ae4-3fc3-4874-95d3-d448db54b18a -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f12f4ae4-3fc3-4874-95d3-d448db54b18a.2af17268-a8b0-4f4b-aa23-d12f1bdc4b98 Sep 18 21:53:20 devstack sudo[105855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:53:20 devstack sudo[105855]: pam_unix(sudo:session): session closed for user root Sep 18 21:53:20 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c537edc0-13e3-4f9c-8961-0bebeeab274b tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f12f4ae4-3fc3-4874-95d3-d448db54b18a -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f12f4ae4-3fc3-4874-95d3-d448db54b18a.2af17268-a8b0-4f4b-aa23-d12f1bdc4b98" returned: 0 in 0.297s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:53:20 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-c537edc0-13e3-4f9c-8961-0bebeeab274b tempest-ProjectMemberTests-864505458 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f12f4ae4-3fc3-4874-95d3-d448db54b18a.2af17268-a8b0-4f4b-aa23-d12f1bdc4b98 is being set with open permissions: ugo+rw Sep 18 21:53:20 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c537edc0-13e3-4f9c-8961-0bebeeab274b tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f12f4ae4-3fc3-4874-95d3-d448db54b18a.2af17268-a8b0-4f4b-aa23-d12f1bdc4b98 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:53:20 devstack sudo[105861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f12f4ae4-3fc3-4874-95d3-d448db54b18a.2af17268-a8b0-4f4b-aa23-d12f1bdc4b98 Sep 18 21:53:20 devstack sudo[105861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:53:21 devstack sudo[105861]: pam_unix(sudo:session): session closed for user root Sep 18 21:53:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c537edc0-13e3-4f9c-8961-0bebeeab274b tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f12f4ae4-3fc3-4874-95d3-d448db54b18a.2af17268-a8b0-4f4b-aa23-d12f1bdc4b98" returned: 0 in 0.270s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:53:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c537edc0-13e3-4f9c-8961-0bebeeab274b tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f12f4ae4-3fc3-4874-95d3-d448db54b18a.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:53:21 devstack sudo[105864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f12f4ae4-3fc3-4874-95d3-d448db54b18a.info Sep 18 21:53:21 devstack sudo[105864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:53:21 devstack sudo[105864]: pam_unix(sudo:session): session closed for user root Sep 18 21:53:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c537edc0-13e3-4f9c-8961-0bebeeab274b tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f12f4ae4-3fc3-4874-95d3-d448db54b18a.info" returned: 0 in 0.255s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:53:21 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-c537edc0-13e3-4f9c-8961-0bebeeab274b tempest-ProjectMemberTests-864505458 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f12f4ae4-3fc3-4874-95d3-d448db54b18a.info is being set with open permissions: ugo+rw Sep 18 21:53:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c537edc0-13e3-4f9c-8961-0bebeeab274b tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f12f4ae4-3fc3-4874-95d3-d448db54b18a.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:53:21 devstack sudo[105867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f12f4ae4-3fc3-4874-95d3-d448db54b18a.info Sep 18 21:53:21 devstack sudo[105867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:53:21 devstack sudo[105867]: pam_unix(sudo:session): session closed for user root Sep 18 21:53:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-c537edc0-13e3-4f9c-8961-0bebeeab274b tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f12f4ae4-3fc3-4874-95d3-d448db54b18a.info" returned: 0 in 0.245s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:53:21 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-c537edc0-13e3-4f9c-8961-0bebeeab274b tempest-ProjectMemberTests-864505458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.887s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:53:21 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-c537edc0-13e3-4f9c-8961-0bebeeab274b tempest-ProjectMemberTests-864505458 None] Create snapshot completed successfully Sep 18 21:53:21 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-7406ed8b-a9dc-47e9-9637-63b7beaef53f tempest-ProjectMemberTests-864505458 None] Acquiring lock "cinder-2af17268-a8b0-4f4b-aa23-d12f1bdc4b98-delete_snapshot" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:53:21 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-7406ed8b-a9dc-47e9-9637-63b7beaef53f tempest-ProjectMemberTests-864505458 None] Lock "cinder-2af17268-a8b0-4f4b-aa23-d12f1bdc4b98-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:53:21 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-7406ed8b-a9dc-47e9-9637-63b7beaef53f tempest-ProjectMemberTests-864505458 None] Acquiring lock "cinder-quobyte-f12f4ae4-3fc3-4874-95d3-d448db54b18a" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:53:21 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-7406ed8b-a9dc-47e9-9637-63b7beaef53f tempest-ProjectMemberTests-864505458 None] Lock "cinder-quobyte-f12f4ae4-3fc3-4874-95d3-d448db54b18a" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:53:21 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-7406ed8b-a9dc-47e9-9637-63b7beaef53f tempest-ProjectMemberTests-864505458 None] Acquiring lock "cinder-quobyte-2af17268-a8b0-4f4b-aa23-d12f1bdc4b98" by "_delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:53:22 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-7406ed8b-a9dc-47e9-9637-63b7beaef53f tempest-ProjectMemberTests-864505458 None] Lock "cinder-quobyte-2af17268-a8b0-4f4b-aa23-d12f1bdc4b98" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:53:22 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-7406ed8b-a9dc-47e9-9637-63b7beaef53f tempest-ProjectMemberTests-864505458 None] Deleting offline snapshot 2af17268-a8b0-4f4b-aa23-d12f1bdc4b98 of volume f12f4ae4-3fc3-4874-95d3-d448db54b18a {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 21:53:22 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-7406ed8b-a9dc-47e9-9637-63b7beaef53f tempest-ProjectMemberTests-864505458 None] snapshot_file for this snap is: volume-f12f4ae4-3fc3-4874-95d3-d448db54b18a.2af17268-a8b0-4f4b-aa23-d12f1bdc4b98 {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 21:53:22 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[1833e34e-6fdb-454a-b06b-cf3907ec0ad7]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:53:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-7406ed8b-a9dc-47e9-9637-63b7beaef53f tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f12f4ae4-3fc3-4874-95d3-d448db54b18a.2af17268-a8b0-4f4b-aa23-d12f1bdc4b98 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:53:22 devstack sudo[105870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f12f4ae4-3fc3-4874-95d3-d448db54b18a.2af17268-a8b0-4f4b-aa23-d12f1bdc4b98 Sep 18 21:53:22 devstack sudo[105870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:53:22 devstack sudo[105870]: pam_unix(sudo:session): session closed for user root Sep 18 21:53:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-7406ed8b-a9dc-47e9-9637-63b7beaef53f tempest-ProjectMemberTests-864505458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f12f4ae4-3fc3-4874-95d3-d448db54b18a.2af17268-a8b0-4f4b-aa23-d12f1bdc4b98" returned: 0 in 0.356s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:53:22 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-7406ed8b-a9dc-47e9-9637-63b7beaef53f tempest-ProjectMemberTests-864505458 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f12f4ae4-3fc3-4874-95d3-d448db54b18a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86136) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 21:53:22 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[e96c713f-05df-41fc-83f6-8f4afd1914ba]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:53:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-7406ed8b-a9dc-47e9-9637-63b7beaef53f tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f12f4ae4-3fc3-4874-95d3-d448db54b18a {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:53:22 devstack sudo[105875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f12f4ae4-3fc3-4874-95d3-d448db54b18a Sep 18 21:53:22 devstack sudo[105875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:53:22 devstack sudo[105875]: pam_unix(sudo:session): session closed for user root Sep 18 21:53:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-7406ed8b-a9dc-47e9-9637-63b7beaef53f tempest-ProjectMemberTests-864505458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f12f4ae4-3fc3-4874-95d3-d448db54b18a" returned: 0 in 0.349s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:53:22 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-7406ed8b-a9dc-47e9-9637-63b7beaef53f tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f12f4ae4-3fc3-4874-95d3-d448db54b18a.2af17268-a8b0-4f4b-aa23-d12f1bdc4b98 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:53:22 devstack sudo[105880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f12f4ae4-3fc3-4874-95d3-d448db54b18a.2af17268-a8b0-4f4b-aa23-d12f1bdc4b98 Sep 18 21:53:22 devstack sudo[105880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:53:23 devstack sudo[105880]: pam_unix(sudo:session): session closed for user root Sep 18 21:53:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-7406ed8b-a9dc-47e9-9637-63b7beaef53f tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f12f4ae4-3fc3-4874-95d3-d448db54b18a.2af17268-a8b0-4f4b-aa23-d12f1bdc4b98" returned: 0 in 0.328s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:53:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-7406ed8b-a9dc-47e9-9637-63b7beaef53f tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f12f4ae4-3fc3-4874-95d3-d448db54b18a.2af17268-a8b0-4f4b-aa23-d12f1bdc4b98 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:53:23 devstack sudo[105885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f12f4ae4-3fc3-4874-95d3-d448db54b18a.2af17268-a8b0-4f4b-aa23-d12f1bdc4b98 Sep 18 21:53:23 devstack sudo[105885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:53:23 devstack sudo[105885]: pam_unix(sudo:session): session closed for user root Sep 18 21:53:23 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-7406ed8b-a9dc-47e9-9637-63b7beaef53f tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f12f4ae4-3fc3-4874-95d3-d448db54b18a.2af17268-a8b0-4f4b-aa23-d12f1bdc4b98" returned: 0 in 0.245s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:53:23 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-7406ed8b-a9dc-47e9-9637-63b7beaef53f tempest-ProjectMemberTests-864505458 None] Lock "cinder-quobyte-2af17268-a8b0-4f4b-aa23-d12f1bdc4b98" released by "_delete_snapshot" :: held 1.371s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:53:23 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-7406ed8b-a9dc-47e9-9637-63b7beaef53f tempest-ProjectMemberTests-864505458 None] Lock "cinder-quobyte-f12f4ae4-3fc3-4874-95d3-d448db54b18a" released by "delete_snapshot" :: held 1.389s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:53:23 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-7406ed8b-a9dc-47e9-9637-63b7beaef53f tempest-ProjectMemberTests-864505458 None] Created reservations ['2b36e045-6972-4502-bf45-6498fc62cbbd', 'a559e361-7008-4729-a1e8-9f57fe31fce3', '248c662e-0379-4e7d-bf7d-b27a7db52fa2', '6ea583d7-f3c3-4fef-9595-3577c00f8c34'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:53:23 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-7406ed8b-a9dc-47e9-9637-63b7beaef53f tempest-ProjectMemberTests-864505458 None] Delete snapshot completed successfully. Sep 18 21:53:23 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-7406ed8b-a9dc-47e9-9637-63b7beaef53f tempest-ProjectMemberTests-864505458 None] Lock "cinder-2af17268-a8b0-4f4b-aa23-d12f1bdc4b98-delete_snapshot" released by "delete_snapshot" :: held 1.512s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:53:24 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d4f0fb02-0d5b-4b82-9f24-3840e26e465b tempest-ProjectMemberTests-864505458 None] Acquiring lock "cinder-f12f4ae4-3fc3-4874-95d3-d448db54b18a-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:53:24 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d4f0fb02-0d5b-4b82-9f24-3840e26e465b tempest-ProjectMemberTests-864505458 None] Lock "cinder-f12f4ae4-3fc3-4874-95d3-d448db54b18a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:53:24 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d4f0fb02-0d5b-4b82-9f24-3840e26e465b tempest-ProjectMemberTests-864505458 None] Acquiring lock "cinder-quobyte-f12f4ae4-3fc3-4874-95d3-d448db54b18a" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:53:24 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d4f0fb02-0d5b-4b82-9f24-3840e26e465b tempest-ProjectMemberTests-864505458 None] Lock "cinder-quobyte-f12f4ae4-3fc3-4874-95d3-d448db54b18a" acquired by "delete_volume" :: waited 0.015s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:53:24 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b87c67a-7d88-409b-94f9-9fa9a2e486aa]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:53:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d4f0fb02-0d5b-4b82-9f24-3840e26e465b tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f12f4ae4-3fc3-4874-95d3-d448db54b18a {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:53:24 devstack sudo[105888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f12f4ae4-3fc3-4874-95d3-d448db54b18a Sep 18 21:53:24 devstack sudo[105888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:53:24 devstack sudo[105888]: pam_unix(sudo:session): session closed for user root Sep 18 21:53:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d4f0fb02-0d5b-4b82-9f24-3840e26e465b tempest-ProjectMemberTests-864505458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f12f4ae4-3fc3-4874-95d3-d448db54b18a" returned: 0 in 0.355s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:53:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d4f0fb02-0d5b-4b82-9f24-3840e26e465b tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f12f4ae4-3fc3-4874-95d3-d448db54b18a {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:53:24 devstack sudo[105893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f12f4ae4-3fc3-4874-95d3-d448db54b18a Sep 18 21:53:24 devstack sudo[105893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:53:24 devstack sudo[105893]: pam_unix(sudo:session): session closed for user root Sep 18 21:53:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d4f0fb02-0d5b-4b82-9f24-3840e26e465b tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-f12f4ae4-3fc3-4874-95d3-d448db54b18a" returned: 0 in 0.250s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:53:24 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d4f0fb02-0d5b-4b82-9f24-3840e26e465b tempest-ProjectMemberTests-864505458 None] Lock "cinder-quobyte-f12f4ae4-3fc3-4874-95d3-d448db54b18a" released by "delete_volume" :: held 0.663s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:53:24 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-d4f0fb02-0d5b-4b82-9f24-3840e26e465b tempest-ProjectMemberTests-864505458 None] Created reservations ['ca420dc0-8372-4b8a-96c9-b7589569763d', 'a1c7e671-5432-4b2e-afff-dade3f6a99c7', '146f8e87-5ccc-4987-b511-8bb2dc8a0028', 'c776fe3c-cc51-4e63-aa58-7683bc72e2b4'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:53:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-d4f0fb02-0d5b-4b82-9f24-3840e26e465b tempest-ProjectMemberTests-864505458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:53:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-d4f0fb02-0d5b-4b82-9f24-3840e26e465b tempest-ProjectMemberTests-864505458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:53:24 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-d4f0fb02-0d5b-4b82-9f24-3840e26e465b tempest-ProjectMemberTests-864505458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:53:24 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-d4f0fb02-0d5b-4b82-9f24-3840e26e465b tempest-ProjectMemberTests-864505458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:53:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-d4f0fb02-0d5b-4b82-9f24-3840e26e465b tempest-ProjectMemberTests-864505458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:53:24 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d4f0fb02-0d5b-4b82-9f24-3840e26e465b tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:53:24 devstack sudo[105896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:53:24 devstack sudo[105896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:53:25 devstack sudo[105896]: pam_unix(sudo:session): session closed for user root Sep 18 21:53:25 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d4f0fb02-0d5b-4b82-9f24-3840e26e465b tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.252s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:53:25 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-d4f0fb02-0d5b-4b82-9f24-3840e26e465b tempest-ProjectMemberTests-864505458 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:53:25 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-d4f0fb02-0d5b-4b82-9f24-3840e26e465b tempest-ProjectMemberTests-864505458 None] Deleted volume successfully. Sep 18 21:53:25 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-d4f0fb02-0d5b-4b82-9f24-3840e26e465b tempest-ProjectMemberTests-864505458 None] Lock "cinder-f12f4ae4-3fc3-4874-95d3-d448db54b18a-delete_volume" released by "delete_volume" :: held 1.092s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:53:25 devstack cinder-volume[86136]: DEBUG cinder.volume.flows.manager.create_volume [None req-d65477f2-d738-4868-9c44-49efefe4a6ee tempest-ProjectMemberTests-864505458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86136) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 21:53:25 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d65477f2-d738-4868-9c44-49efefe4a6ee tempest-ProjectMemberTests-864505458 None] Flow 'volume_create_manager' (62cda286-5f74-4e56-a882-4fc2c8d45b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:53:25 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d65477f2-d738-4868-9c44-49efefe4a6ee tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c533c688-20af-4fb9-929b-3c25515c2405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:53:25 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d65477f2-d738-4868-9c44-49efefe4a6ee tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c533c688-20af-4fb9-929b-3c25515c2405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:53:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1674885905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eeec9b8-f4ab-4153-9c4c-1e4d35daf451,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44aed77f70a242029bc978ba9aa69a78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:53:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:53:26Z,use_quota=True,user_id='fbe2b10fb8584161a20a4564db383b3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:53:25 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d65477f2-d738-4868-9c44-49efefe4a6ee tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d92875ae-4071-4840-ad42-ef3de16303cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:53:25 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d65477f2-d738-4868-9c44-49efefe4a6ee tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d92875ae-4071-4840-ad42-ef3de16303cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:53:25 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d65477f2-d738-4868-9c44-49efefe4a6ee tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (188a6b02-d65e-4224-81f6-80cd38c441ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:53:25 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d65477f2-d738-4868-9c44-49efefe4a6ee tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (188a6b02-d65e-4224-81f6-80cd38c441ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2eeec9b8-f4ab-4153-9c4c-1e4d35daf451', 'volume_name': 'volume-2eeec9b8-f4ab-4153-9c4c-1e4d35daf451', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:53:25 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d65477f2-d738-4868-9c44-49efefe4a6ee tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8713607-4592-4f2e-893a-07b1a6b2f093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:53:25 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d65477f2-d738-4868-9c44-49efefe4a6ee tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8713607-4592-4f2e-893a-07b1a6b2f093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:53:25 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d65477f2-d738-4868-9c44-49efefe4a6ee tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a279a0a0-70c8-4ee6-b6b7-ff17358f99c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:53:25 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-d65477f2-d738-4868-9c44-49efefe4a6ee tempest-ProjectMemberTests-864505458 None] Volume 2eeec9b8-f4ab-4153-9c4c-1e4d35daf451: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2eeec9b8-f4ab-4153-9c4c-1e4d35daf451', 'volume_size': 1} Sep 18 21:53:25 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-d65477f2-d738-4868-9c44-49efefe4a6ee tempest-ProjectMemberTests-864505458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:53:25 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-d65477f2-d738-4868-9c44-49efefe4a6ee tempest-ProjectMemberTests-864505458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:53:25 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-d65477f2-d738-4868-9c44-49efefe4a6ee tempest-ProjectMemberTests-864505458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T19:53:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1674885905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eeec9b8-f4ab-4153-9c4c-1e4d35daf451,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44aed77f70a242029bc978ba9aa69a78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T19:53:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T19:53:26Z,use_quota=True,user_id='fbe2b10fb8584161a20a4564db383b3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d115133b-d148-430e-bf5d-ef89b6248027),volume_type_id=d115133b-d148-430e-bf5d-ef89b6248027)}" {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 21:53:25 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-d65477f2-d738-4868-9c44-49efefe4a6ee tempest-ProjectMemberTests-864505458 None] Creating volume 2eeec9b8-f4ab-4153-9c4c-1e4d35daf451 {{(pid=86136) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 21:53:25 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-d65477f2-d738-4868-9c44-49efefe4a6ee tempest-ProjectMemberTests-864505458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:53:25 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-d65477f2-d738-4868-9c44-49efefe4a6ee tempest-ProjectMemberTests-864505458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:53:25 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-d65477f2-d738-4868-9c44-49efefe4a6ee tempest-ProjectMemberTests-864505458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:53:25 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-d65477f2-d738-4868-9c44-49efefe4a6ee tempest-ProjectMemberTests-864505458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:53:25 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-d65477f2-d738-4868-9c44-49efefe4a6ee tempest-ProjectMemberTests-864505458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:53:25 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-d65477f2-d738-4868-9c44-49efefe4a6ee tempest-ProjectMemberTests-864505458 None] Selected osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff as target Quobyte volume. {{(pid=86136) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 21:53:25 devstack cinder-volume[86136]: INFO cinder.volume.drivers.remotefs [None req-d65477f2-d738-4868-9c44-49efefe4a6ee tempest-ProjectMemberTests-864505458 None] casted to osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff Sep 18 21:53:25 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d65477f2-d738-4868-9c44-49efefe4a6ee tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2eeec9b8-f4ab-4153-9c4c-1e4d35daf451 1073741824 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:53:25 devstack sudo[105899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2eeec9b8-f4ab-4153-9c4c-1e4d35daf451 1073741824 Sep 18 21:53:25 devstack sudo[105899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:53:26 devstack sudo[105899]: pam_unix(sudo:session): session closed for user root Sep 18 21:53:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d65477f2-d738-4868-9c44-49efefe4a6ee tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2eeec9b8-f4ab-4153-9c4c-1e4d35daf451 1073741824" returned: 0 in 0.406s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:53:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d65477f2-d738-4868-9c44-49efefe4a6ee tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2eeec9b8-f4ab-4153-9c4c-1e4d35daf451 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:53:26 devstack sudo[105905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2eeec9b8-f4ab-4153-9c4c-1e4d35daf451 Sep 18 21:53:26 devstack sudo[105905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:53:26 devstack sudo[105905]: pam_unix(sudo:session): session closed for user root Sep 18 21:53:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-d65477f2-d738-4868-9c44-49efefe4a6ee tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2eeec9b8-f4ab-4153-9c4c-1e4d35daf451" returned: 0 in 0.241s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:53:26 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-d65477f2-d738-4868-9c44-49efefe4a6ee tempest-ProjectMemberTests-864505458 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'} {{(pid=86136) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 21:53:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-d65477f2-d738-4868-9c44-49efefe4a6ee tempest-ProjectMemberTests-864505458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:53:26 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d65477f2-d738-4868-9c44-49efefe4a6ee tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a279a0a0-70c8-4ee6-b6b7-ff17358f99c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2eeec9b8-f4ab-4153-9c4c-1e4d35daf451', 'volume_size': 1}' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:53:26 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d65477f2-d738-4868-9c44-49efefe4a6ee tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9038b3a6-28cc-49f6-85ea-e403a2ebc261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 21:53:26 devstack cinder-volume[86136]: INFO cinder.volume.flows.manager.create_volume [None req-d65477f2-d738-4868-9c44-49efefe4a6ee tempest-ProjectMemberTests-864505458 None] Volume volume-2eeec9b8-f4ab-4153-9c4c-1e4d35daf451 (2eeec9b8-f4ab-4153-9c4c-1e4d35daf451): created successfully Sep 18 21:53:26 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d65477f2-d738-4868-9c44-49efefe4a6ee tempest-ProjectMemberTests-864505458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9038b3a6-28cc-49f6-85ea-e403a2ebc261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86136) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 21:53:26 devstack cinder-volume[86136]: DEBUG cinder.volume.manager [None req-d65477f2-d738-4868-9c44-49efefe4a6ee tempest-ProjectMemberTests-864505458 None] Flow 'volume_create_manager' (62cda286-5f74-4e56-a882-4fc2c8d45b17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86136) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 21:53:26 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-d65477f2-d738-4868-9c44-49efefe4a6ee tempest-ProjectMemberTests-864505458 None] Created volume successfully. Sep 18 21:53:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-0b9b7ec5-ab4c-4d12-aef3-fd4a84842d4e tempest-ProjectMemberTests-864505458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:53:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-0b9b7ec5-ab4c-4d12-aef3-fd4a84842d4e tempest-ProjectMemberTests-864505458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:53:26 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-0b9b7ec5-ab4c-4d12-aef3-fd4a84842d4e tempest-ProjectMemberTests-864505458 None] Creating offline snapshot 4abde79f-ddd7-4f77-9754-79379e4ba7f6 of volume 2eeec9b8-f4ab-4153-9c4c-1e4d35daf451 {{(pid=86136) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 21:53:26 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b379f9-a81c-4c86-a05d-51c1dd3d9650]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:53:26 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0b9b7ec5-ab4c-4d12-aef3-fd4a84842d4e tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2eeec9b8-f4ab-4153-9c4c-1e4d35daf451 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:53:26 devstack sudo[105908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2eeec9b8-f4ab-4153-9c4c-1e4d35daf451 Sep 18 21:53:26 devstack sudo[105908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:53:27 devstack sudo[105908]: pam_unix(sudo:session): session closed for user root Sep 18 21:53:27 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0b9b7ec5-ab4c-4d12-aef3-fd4a84842d4e tempest-ProjectMemberTests-864505458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2eeec9b8-f4ab-4153-9c4c-1e4d35daf451" returned: 0 in 0.351s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:53:27 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0b9b7ec5-ab4c-4d12-aef3-fd4a84842d4e tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2eeec9b8-f4ab-4153-9c4c-1e4d35daf451,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2eeec9b8-f4ab-4153-9c4c-1e4d35daf451.4abde79f-ddd7-4f77-9754-79379e4ba7f6 1G {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:53:27 devstack sudo[105913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2eeec9b8-f4ab-4153-9c4c-1e4d35daf451,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2eeec9b8-f4ab-4153-9c4c-1e4d35daf451.4abde79f-ddd7-4f77-9754-79379e4ba7f6 1G Sep 18 21:53:27 devstack sudo[105913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:53:27 devstack sudo[105913]: pam_unix(sudo:session): session closed for user root Sep 18 21:53:27 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0b9b7ec5-ab4c-4d12-aef3-fd4a84842d4e tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2eeec9b8-f4ab-4153-9c4c-1e4d35daf451,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2eeec9b8-f4ab-4153-9c4c-1e4d35daf451.4abde79f-ddd7-4f77-9754-79379e4ba7f6 1G" returned: 0 in 0.377s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:53:27 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0b9b7ec5-ab4c-4d12-aef3-fd4a84842d4e tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2eeec9b8-f4ab-4153-9c4c-1e4d35daf451 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2eeec9b8-f4ab-4153-9c4c-1e4d35daf451.4abde79f-ddd7-4f77-9754-79379e4ba7f6 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:53:27 devstack sudo[105924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2eeec9b8-f4ab-4153-9c4c-1e4d35daf451 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2eeec9b8-f4ab-4153-9c4c-1e4d35daf451.4abde79f-ddd7-4f77-9754-79379e4ba7f6 Sep 18 21:53:27 devstack sudo[105924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:53:27 devstack sudo[105924]: pam_unix(sudo:session): session closed for user root Sep 18 21:53:27 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0b9b7ec5-ab4c-4d12-aef3-fd4a84842d4e tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2eeec9b8-f4ab-4153-9c4c-1e4d35daf451 -F qcow2 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2eeec9b8-f4ab-4153-9c4c-1e4d35daf451.4abde79f-ddd7-4f77-9754-79379e4ba7f6" returned: 0 in 0.287s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:53:27 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-0b9b7ec5-ab4c-4d12-aef3-fd4a84842d4e tempest-ProjectMemberTests-864505458 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2eeec9b8-f4ab-4153-9c4c-1e4d35daf451.4abde79f-ddd7-4f77-9754-79379e4ba7f6 is being set with open permissions: ugo+rw Sep 18 21:53:27 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0b9b7ec5-ab4c-4d12-aef3-fd4a84842d4e tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2eeec9b8-f4ab-4153-9c4c-1e4d35daf451.4abde79f-ddd7-4f77-9754-79379e4ba7f6 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:53:27 devstack sudo[105929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2eeec9b8-f4ab-4153-9c4c-1e4d35daf451.4abde79f-ddd7-4f77-9754-79379e4ba7f6 Sep 18 21:53:27 devstack sudo[105929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:53:28 devstack sudo[105929]: pam_unix(sudo:session): session closed for user root Sep 18 21:53:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0b9b7ec5-ab4c-4d12-aef3-fd4a84842d4e tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2eeec9b8-f4ab-4153-9c4c-1e4d35daf451.4abde79f-ddd7-4f77-9754-79379e4ba7f6" returned: 0 in 0.246s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:53:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0b9b7ec5-ab4c-4d12-aef3-fd4a84842d4e tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2eeec9b8-f4ab-4153-9c4c-1e4d35daf451.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:53:28 devstack sudo[105932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2eeec9b8-f4ab-4153-9c4c-1e4d35daf451.info Sep 18 21:53:28 devstack sudo[105932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:53:28 devstack sudo[105932]: pam_unix(sudo:session): session closed for user root Sep 18 21:53:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0b9b7ec5-ab4c-4d12-aef3-fd4a84842d4e tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2eeec9b8-f4ab-4153-9c4c-1e4d35daf451.info" returned: 0 in 0.261s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:53:28 devstack cinder-volume[86136]: WARNING cinder.volume.drivers.remotefs [None req-0b9b7ec5-ab4c-4d12-aef3-fd4a84842d4e tempest-ProjectMemberTests-864505458 None] /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2eeec9b8-f4ab-4153-9c4c-1e4d35daf451.info is being set with open permissions: ugo+rw Sep 18 21:53:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0b9b7ec5-ab4c-4d12-aef3-fd4a84842d4e tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2eeec9b8-f4ab-4153-9c4c-1e4d35daf451.info {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:53:28 devstack sudo[105969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2eeec9b8-f4ab-4153-9c4c-1e4d35daf451.info Sep 18 21:53:28 devstack sudo[105969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:53:28 devstack sudo[105969]: pam_unix(sudo:session): session closed for user root Sep 18 21:53:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-0b9b7ec5-ab4c-4d12-aef3-fd4a84842d4e tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2eeec9b8-f4ab-4153-9c4c-1e4d35daf451.info" returned: 0 in 0.250s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:53:28 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-0b9b7ec5-ab4c-4d12-aef3-fd4a84842d4e tempest-ProjectMemberTests-864505458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.855s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:53:28 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-0b9b7ec5-ab4c-4d12-aef3-fd4a84842d4e tempest-ProjectMemberTests-864505458 None] Create snapshot completed successfully Sep 18 21:53:29 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-22997dd8-8c75-46fd-9447-7954e7140d24 tempest-ProjectMemberTests-864505458 None] Acquiring lock "cinder-4abde79f-ddd7-4f77-9754-79379e4ba7f6-delete_snapshot" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:53:29 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-22997dd8-8c75-46fd-9447-7954e7140d24 tempest-ProjectMemberTests-864505458 None] Lock "cinder-4abde79f-ddd7-4f77-9754-79379e4ba7f6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:53:29 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-22997dd8-8c75-46fd-9447-7954e7140d24 tempest-ProjectMemberTests-864505458 None] Acquiring lock "cinder-quobyte-2eeec9b8-f4ab-4153-9c4c-1e4d35daf451" by "delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:53:29 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-22997dd8-8c75-46fd-9447-7954e7140d24 tempest-ProjectMemberTests-864505458 None] Lock "cinder-quobyte-2eeec9b8-f4ab-4153-9c4c-1e4d35daf451" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:53:29 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-22997dd8-8c75-46fd-9447-7954e7140d24 tempest-ProjectMemberTests-864505458 None] Acquiring lock "cinder-quobyte-4abde79f-ddd7-4f77-9754-79379e4ba7f6" by "_delete_snapshot" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:53:29 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-22997dd8-8c75-46fd-9447-7954e7140d24 tempest-ProjectMemberTests-864505458 None] Lock "cinder-quobyte-4abde79f-ddd7-4f77-9754-79379e4ba7f6" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:53:29 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-22997dd8-8c75-46fd-9447-7954e7140d24 tempest-ProjectMemberTests-864505458 None] Deleting offline snapshot 4abde79f-ddd7-4f77-9754-79379e4ba7f6 of volume 2eeec9b8-f4ab-4153-9c4c-1e4d35daf451 {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 21:53:29 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-22997dd8-8c75-46fd-9447-7954e7140d24 tempest-ProjectMemberTests-864505458 None] snapshot_file for this snap is: volume-2eeec9b8-f4ab-4153-9c4c-1e4d35daf451.4abde79f-ddd7-4f77-9754-79379e4ba7f6 {{(pid=86136) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 21:53:29 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d1bcb32-0ab3-41ac-8929-e7dc3fd1d302]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:53:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-22997dd8-8c75-46fd-9447-7954e7140d24 tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2eeec9b8-f4ab-4153-9c4c-1e4d35daf451.4abde79f-ddd7-4f77-9754-79379e4ba7f6 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:53:29 devstack sudo[105974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2eeec9b8-f4ab-4153-9c4c-1e4d35daf451.4abde79f-ddd7-4f77-9754-79379e4ba7f6 Sep 18 21:53:29 devstack sudo[105974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:53:29 devstack sudo[105974]: pam_unix(sudo:session): session closed for user root Sep 18 21:53:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-22997dd8-8c75-46fd-9447-7954e7140d24 tempest-ProjectMemberTests-864505458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2eeec9b8-f4ab-4153-9c4c-1e4d35daf451.4abde79f-ddd7-4f77-9754-79379e4ba7f6" returned: 0 in 0.349s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:53:29 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.remotefs [None req-22997dd8-8c75-46fd-9447-7954e7140d24 tempest-ProjectMemberTests-864505458 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2eeec9b8-f4ab-4153-9c4c-1e4d35daf451(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86136) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 21:53:29 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[29215eea-4da3-4e63-90d7-6a2d9eba1628]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:53:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-22997dd8-8c75-46fd-9447-7954e7140d24 tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2eeec9b8-f4ab-4153-9c4c-1e4d35daf451 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:53:29 devstack sudo[105979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2eeec9b8-f4ab-4153-9c4c-1e4d35daf451 Sep 18 21:53:29 devstack sudo[105979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:53:29 devstack sudo[105979]: pam_unix(sudo:session): session closed for user root Sep 18 21:53:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-22997dd8-8c75-46fd-9447-7954e7140d24 tempest-ProjectMemberTests-864505458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2eeec9b8-f4ab-4153-9c4c-1e4d35daf451" returned: 0 in 0.357s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:53:29 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-22997dd8-8c75-46fd-9447-7954e7140d24 tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2eeec9b8-f4ab-4153-9c4c-1e4d35daf451.4abde79f-ddd7-4f77-9754-79379e4ba7f6 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:53:29 devstack sudo[105985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2eeec9b8-f4ab-4153-9c4c-1e4d35daf451.4abde79f-ddd7-4f77-9754-79379e4ba7f6 Sep 18 21:53:29 devstack sudo[105985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:53:30 devstack sudo[105985]: pam_unix(sudo:session): session closed for user root Sep 18 21:53:30 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-22997dd8-8c75-46fd-9447-7954e7140d24 tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2eeec9b8-f4ab-4153-9c4c-1e4d35daf451.4abde79f-ddd7-4f77-9754-79379e4ba7f6" returned: 0 in 0.327s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:53:30 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-22997dd8-8c75-46fd-9447-7954e7140d24 tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2eeec9b8-f4ab-4153-9c4c-1e4d35daf451.4abde79f-ddd7-4f77-9754-79379e4ba7f6 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:53:30 devstack sudo[105990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2eeec9b8-f4ab-4153-9c4c-1e4d35daf451.4abde79f-ddd7-4f77-9754-79379e4ba7f6 Sep 18 21:53:30 devstack sudo[105990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:53:30 devstack sudo[105990]: pam_unix(sudo:session): session closed for user root Sep 18 21:53:30 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-22997dd8-8c75-46fd-9447-7954e7140d24 tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2eeec9b8-f4ab-4153-9c4c-1e4d35daf451.4abde79f-ddd7-4f77-9754-79379e4ba7f6" returned: 0 in 0.240s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:53:30 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-22997dd8-8c75-46fd-9447-7954e7140d24 tempest-ProjectMemberTests-864505458 None] Lock "cinder-quobyte-4abde79f-ddd7-4f77-9754-79379e4ba7f6" released by "_delete_snapshot" :: held 1.363s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:53:30 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-22997dd8-8c75-46fd-9447-7954e7140d24 tempest-ProjectMemberTests-864505458 None] Lock "cinder-quobyte-2eeec9b8-f4ab-4153-9c4c-1e4d35daf451" released by "delete_snapshot" :: held 1.382s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:53:30 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-22997dd8-8c75-46fd-9447-7954e7140d24 tempest-ProjectMemberTests-864505458 None] Created reservations ['71b3f368-81ed-4668-a932-e8e981d602f9', 'e41c3cab-3c1b-4358-ad2a-98565a4f18dc', '9ca4b815-b435-4ad1-ad56-480c4374ea62', 'c4392ff8-7381-4870-930e-64aa655189cd'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:53:30 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-22997dd8-8c75-46fd-9447-7954e7140d24 tempest-ProjectMemberTests-864505458 None] Delete snapshot completed successfully. Sep 18 21:53:30 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-22997dd8-8c75-46fd-9447-7954e7140d24 tempest-ProjectMemberTests-864505458 None] Lock "cinder-4abde79f-ddd7-4f77-9754-79379e4ba7f6-delete_snapshot" released by "delete_snapshot" :: held 1.506s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:53:31 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-afcb4f1c-5b49-467c-aa51-0c8e7115ac82 tempest-ProjectMemberTests-864505458 None] Acquiring lock "cinder-2eeec9b8-f4ab-4153-9c4c-1e4d35daf451-delete_volume" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:53:31 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-afcb4f1c-5b49-467c-aa51-0c8e7115ac82 tempest-ProjectMemberTests-864505458 None] Lock "cinder-2eeec9b8-f4ab-4153-9c4c-1e4d35daf451-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:53:31 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-afcb4f1c-5b49-467c-aa51-0c8e7115ac82 tempest-ProjectMemberTests-864505458 None] Acquiring lock "cinder-quobyte-2eeec9b8-f4ab-4153-9c4c-1e4d35daf451" by "delete_volume" {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 21:53:31 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-afcb4f1c-5b49-467c-aa51-0c8e7115ac82 tempest-ProjectMemberTests-864505458 None] Lock "cinder-quobyte-2eeec9b8-f4ab-4153-9c4c-1e4d35daf451" acquired by "delete_volume" :: waited 0.014s {{(pid=86136) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 21:53:31 devstack cinder-volume[86136]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c2e1d46-4222-4dd9-8042-291e6495018c]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 21:53:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-afcb4f1c-5b49-467c-aa51-0c8e7115ac82 tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2eeec9b8-f4ab-4153-9c4c-1e4d35daf451 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:53:31 devstack sudo[105994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2eeec9b8-f4ab-4153-9c4c-1e4d35daf451 Sep 18 21:53:31 devstack sudo[105994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:53:31 devstack sudo[105994]: pam_unix(sudo:session): session closed for user root Sep 18 21:53:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-afcb4f1c-5b49-467c-aa51-0c8e7115ac82 tempest-ProjectMemberTests-864505458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2eeec9b8-f4ab-4153-9c4c-1e4d35daf451" returned: 0 in 0.351s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:53:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-afcb4f1c-5b49-467c-aa51-0c8e7115ac82 tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2eeec9b8-f4ab-4153-9c4c-1e4d35daf451 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:53:31 devstack sudo[105999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2eeec9b8-f4ab-4153-9c4c-1e4d35daf451 Sep 18 21:53:31 devstack sudo[105999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:53:31 devstack sudo[105999]: pam_unix(sudo:session): session closed for user root Sep 18 21:53:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-afcb4f1c-5b49-467c-aa51-0c8e7115ac82 tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420/volume-2eeec9b8-f4ab-4153-9c4c-1e4d35daf451" returned: 0 in 0.240s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:53:31 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-afcb4f1c-5b49-467c-aa51-0c8e7115ac82 tempest-ProjectMemberTests-864505458 None] Lock "cinder-quobyte-2eeec9b8-f4ab-4153-9c4c-1e4d35daf451" released by "delete_volume" :: held 0.651s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:53:31 devstack cinder-volume[86136]: DEBUG cinder.quota [None req-afcb4f1c-5b49-467c-aa51-0c8e7115ac82 tempest-ProjectMemberTests-864505458 None] Created reservations ['345d999b-9f71-4e36-9ae9-a6a1b32294dd', '3849f911-7d06-4545-9691-518d267ad72c', 'f67b210e-0582-4453-87a9-d3dcde0f3fc2', '9169cfe9-83dd-4f08-b852-df1c00294b64'] {{(pid=86136) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 21:53:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-afcb4f1c-5b49-467c-aa51-0c8e7115ac82 tempest-ProjectMemberTests-864505458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 21:53:31 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-afcb4f1c-5b49-467c-aa51-0c8e7115ac82 tempest-ProjectMemberTests-864505458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 21:53:31 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-afcb4f1c-5b49-467c-aa51-0c8e7115ac82 tempest-ProjectMemberTests-864505458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff': None} {{(pid=86136) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 21:53:32 devstack cinder-volume[86136]: DEBUG cinder.volume.drivers.quobyte [None req-afcb4f1c-5b49-467c-aa51-0c8e7115ac82 tempest-ProjectMemberTests-864505458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-596cdb33-2e83-4442-8add-bf46ab6ec6ff'] {{(pid=86136) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 21:53:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.lockutils [None req-afcb4f1c-5b49-467c-aa51-0c8e7115ac82 tempest-ProjectMemberTests-864505458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86136) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 21:53:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-afcb4f1c-5b49-467c-aa51-0c8e7115ac82 tempest-ProjectMemberTests-864505458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 21:53:32 devstack sudo[106002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420 Sep 18 21:53:32 devstack sudo[106002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 21:53:32 devstack sudo[106002]: pam_unix(sudo:session): session closed for user root Sep 18 21:53:32 devstack cinder-volume[86136]: DEBUG oslo_concurrency.processutils [None req-afcb4f1c-5b49-467c-aa51-0c8e7115ac82 tempest-ProjectMemberTests-864505458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/160f98a25c35c5b0b177123f9a518420" returned: 0 in 0.247s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 21:53:32 devstack cinder-volume[86136]: DEBUG cinder.manager [None req-afcb4f1c-5b49-467c-aa51-0c8e7115ac82 tempest-ProjectMemberTests-864505458 None] Notifying Schedulers of capabilities ... {{(pid=86136) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 21:53:32 devstack cinder-volume[86136]: INFO cinder.volume.manager [None req-afcb4f1c-5b49-467c-aa51-0c8e7115ac82 tempest-ProjectMemberTests-864505458 None] Deleted volume successfully. Sep 18 21:53:32 devstack cinder-volume[86136]: DEBUG cinder.coordination [None req-afcb4f1c-5b49-467c-aa51-0c8e7115ac82 tempest-ProjectMemberTests-864505458 None] Lock "cinder-2eeec9b8-f4ab-4153-9c4c-1e4d35daf451-delete_volume" released by "delete_volume" :: held 1.077s {{(pid=86136) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 21:53:41 devstack cinder-volume[86136]: DEBUG dbcounter [-] [86136] Writing DB stats cinder:INSERT=36,cinder:UPDATE=144,cinder:SELECT=104,cinder:DELETE=12 {{(pid=86136) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 21:53:42 devstack cinder-volume[86136]: DEBUG dbcounter [-] [86136] Writing DB stats cinder:SELECT=121,cinder:INSERT=46,cinder:UPDATE=164,cinder:DELETE=14 {{(pid=86136) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}